Jun 09 11:04:41.423077 ip-10-0-131-194 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 11:04:41.423086 ip-10-0-131-194 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 11:04:41.423093 ip-10-0-131-194 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 11:04:41.423236 ip-10-0-131-194 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 11:04:51.490568 ip-10-0-131-194 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 11:04:51.490582 ip-10-0-131-194 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 46c64cd52aa949188c54cd0e7894dffd -- Jun 09 11:07:23.987159 ip-10-0-131-194 systemd[1]: Starting Kubernetes Kubelet... Jun 09 11:07:24.341474 ip-10-0-131-194 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:07:24.341474 ip-10-0-131-194 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 11:07:24.341474 ip-10-0-131-194 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:07:24.341474 ip-10-0-131-194 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 11:07:24.341474 ip-10-0-131-194 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:07:24.343693 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.343609 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 11:07:24.348077 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348062 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:07:24.348077 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348077 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348081 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348085 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348087 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348090 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348093 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348096 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348099 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348101 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348104 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348107 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348109 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348112 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348114 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348117 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348119 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348123 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348126 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348129 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348131 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:07:24.348140 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348134 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348142 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348145 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348148 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348152 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348155 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348157 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348160 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348162 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348165 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348168 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348170 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348173 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348176 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348178 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348181 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348185 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348189 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348193 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:07:24.348621 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348195 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348198 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348200 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348203 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348205 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348208 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348210 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348213 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348215 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348218 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348221 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348224 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348227 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348231 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348235 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348239 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348242 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348245 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348249 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:07:24.349109 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348252 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348256 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348259 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348261 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348264 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348267 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348269 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348272 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348274 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348277 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348279 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348282 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348285 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348287 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348290 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348292 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348295 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348298 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348300 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348303 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:07:24.349579 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348305 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348308 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348312 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348314 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348316 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348319 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348322 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348326 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348329 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348331 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348334 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348338 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348341 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348343 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348346 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348348 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348351 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348354 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348356 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.348359 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:07:24.350074 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349068 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349074 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349077 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349080 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349083 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349086 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349089 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349091 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349095 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349099 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349102 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349105 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349108 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349111 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349113 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349116 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349119 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349122 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349124 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:07:24.350569 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349127 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349130 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349133 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349136 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349138 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349151 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349154 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349157 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349159 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349162 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349164 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349167 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349170 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349173 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349175 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349178 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349181 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349183 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349186 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349189 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:07:24.351062 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349192 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349194 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349197 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349200 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349202 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349205 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349207 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349210 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349212 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349215 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349217 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349219 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349222 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349225 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349228 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349230 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349233 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349235 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349238 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349240 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:07:24.351543 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349243 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349246 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349248 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349251 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349253 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349256 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349260 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349263 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349266 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349269 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349272 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349275 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349278 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349281 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349283 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349287 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349289 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349292 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349297 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:07:24.352078 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349300 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349303 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349306 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349309 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349311 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349314 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349317 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349319 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349322 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349325 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349327 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349330 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349332 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349335 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349337 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349340 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349342 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349345 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349347 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349350 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:07:24.352536 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349353 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349705 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349709 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349712 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349715 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349719 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349721 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349724 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349727 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349731 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349733 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349736 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349739 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349742 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349744 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349747 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349749 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349752 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349755 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349758 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:07:24.353041 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349760 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349763 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349767 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349771 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349774 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349776 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349779 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349782 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349784 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349787 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349789 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349792 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349794 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349797 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349799 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349802 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349805 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349807 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349813 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:07:24.353587 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349816 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349819 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349822 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349824 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349827 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349829 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349832 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349835 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349838 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349846 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349848 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349851 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349853 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349856 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349858 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349861 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349864 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349880 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349882 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349885 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:07:24.354075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349887 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349890 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349892 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349895 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349898 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349900 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349903 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349905 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349908 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349910 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349913 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349915 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349924 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349927 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349930 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349934 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349939 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349942 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349945 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:07:24.354598 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349948 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349951 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349955 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349958 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349961 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349963 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349966 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349968 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349971 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349974 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349977 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349979 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349982 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349984 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349987 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349989 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349993 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349997 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.349999 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:07:24.355084 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350002 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350005 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350007 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350090 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350101 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350110 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350120 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350141 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350149 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350159 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350165 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350170 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350175 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350180 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350184 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350189 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350191 2558 flags.go:64] FLAG: --cgroup-root="" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350194 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350197 2558 flags.go:64] FLAG: --client-ca-file="" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350200 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350203 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350211 2558 flags.go:64] FLAG: --cluster-domain="" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350214 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350217 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 11:07:24.355554 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350220 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350224 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350227 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350230 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350234 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350237 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350240 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350243 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350246 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350249 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350252 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350256 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350259 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350262 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350264 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350269 2558 flags.go:64] FLAG: --enable-server="true" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350272 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350279 2558 flags.go:64] FLAG: --event-burst="100" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350282 2558 flags.go:64] FLAG: --event-qps="50" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350284 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350287 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350290 2558 flags.go:64] FLAG: --eviction-hard="" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350294 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350298 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350301 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 11:07:24.356190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350304 2558 flags.go:64] FLAG: --eviction-soft="" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350306 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350309 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350312 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350315 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350318 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350321 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350324 2558 flags.go:64] FLAG: --feature-gates="" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350327 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350330 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350334 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350337 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350340 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350342 2558 flags.go:64] FLAG: --help="false" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350345 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350349 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350352 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350354 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350358 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350361 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350364 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350367 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350374 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 11:07:24.356783 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350377 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350383 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350386 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350389 2558 flags.go:64] FLAG: --kube-reserved="" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350392 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350395 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350398 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350402 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350405 2558 flags.go:64] FLAG: --lock-file="" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350408 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350411 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350414 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350419 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350422 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350425 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350427 2558 flags.go:64] FLAG: --logging-format="text" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350430 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350433 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350436 2558 flags.go:64] FLAG: --manifest-url="" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350439 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350443 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350446 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350450 2558 flags.go:64] FLAG: --max-pods="110" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350453 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350457 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 11:07:24.357403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350460 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350462 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350465 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350468 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350471 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350478 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350482 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350485 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350488 2558 flags.go:64] FLAG: --pod-cidr="" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350491 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350496 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350499 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350502 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350505 2558 flags.go:64] FLAG: --port="10250" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350508 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350512 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e0c454cdf21bcb83" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350516 2558 flags.go:64] FLAG: --qos-reserved="" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350519 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350522 2558 flags.go:64] FLAG: --register-node="true" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350525 2558 flags.go:64] FLAG: --register-with-taints="" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350529 2558 flags.go:64] FLAG: --registry-burst="10" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350531 2558 flags.go:64] FLAG: --registry-qps="5" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350534 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350537 2558 flags.go:64] FLAG: --reserved-memory="" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350541 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 11:07:24.358043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350544 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350547 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350550 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350553 2558 flags.go:64] FLAG: --runonce="false" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350555 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350558 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350561 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350564 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350567 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350570 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350573 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350576 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350579 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350584 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350586 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350589 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350592 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350595 2558 flags.go:64] FLAG: --system-cgroups="" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350598 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350603 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350606 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350609 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350614 2558 flags.go:64] FLAG: --tls-min-version="" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350617 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350620 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 11:07:24.358648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350623 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350626 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350629 2558 flags.go:64] FLAG: --v="2" Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350632 2558 flags.go:64] FLAG: --version="false" Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350639 2558 flags.go:64] FLAG: --vmodule="" Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350642 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.350646 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350759 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350764 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350768 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350771 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350774 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350777 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350780 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350783 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350786 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350788 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350791 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350793 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350796 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350800 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:07:24.359284 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350803 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350805 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350808 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350811 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350814 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350817 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350819 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350821 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350824 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350827 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350830 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350832 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350835 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350838 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350841 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350843 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350845 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350849 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350852 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:07:24.359809 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350855 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350858 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350860 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350863 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350865 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350881 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350884 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350886 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350889 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350892 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350894 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350897 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350901 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350904 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350906 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350909 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350911 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350914 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350917 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350920 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:07:24.360295 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350922 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350925 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350927 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350930 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350932 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350935 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350938 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350940 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350943 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350945 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350948 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350950 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350952 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350955 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350958 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350960 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350963 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350965 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350968 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350970 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:07:24.360811 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350973 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350976 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350978 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350981 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350985 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350987 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350990 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350993 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350995 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.350998 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351000 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351003 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351006 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351009 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351011 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351014 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351016 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351020 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351023 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:07:24.361454 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351027 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351029 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351032 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351035 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351038 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351041 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.351043 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.351743 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.358392 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.358406 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.358423 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.358430 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358493 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358498 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358501 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:07:24.361936 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358504 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358513 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358516 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358518 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358522 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358524 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358527 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358530 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358532 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358542 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358544 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358547 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358550 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358556 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358558 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358561 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358564 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358566 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358569 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358572 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:07:24.362354 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358574 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358577 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358579 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358584 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358587 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358590 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358594 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358597 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358600 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358602 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358605 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358608 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358610 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358613 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358616 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358618 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358621 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358623 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358626 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358628 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:07:24.362838 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358631 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358633 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358642 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358644 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358647 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358649 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358652 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358655 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358658 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358660 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358663 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358666 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358669 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358672 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358674 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358677 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358679 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358682 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358685 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:07:24.363343 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358689 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358693 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358696 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358699 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358702 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358705 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358758 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358762 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358767 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358771 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358774 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358777 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358779 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358782 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358785 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358787 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358796 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358799 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358801 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358804 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:07:24.363822 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358806 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358809 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358811 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358814 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358816 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358819 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358821 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358824 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358826 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358829 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358832 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358835 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358838 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358840 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358843 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358846 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:07:24.364316 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.358848 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.358853 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359017 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359022 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359024 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359027 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359030 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359034 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359037 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359040 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359043 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359046 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359049 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359058 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:07:24.364708 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359061 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359063 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359066 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359068 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359071 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359074 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359077 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359079 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359082 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359084 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359087 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359090 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359093 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359095 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359098 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359100 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359103 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359105 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359108 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359111 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:07:24.365131 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359113 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359116 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359118 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359121 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359123 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359126 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359128 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359131 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359133 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359136 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359138 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359141 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359150 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359153 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359156 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359158 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359161 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359163 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359166 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359168 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:07:24.365674 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359170 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359173 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359176 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359178 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359181 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359183 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359186 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359188 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359191 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359193 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359196 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359198 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359201 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359203 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359206 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359208 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359211 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359213 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359216 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359218 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:07:24.366541 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359221 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359223 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359226 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359228 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359231 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359239 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359241 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359244 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359247 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359250 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359255 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359259 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359263 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359266 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359269 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359272 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359274 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359277 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359279 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:07:24.367377 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359282 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359285 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359287 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359290 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359293 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359295 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359298 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:24.359300 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.359305 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.359408 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.361445 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.362793 2558 server.go:1019] "Starting client certificate rotation" Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.362913 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:07:24.367829 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.362953 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:07:24.368161 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.367122 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:07:24.368758 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.368742 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:07:24.378036 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.378018 2558 log.go:25] "Validated CRI v1 runtime API" Jun 09 11:07:24.380458 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.380441 2558 log.go:25] "Validated CRI v1 image API" Jun 09 11:07:24.381298 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.381277 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 11:07:24.386156 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.386131 2558 fs.go:135] Filesystem UUIDs: map[0ac55c96-94df-4c62-ba04-90ec55ef4b80:/dev/nvme0n1p3 73e3246e-eb5c-4025-819b-373031d7b1e6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 09 11:07:24.386231 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.386156 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 11:07:24.392018 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.391895 2558 manager.go:216] Machine: {Timestamp:2026-06-09 11:07:24.390654888 +0000 UTC m=+0.299040206 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100582 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e8dca8dae181935478ff12d32d78e SystemUUID:ec2e8dca-8dae-1819-3547-8ff12d32d78e BootID:46c64cd5-2aa9-4918-8c54-cd0e7894dffd Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:00:b7:77:44:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:00:b7:77:44:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:84:c9:61:5b:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 11:07:24.392018 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.392010 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 11:07:24.392131 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.392110 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 11:07:24.393321 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.393305 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:07:24.395350 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.395329 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 11:07:24.395486 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.395353 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-194.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 11:07:24.396029 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.396019 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 11:07:24.396068 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.396030 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 11:07:24.396068 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.396038 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:07:24.396656 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.396646 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:07:24.397394 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.397384 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 11:07:24.399988 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.399977 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:07:24.400247 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.400237 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 11:07:24.400287 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.400266 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 09 11:07:24.400287 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.400279 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 11:07:24.400343 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.400296 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 11:07:24.400343 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.400305 2558 kubelet.go:398] "Adding apiserver pod source" Jun 09 11:07:24.400343 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.400314 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 11:07:24.400796 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.400777 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:07:24.400796 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.400799 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:07:24.404537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.404518 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 11:07:24.405738 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.405725 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 11:07:24.405787 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.405755 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 11:07:24.406961 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.406948 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 11:07:24.406999 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.406967 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 11:07:24.406999 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.406974 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 11:07:24.406999 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.406982 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 11:07:24.406999 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.406995 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 11:07:24.406999 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.407000 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 11:07:24.407136 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.407008 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 11:07:24.407136 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.407014 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 11:07:24.407136 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.407020 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 11:07:24.407136 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.407025 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 11:07:24.407136 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.407033 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 11:07:24.407136 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.407039 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 11:07:24.407136 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.407061 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 11:07:24.407136 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.407066 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 11:07:24.410153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.410140 2558 server.go:1268] "Started kubelet" Jun 09 11:07:24.410309 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.410252 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 11:07:24.410685 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.410250 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 11:07:24.410766 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.410706 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 11:07:24.411076 ip-10-0-131-194 systemd[1]: Started Kubernetes Kubelet. Jun 09 11:07:24.412720 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.412702 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 09 11:07:24.413745 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.413712 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-194.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 11:07:24.413745 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.413739 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 11:07:24.413884 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.413765 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-194.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 11:07:24.413936 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.413882 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 11:07:24.415973 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.415953 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 11:07:24.417788 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.417771 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 11:07:24.417788 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.417780 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 11:07:24.417935 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.417846 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:24.418325 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.417241 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-194.ec2.internal.18b76503bee21d99 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-194.ec2.internal,UID:ip-10-0-131-194.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-194.ec2.internal,},FirstTimestamp:2026-06-09 11:07:24.410117529 +0000 UTC m=+0.318502846,LastTimestamp:2026-06-09 11:07:24.410117529 +0000 UTC m=+0.318502846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-194.ec2.internal,}" Jun 09 11:07:24.418648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.418636 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 11:07:24.418749 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.418738 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 11:07:24.418927 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.418907 2558 factory.go:55] Registering systemd factory Jun 09 11:07:24.419018 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.418930 2558 factory.go:223] Registration of the systemd container factory successfully Jun 09 11:07:24.419018 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.419009 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 11:07:24.419109 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.419021 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 09 11:07:24.419109 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.419033 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 09 11:07:24.419296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.419282 2558 factory.go:153] Registering CRI-O factory Jun 09 11:07:24.419353 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.419302 2558 factory.go:223] Registration of the crio container factory successfully Jun 09 11:07:24.419353 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.419348 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 11:07:24.419442 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.419371 2558 factory.go:103] Registering Raw factory Jun 09 11:07:24.419442 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.419389 2558 manager.go:1196] Started watching for new ooms in manager Jun 09 11:07:24.419742 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.419726 2558 manager.go:349] Starting recovery of all containers Jun 09 11:07:24.424479 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.424423 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vfm7q" Jun 09 11:07:24.426859 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.426708 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-194.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 11:07:24.426859 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.426771 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 11:07:24.431361 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.431346 2558 manager.go:354] Recovery completed Jun 09 11:07:24.432584 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.432519 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vfm7q" Jun 09 11:07:24.432795 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.432772 2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 09 11:07:24.435990 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.435978 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:07:24.438117 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.438101 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:07:24.438172 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.438128 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:07:24.438172 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.438138 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:07:24.438629 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.438617 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 11:07:24.438629 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.438627 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 11:07:24.438713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.438633 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:07:24.438713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.438641 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:07:24.439317 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.439302 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:07:24.439378 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.439326 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:07:24.439378 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.439341 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:07:24.439547 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.439535 2558 policy_none.go:49] "None policy: Start" Jun 09 11:07:24.439577 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.439552 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 11:07:24.439577 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.439562 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 11:07:24.440374 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.440364 2558 policy_none.go:47] "Start" Jun 09 11:07:24.440491 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.440435 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-194.ec2.internal.18b76503c08d5936 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-194.ec2.internal,UID:ip-10-0-131-194.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-194.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-194.ec2.internal,},FirstTimestamp:2026-06-09 11:07:24.438116662 +0000 UTC m=+0.346501982,LastTimestamp:2026-06-09 11:07:24.438116662 +0000 UTC m=+0.346501982,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-194.ec2.internal,}" Jun 09 11:07:24.468454 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.468436 2558 manager.go:337] "Starting Device Plugin manager" Jun 09 11:07:24.468528 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.468495 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 11:07:24.468528 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.468506 2558 server.go:87] "Starting device plugin registration server" Jun 09 11:07:24.468725 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.468710 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 11:07:24.468818 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.468725 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 11:07:24.468896 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.468827 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 11:07:24.468948 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.468927 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 11:07:24.468948 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.468937 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 11:07:24.469605 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.469585 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 11:07:24.469693 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.469637 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:24.484531 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.484505 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 11:07:24.485714 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.485697 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 11:07:24.485782 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.485734 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 11:07:24.485782 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.485756 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 11:07:24.485910 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.485787 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 11:07:24.488080 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.488065 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:07:24.569372 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.569351 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:07:24.571969 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.571954 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:07:24.572044 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.571984 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:07:24.572044 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.571995 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:07:24.572044 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.572014 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.582524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.582507 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.582609 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.582531 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-194.ec2.internal\": node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:24.586059 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.586034 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal"] Jun 09 11:07:24.586118 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.586096 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:07:24.587253 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.587234 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:07:24.587332 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.587264 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:07:24.587332 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.587280 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:07:24.588428 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.588415 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:07:24.588536 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.588522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.588577 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.588550 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:07:24.589221 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.589207 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:07:24.589286 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.589227 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:07:24.589286 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.589236 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:07:24.589784 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.589771 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:07:24.589844 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.589798 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:07:24.589844 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.589810 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:07:24.590782 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.590769 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.590832 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.590797 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:07:24.591470 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.591454 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:07:24.591565 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.591480 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:07:24.591565 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.591489 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:07:24.597254 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.597237 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:24.615511 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.615490 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-194.ec2.internal\" not found" node="ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.619833 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.619818 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-194.ec2.internal\" not found" node="ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.697413 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.697393 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:24.719959 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.719937 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f3ac2bd76351f2f2779b6b727bf860f7-config\") pod \"kube-apiserver-proxy-ip-10-0-131-194.ec2.internal\" (UID: \"f3ac2bd76351f2f2779b6b727bf860f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.720044 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.719968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a9677444b9c2bbc2d4544716d99c13c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal\" (UID: \"5a9677444b9c2bbc2d4544716d99c13c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.720044 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.719994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9677444b9c2bbc2d4544716d99c13c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal\" (UID: \"5a9677444b9c2bbc2d4544716d99c13c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.797464 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.797431 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:24.820757 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.820739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a9677444b9c2bbc2d4544716d99c13c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal\" (UID: \"5a9677444b9c2bbc2d4544716d99c13c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.820813 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.820771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9677444b9c2bbc2d4544716d99c13c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal\" (UID: \"5a9677444b9c2bbc2d4544716d99c13c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.820813 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.820799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f3ac2bd76351f2f2779b6b727bf860f7-config\") pod \"kube-apiserver-proxy-ip-10-0-131-194.ec2.internal\" (UID: \"f3ac2bd76351f2f2779b6b727bf860f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.820934 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.820833 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a9677444b9c2bbc2d4544716d99c13c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal\" (UID: \"5a9677444b9c2bbc2d4544716d99c13c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.820934 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.820850 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f3ac2bd76351f2f2779b6b727bf860f7-config\") pod \"kube-apiserver-proxy-ip-10-0-131-194.ec2.internal\" (UID: \"f3ac2bd76351f2f2779b6b727bf860f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.820934 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.820895 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9677444b9c2bbc2d4544716d99c13c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal\" (UID: \"5a9677444b9c2bbc2d4544716d99c13c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.898026 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.897975 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:24.919285 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.919268 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.923622 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:24.923606 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal" Jun 09 11:07:24.998946 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:24.998922 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:25.099408 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:25.099382 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:25.199954 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:25.199903 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:25.300365 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:25.300340 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:25.359543 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.359520 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:07:25.362675 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.362657 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 11:07:25.362793 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.362773 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:07:25.362837 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.362806 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:07:25.400937 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:25.400917 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:25.408600 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:25.408573 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ac2bd76351f2f2779b6b727bf860f7.slice/crio-224a8b78a42d1f031829ad1443ec8371dbf4869d5f19232788796d3b3f49f87d WatchSource:0}: Error finding container 224a8b78a42d1f031829ad1443ec8371dbf4869d5f19232788796d3b3f49f87d: Status 404 returned error can't find the container with id 224a8b78a42d1f031829ad1443ec8371dbf4869d5f19232788796d3b3f49f87d Jun 09 11:07:25.408968 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:25.408952 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9677444b9c2bbc2d4544716d99c13c.slice/crio-59470cec36ca862f0342cefde05e70a60d7b2b0cf21f73df24fd975cc2f5d8bc WatchSource:0}: Error finding container 59470cec36ca862f0342cefde05e70a60d7b2b0cf21f73df24fd975cc2f5d8bc: Status 404 returned error can't find the container with id 59470cec36ca862f0342cefde05e70a60d7b2b0cf21f73df24fd975cc2f5d8bc Jun 09 11:07:25.415717 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.415705 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:07:25.434838 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.434808 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 11:02:24 +0000 UTC" deadline="2028-01-02 12:41:47.826288161 +0000 UTC" Jun 09 11:07:25.434838 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.434832 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13729h34m22.39145896s" Jun 09 11:07:25.489821 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.489753 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" event={"ID":"5a9677444b9c2bbc2d4544716d99c13c","Type":"ContainerStarted","Data":"59470cec36ca862f0342cefde05e70a60d7b2b0cf21f73df24fd975cc2f5d8bc"} Jun 09 11:07:25.490741 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.490723 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal" event={"ID":"f3ac2bd76351f2f2779b6b727bf860f7","Type":"ContainerStarted","Data":"224a8b78a42d1f031829ad1443ec8371dbf4869d5f19232788796d3b3f49f87d"} Jun 09 11:07:25.501910 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:25.501891 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:25.576546 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.576520 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:07:25.602202 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:25.602182 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:25.702768 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:25.702735 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-194.ec2.internal\" not found" Jun 09 11:07:25.715884 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.715851 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:07:25.718296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.718274 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" Jun 09 11:07:25.731280 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.731255 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:07:25.732560 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.732543 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal" Jun 09 11:07:25.741051 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:25.740990 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:07:26.401435 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.401404 2558 apiserver.go:52] "Watching apiserver" Jun 09 11:07:26.409526 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.409498 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 11:07:26.409976 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.409952 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-nm45q","kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f","openshift-cluster-node-tuning-operator/tuned-ln24x","openshift-dns/node-resolver-9xqst","openshift-image-registry/node-ca-wpnv2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal","openshift-multus/multus-dxpxr","openshift-network-diagnostics/network-check-target-tnz62","kube-system/global-pull-secret-syncer-565cd","kube-system/konnectivity-agent-l675b","openshift-multus/multus-additional-cni-plugins-fqd6x","openshift-multus/network-metrics-daemon-kb4nv","openshift-network-operator/iptables-alerter-s6vzx"] Jun 09 11:07:26.412460 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.412429 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:26.412569 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.412500 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:26.414550 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.414532 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:26.414646 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.414601 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:26.416596 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.416576 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.418672 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.418641 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 11:07:26.418855 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.418833 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.419126 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.419098 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-56zzj\"" Jun 09 11:07:26.419302 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.419281 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 11:07:26.419391 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.419316 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 11:07:26.419453 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.419438 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 11:07:26.420907 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.420887 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.421510 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.421337 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 11:07:26.421907 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.421886 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:07:26.422017 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.421915 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xmbns\"" Jun 09 11:07:26.423198 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.423176 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.423352 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.423335 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l8g72\"" Jun 09 11:07:26.423886 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.423855 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 11:07:26.423979 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.423857 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 11:07:26.425580 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.425346 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:26.425580 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.425414 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:26.426046 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.425649 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 11:07:26.426046 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.425708 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s2d7b\"" Jun 09 11:07:26.426046 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.425723 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 11:07:26.426046 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.425935 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 11:07:26.427639 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.427623 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.428228 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428205 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.428332 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b30eae0-cd00-4a3f-9406-1c8bae36286a-tmp-dir\") pod \"node-resolver-9xqst\" (UID: \"0b30eae0-cd00-4a3f-9406-1c8bae36286a\") " pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.428332 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428267 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7hp\" (UniqueName: \"kubernetes.io/projected/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-kube-api-access-bk7hp\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:26.428332 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcdpm\" (UniqueName: \"kubernetes.io/projected/bd7796a9-b81f-4533-b45d-7ee056cb5221-kube-api-access-wcdpm\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.428332 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428314 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-sysconfig\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.428527 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d35dc75d-89f4-405b-8e36-b479b12f9687-dbus\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:26.428527 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428378 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:26.428527 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428399 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-sys-fs\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.428527 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428437 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-systemd\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.428527 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428512 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nd4w\" (UniqueName: \"kubernetes.io/projected/0b30eae0-cd00-4a3f-9406-1c8bae36286a-kube-api-access-8nd4w\") pod \"node-resolver-9xqst\" (UID: \"0b30eae0-cd00-4a3f-9406-1c8bae36286a\") " pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.428754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-device-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.428754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428564 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-socket-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.428754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428585 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-run\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.428754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428617 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-sys\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.428754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428643 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-modprobe-d\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.428754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-sysctl-conf\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.428754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-var-lib-kubelet\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.428754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55c63786-c0b0-4457-843a-eb1d16b62564-tmp\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.428754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b30eae0-cd00-4a3f-9406-1c8bae36286a-hosts-file\") pod \"node-resolver-9xqst\" (UID: \"0b30eae0-cd00-4a3f-9406-1c8bae36286a\") " pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.429157 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428773 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d35dc75d-89f4-405b-8e36-b479b12f9687-kubelet-config\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:26.429157 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:26.429157 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-host\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.429157 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428837 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk5rm\" (UniqueName: \"kubernetes.io/projected/55c63786-c0b0-4457-843a-eb1d16b62564-kube-api-access-kk5rm\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.429157 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428856 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-registration-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.429157 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428895 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-kubernetes\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.429157 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-sysctl-d\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.429157 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428931 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-lib-modules\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.429157 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.428988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/55c63786-c0b0-4457-843a-eb1d16b62564-etc-tuned\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.429157 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.429021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.429700 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.429682 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:07:26.429975 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.429938 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.430828 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.430804 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jl499\"" Jun 09 11:07:26.431176 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.431159 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 11:07:26.431447 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.431426 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 11:07:26.432643 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.432623 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.432745 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.432734 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 11:07:26.433412 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.433328 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 11:07:26.434405 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.434285 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 11:07:26.434541 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.434413 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 11:07:26.434541 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.434523 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kwgd9\"" Jun 09 11:07:26.435666 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.435636 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:26.437318 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.437301 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 11:07:26.437410 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.437300 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 11:07:26.437410 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.437300 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 11:07:26.438039 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.437930 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 11:07:26.438039 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.437973 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9mwn5\"" Jun 09 11:07:26.438180 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.438115 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.438180 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.438149 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:07:26.438287 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.438184 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 11:07:26.439187 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.439169 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 11:07:26.439280 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.439217 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 11:07:26.439376 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.439359 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-htb2h\"" Jun 09 11:07:26.439487 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.439470 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 11:07:26.440458 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.440439 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 11:07:26.440560 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.440545 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hsrk4\"" Jun 09 11:07:26.440604 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.440439 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 11:07:26.461611 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.461593 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-smcgg" Jun 09 11:07:26.470492 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.470473 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-smcgg" Jun 09 11:07:26.520577 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.520559 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 11:07:26.529928 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.529896 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:26.530036 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.529933 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-var-lib-cni-multus\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.530036 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.529958 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njl6t\" (UniqueName: \"kubernetes.io/projected/45861504-7f9b-4628-bb0f-e54074f31d71-kube-api-access-njl6t\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.530036 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.529993 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-host\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.530036 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.530020 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:26.530220 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d4e7287-8535-4c9f-951e-4fbab9770dcd-iptables-alerter-script\") pod \"iptables-alerter-s6vzx\" (UID: \"5d4e7287-8535-4c9f-951e-4fbab9770dcd\") " pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.530220 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530100 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-host\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.530220 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.530115 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret podName:d35dc75d-89f4-405b-8e36-b479b12f9687 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:27.030094912 +0000 UTC m=+2.938480220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret") pod "global-pull-secret-syncer-565cd" (UID: "d35dc75d-89f4-405b-8e36-b479b12f9687") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:26.530220 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530161 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-cni-dir\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.530220 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530188 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-var-lib-openvswitch\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.530220 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45861504-7f9b-4628-bb0f-e54074f31d71-ovnkube-script-lib\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-system-cni-dir\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-cnibin\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530299 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-kubernetes\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530322 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/55c63786-c0b0-4457-843a-eb1d16b62564-etc-tuned\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-log-socket\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45861504-7f9b-4628-bb0f-e54074f31d71-ovn-node-metrics-cert\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530384 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-kubernetes\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530399 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b30eae0-cd00-4a3f-9406-1c8bae36286a-tmp-dir\") pod \"node-resolver-9xqst\" (UID: \"0b30eae0-cd00-4a3f-9406-1c8bae36286a\") " pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-var-lib-cni-bin\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-cni-bin\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530469 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb3cf9c1-c138-4a7f-a389-7327c645757d-konnectivity-ca\") pod \"konnectivity-agent-l675b\" (UID: \"cb3cf9c1-c138-4a7f-a389-7327c645757d\") " pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530490 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.530502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-sysconfig\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530552 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04267d35-9ac0-4466-a7db-9740e669c681-host\") pod \"node-ca-wpnv2\" (UID: \"04267d35-9ac0-4466-a7db-9740e669c681\") " pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-sysconfig\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530607 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530629 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04267d35-9ac0-4466-a7db-9740e669c681-serviceca\") pod \"node-ca-wpnv2\" (UID: \"04267d35-9ac0-4466-a7db-9740e669c681\") " pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530658 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-kubelet\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-run-netns\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530704 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b30eae0-cd00-4a3f-9406-1c8bae36286a-tmp-dir\") pod \"node-resolver-9xqst\" (UID: \"0b30eae0-cd00-4a3f-9406-1c8bae36286a\") " pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530708 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-node-log\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-sys-fs\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530760 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-systemd\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530808 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-sys-fs\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nd4w\" (UniqueName: \"kubernetes.io/projected/0b30eae0-cd00-4a3f-9406-1c8bae36286a-kube-api-access-8nd4w\") pod \"node-resolver-9xqst\" (UID: \"0b30eae0-cd00-4a3f-9406-1c8bae36286a\") " pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-os-release\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530963 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-systemd\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.530968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-socket-dir-parent\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-etc-kubernetes\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.531153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531072 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-cni-netd\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531098 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckmwd\" (UniqueName: \"kubernetes.io/projected/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-kube-api-access-ckmwd\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-run\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531322 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bdwg\" (UniqueName: \"kubernetes.io/projected/5d4e7287-8535-4c9f-951e-4fbab9770dcd-kube-api-access-6bdwg\") pod \"iptables-alerter-s6vzx\" (UID: \"5d4e7287-8535-4c9f-951e-4fbab9770dcd\") " pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531376 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-run\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531403 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-systemd-units\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531455 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-modprobe-d\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-var-lib-kubelet\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531512 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-cnibin\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531532 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-run-k8s-cni-cncf-io\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-etc-openvswitch\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531571 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-modprobe-d\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45861504-7f9b-4628-bb0f-e54074f31d71-ovnkube-config\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531597 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-var-lib-kubelet\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb3cf9c1-c138-4a7f-a389-7327c645757d-agent-certs\") pod \"konnectivity-agent-l675b\" (UID: \"cb3cf9c1-c138-4a7f-a389-7327c645757d\") " pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531639 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk5rm\" (UniqueName: \"kubernetes.io/projected/55c63786-c0b0-4457-843a-eb1d16b62564-kube-api-access-kk5rm\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc77z\" (UniqueName: \"kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z\") pod \"network-check-target-tnz62\" (UID: \"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65\") " pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531702 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-run-openvswitch\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531723 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-os-release\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531748 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-registration-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-sysctl-d\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531888 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-registration-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-lib-modules\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531902 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-sysctl-d\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531922 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531941 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk7hp\" (UniqueName: \"kubernetes.io/projected/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-kube-api-access-bk7hp\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531957 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3041b5f-fb01-4263-ac00-feae98ffd75b-cni-binary-copy\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-run-multus-certs\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.531996 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-lib-modules\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532004 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45861504-7f9b-4628-bb0f-e54074f31d71-env-overrides\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532018 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.532983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532070 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcdpm\" (UniqueName: \"kubernetes.io/projected/bd7796a9-b81f-4533-b45d-7ee056cb5221-kube-api-access-wcdpm\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532110 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d35dc75d-89f4-405b-8e36-b479b12f9687-dbus\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532142 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532171 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7lvv\" (UniqueName: \"kubernetes.io/projected/04267d35-9ac0-4466-a7db-9740e669c681-kube-api-access-r7lvv\") pod \"node-ca-wpnv2\" (UID: \"04267d35-9ac0-4466-a7db-9740e669c681\") " pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532195 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-system-cni-dir\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-slash\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-run-systemd\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532565 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-run-ovn\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.532591 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532399 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d35dc75d-89f4-405b-8e36-b479b12f9687-dbus\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532599 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d4e7287-8535-4c9f-951e-4fbab9770dcd-host-slash\") pod \"iptables-alerter-s6vzx\" (UID: \"5d4e7287-8535-4c9f-951e-4fbab9770dcd\") " pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.532659 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs podName:1e0a06bb-e1b3-42c5-be16-57d0a40b8990 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:27.032638495 +0000 UTC m=+2.941023818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs") pod "network-metrics-daemon-kb4nv" (UID: "1e0a06bb-e1b3-42c5-be16-57d0a40b8990") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-daemon-config\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-device-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.533713 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532824 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-var-lib-kubelet\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-hostroot\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ggtq\" (UniqueName: \"kubernetes.io/projected/b3041b5f-fb01-4263-ac00-feae98ffd75b-kube-api-access-2ggtq\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532926 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-run-ovn-kubernetes\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532928 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-device-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-socket-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.532975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-sys\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-run-netns\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533032 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-conf-dir\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-sys\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-sysctl-conf\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533102 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd7796a9-b81f-4533-b45d-7ee056cb5221-socket-dir\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55c63786-c0b0-4457-843a-eb1d16b62564-tmp\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533153 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b30eae0-cd00-4a3f-9406-1c8bae36286a-hosts-file\") pod \"node-resolver-9xqst\" (UID: \"0b30eae0-cd00-4a3f-9406-1c8bae36286a\") " pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d35dc75d-89f4-405b-8e36-b479b12f9687-kubelet-config\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533232 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/55c63786-c0b0-4457-843a-eb1d16b62564-etc-sysctl-conf\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533274 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b30eae0-cd00-4a3f-9406-1c8bae36286a-hosts-file\") pod \"node-resolver-9xqst\" (UID: \"0b30eae0-cd00-4a3f-9406-1c8bae36286a\") " pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.534257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533278 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d35dc75d-89f4-405b-8e36-b479b12f9687-kubelet-config\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:26.534788 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.533588 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/55c63786-c0b0-4457-843a-eb1d16b62564-etc-tuned\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.535399 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.535380 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55c63786-c0b0-4457-843a-eb1d16b62564-tmp\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.545899 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.545865 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk7hp\" (UniqueName: \"kubernetes.io/projected/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-kube-api-access-bk7hp\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:26.546011 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.545946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcdpm\" (UniqueName: \"kubernetes.io/projected/bd7796a9-b81f-4533-b45d-7ee056cb5221-kube-api-access-wcdpm\") pod \"aws-ebs-csi-driver-node-vwv5f\" (UID: \"bd7796a9-b81f-4533-b45d-7ee056cb5221\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.547110 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.547077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nd4w\" (UniqueName: \"kubernetes.io/projected/0b30eae0-cd00-4a3f-9406-1c8bae36286a-kube-api-access-8nd4w\") pod \"node-resolver-9xqst\" (UID: \"0b30eae0-cd00-4a3f-9406-1c8bae36286a\") " pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.548091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.548073 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk5rm\" (UniqueName: \"kubernetes.io/projected/55c63786-c0b0-4457-843a-eb1d16b62564-kube-api-access-kk5rm\") pod \"tuned-ln24x\" (UID: \"55c63786-c0b0-4457-843a-eb1d16b62564\") " pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.634238 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-var-lib-cni-multus\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.634371 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njl6t\" (UniqueName: \"kubernetes.io/projected/45861504-7f9b-4628-bb0f-e54074f31d71-kube-api-access-njl6t\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.634371 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634275 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d4e7287-8535-4c9f-951e-4fbab9770dcd-iptables-alerter-script\") pod \"iptables-alerter-s6vzx\" (UID: \"5d4e7287-8535-4c9f-951e-4fbab9770dcd\") " pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.634371 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-cni-dir\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.634371 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634319 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-var-lib-cni-multus\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.634371 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634322 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-var-lib-openvswitch\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.634371 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634355 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45861504-7f9b-4628-bb0f-e54074f31d71-ovnkube-script-lib\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-system-cni-dir\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-cnibin\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-log-socket\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634449 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45861504-7f9b-4628-bb0f-e54074f31d71-ovn-node-metrics-cert\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-var-lib-cni-bin\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634474 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-system-cni-dir\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-cni-bin\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634521 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-log-socket\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb3cf9c1-c138-4a7f-a389-7327c645757d-konnectivity-ca\") pod \"konnectivity-agent-l675b\" (UID: \"cb3cf9c1-c138-4a7f-a389-7327c645757d\") " pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634561 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-var-lib-openvswitch\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634572 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04267d35-9ac0-4466-a7db-9740e669c681-host\") pod \"node-ca-wpnv2\" (UID: \"04267d35-9ac0-4466-a7db-9740e669c681\") " pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-cnibin\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634595 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04267d35-9ac0-4466-a7db-9740e669c681-serviceca\") pod \"node-ca-wpnv2\" (UID: \"04267d35-9ac0-4466-a7db-9740e669c681\") " pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-kubelet\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634475 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-cni-dir\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-run-netns\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634543 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-var-lib-cni-bin\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.634677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634667 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-node-log\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634690 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04267d35-9ac0-4466-a7db-9740e669c681-host\") pod \"node-ca-wpnv2\" (UID: \"04267d35-9ac0-4466-a7db-9740e669c681\") " pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634694 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-os-release\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634697 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-kubelet\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634717 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-socket-dir-parent\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634727 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-run-netns\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634620 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-cni-bin\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-etc-kubernetes\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634765 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-cni-netd\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634790 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-os-release\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634791 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634829 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634852 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634909 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckmwd\" (UniqueName: \"kubernetes.io/projected/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-kube-api-access-ckmwd\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634928 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d4e7287-8535-4c9f-951e-4fbab9770dcd-iptables-alerter-script\") pod \"iptables-alerter-s6vzx\" (UID: \"5d4e7287-8535-4c9f-951e-4fbab9770dcd\") " pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bdwg\" (UniqueName: \"kubernetes.io/projected/5d4e7287-8535-4c9f-951e-4fbab9770dcd-kube-api-access-6bdwg\") pod \"iptables-alerter-s6vzx\" (UID: \"5d4e7287-8535-4c9f-951e-4fbab9770dcd\") " pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.634996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-systemd-units\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.635524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635026 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-cnibin\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635092 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-run-k8s-cni-cncf-io\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635107 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04267d35-9ac0-4466-a7db-9740e669c681-serviceca\") pod \"node-ca-wpnv2\" (UID: \"04267d35-9ac0-4466-a7db-9740e669c681\") " pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635117 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-etc-openvswitch\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45861504-7f9b-4628-bb0f-e54074f31d71-ovnkube-config\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635150 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-node-log\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb3cf9c1-c138-4a7f-a389-7327c645757d-agent-certs\") pod \"konnectivity-agent-l675b\" (UID: \"cb3cf9c1-c138-4a7f-a389-7327c645757d\") " pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635166 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-etc-kubernetes\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635176 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb3cf9c1-c138-4a7f-a389-7327c645757d-konnectivity-ca\") pod \"konnectivity-agent-l675b\" (UID: \"cb3cf9c1-c138-4a7f-a389-7327c645757d\") " pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635192 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc77z\" (UniqueName: \"kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z\") pod \"network-check-target-tnz62\" (UID: \"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65\") " pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635215 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-socket-dir-parent\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635257 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-run-openvswitch\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-etc-openvswitch\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-os-release\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635296 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45861504-7f9b-4628-bb0f-e54074f31d71-ovnkube-script-lib\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635313 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3041b5f-fb01-4263-ac00-feae98ffd75b-cni-binary-copy\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635302 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-systemd-units\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635331 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.636278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635337 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-cnibin\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635338 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-run-multus-certs\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635388 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-run-k8s-cni-cncf-io\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635410 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635431 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-cni-netd\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635471 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-run-multus-certs\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635610 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45861504-7f9b-4628-bb0f-e54074f31d71-env-overrides\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7lvv\" (UniqueName: \"kubernetes.io/projected/04267d35-9ac0-4466-a7db-9740e669c681-kube-api-access-r7lvv\") pod \"node-ca-wpnv2\" (UID: \"04267d35-9ac0-4466-a7db-9740e669c681\") " pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635669 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-system-cni-dir\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-system-cni-dir\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635779 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-os-release\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635783 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-run-openvswitch\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635813 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45861504-7f9b-4628-bb0f-e54074f31d71-ovnkube-config\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-slash\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-slash\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-run-systemd\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635904 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3041b5f-fb01-4263-ac00-feae98ffd75b-cni-binary-copy\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.636985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635919 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-run-ovn\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635918 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-run-systemd\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635953 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d4e7287-8535-4c9f-951e-4fbab9770dcd-host-slash\") pod \"iptables-alerter-s6vzx\" (UID: \"5d4e7287-8535-4c9f-951e-4fbab9770dcd\") " pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635979 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-daemon-config\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d4e7287-8535-4c9f-951e-4fbab9770dcd-host-slash\") pod \"iptables-alerter-s6vzx\" (UID: \"5d4e7287-8535-4c9f-951e-4fbab9770dcd\") " pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.635955 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-run-ovn\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636023 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45861504-7f9b-4628-bb0f-e54074f31d71-env-overrides\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636050 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636054 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-var-lib-kubelet\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636103 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-hostroot\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ggtq\" (UniqueName: \"kubernetes.io/projected/b3041b5f-fb01-4263-ac00-feae98ffd75b-kube-api-access-2ggtq\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636131 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-var-lib-kubelet\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636153 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-run-ovn-kubernetes\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-run-netns\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636204 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-conf-dir\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.637692 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636221 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45861504-7f9b-4628-bb0f-e54074f31d71-host-run-ovn-kubernetes\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.638261 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636180 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-hostroot\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.638261 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636296 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-host-run-netns\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.638261 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636338 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-conf-dir\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.638261 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636444 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3041b5f-fb01-4263-ac00-feae98ffd75b-multus-daemon-config\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.638261 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.636520 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.638261 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.637003 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45861504-7f9b-4628-bb0f-e54074f31d71-ovn-node-metrics-cert\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.638261 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.637890 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb3cf9c1-c138-4a7f-a389-7327c645757d-agent-certs\") pod \"konnectivity-agent-l675b\" (UID: \"cb3cf9c1-c138-4a7f-a389-7327c645757d\") " pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:26.652172 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.652087 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckmwd\" (UniqueName: \"kubernetes.io/projected/ae67b253-e67a-42ee-b1b4-a6c26204ff9f-kube-api-access-ckmwd\") pod \"multus-additional-cni-plugins-fqd6x\" (UID: \"ae67b253-e67a-42ee-b1b4-a6c26204ff9f\") " pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.652376 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.652356 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bdwg\" (UniqueName: \"kubernetes.io/projected/5d4e7287-8535-4c9f-951e-4fbab9770dcd-kube-api-access-6bdwg\") pod \"iptables-alerter-s6vzx\" (UID: \"5d4e7287-8535-4c9f-951e-4fbab9770dcd\") " pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.652469 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.652381 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:07:26.652469 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.652400 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:07:26.652469 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.652412 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tc77z for pod openshift-network-diagnostics/network-check-target-tnz62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:26.652643 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:26.652489 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z podName:5fb47958-5ed9-4a06-8ce5-d1962f5aeb65 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:27.152471399 +0000 UTC m=+3.060856721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tc77z" (UniqueName: "kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z") pod "network-check-target-tnz62" (UID: "5fb47958-5ed9-4a06-8ce5-d1962f5aeb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:26.653493 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.653472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njl6t\" (UniqueName: \"kubernetes.io/projected/45861504-7f9b-4628-bb0f-e54074f31d71-kube-api-access-njl6t\") pod \"ovnkube-node-nm45q\" (UID: \"45861504-7f9b-4628-bb0f-e54074f31d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.653708 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.653690 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7lvv\" (UniqueName: \"kubernetes.io/projected/04267d35-9ac0-4466-a7db-9740e669c681-kube-api-access-r7lvv\") pod \"node-ca-wpnv2\" (UID: \"04267d35-9ac0-4466-a7db-9740e669c681\") " pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.654611 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.654592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ggtq\" (UniqueName: \"kubernetes.io/projected/b3041b5f-fb01-4263-ac00-feae98ffd75b-kube-api-access-2ggtq\") pod \"multus-dxpxr\" (UID: \"b3041b5f-fb01-4263-ac00-feae98ffd75b\") " pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.730335 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.730312 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" Jun 09 11:07:26.737023 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.737002 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ln24x" Jun 09 11:07:26.747676 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.747652 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9xqst" Jun 09 11:07:26.752122 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.752106 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wpnv2" Jun 09 11:07:26.760598 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.760580 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s6vzx" Jun 09 11:07:26.768203 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.768186 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxpxr" Jun 09 11:07:26.772821 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.772802 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:26.778476 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.778457 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:26.783051 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.783028 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" Jun 09 11:07:26.847084 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:26.847064 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:07:27.039474 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.039392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:27.039474 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.039439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:27.039681 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:27.039544 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:27.039681 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:27.039551 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:27.039681 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:27.039602 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret podName:d35dc75d-89f4-405b-8e36-b479b12f9687 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:28.039584098 +0000 UTC m=+3.947969415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret") pod "global-pull-secret-syncer-565cd" (UID: "d35dc75d-89f4-405b-8e36-b479b12f9687") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:27.039681 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:27.039616 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs podName:1e0a06bb-e1b3-42c5-be16-57d0a40b8990 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:28.039609851 +0000 UTC m=+3.947995155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs") pod "network-metrics-daemon-kb4nv" (UID: "1e0a06bb-e1b3-42c5-be16-57d0a40b8990") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:27.171001 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:27.170959 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04267d35_9ac0_4466_a7db_9740e669c681.slice/crio-ac68eb0f8737fc999e6db44eed417e224940108f528eaeb171efce965355c28d WatchSource:0}: Error finding container ac68eb0f8737fc999e6db44eed417e224940108f528eaeb171efce965355c28d: Status 404 returned error can't find the container with id ac68eb0f8737fc999e6db44eed417e224940108f528eaeb171efce965355c28d Jun 09 11:07:27.172171 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:27.172146 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c63786_c0b0_4457_843a_eb1d16b62564.slice/crio-85099b4f8e37adacf0c4625e3f168114cb07a13f232fda1d226f44ff9a453bb7 WatchSource:0}: Error finding container 85099b4f8e37adacf0c4625e3f168114cb07a13f232fda1d226f44ff9a453bb7: Status 404 returned error can't find the container with id 85099b4f8e37adacf0c4625e3f168114cb07a13f232fda1d226f44ff9a453bb7 Jun 09 11:07:27.175530 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:27.175508 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4e7287_8535_4c9f_951e_4fbab9770dcd.slice/crio-80297250908f125f5d33a2eb7e7ab6ef097f81b211d531256e2708379b1e2bc0 WatchSource:0}: Error finding container 80297250908f125f5d33a2eb7e7ab6ef097f81b211d531256e2708379b1e2bc0: Status 404 returned error can't find the container with id 80297250908f125f5d33a2eb7e7ab6ef097f81b211d531256e2708379b1e2bc0 Jun 09 11:07:27.204360 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:27.204324 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd7796a9_b81f_4533_b45d_7ee056cb5221.slice/crio-b1032459383ae23979c0efe579d91496b549ed79640c1937c43470282d7f87ca WatchSource:0}: Error finding container b1032459383ae23979c0efe579d91496b549ed79640c1937c43470282d7f87ca: Status 404 returned error can't find the container with id b1032459383ae23979c0efe579d91496b549ed79640c1937c43470282d7f87ca Jun 09 11:07:27.204908 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:27.204885 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3cf9c1_c138_4a7f_a389_7327c645757d.slice/crio-25eef5671c6401198d356de85bcde62ccd9c9e9e5eb956667ef736527ca1b66f WatchSource:0}: Error finding container 25eef5671c6401198d356de85bcde62ccd9c9e9e5eb956667ef736527ca1b66f: Status 404 returned error can't find the container with id 25eef5671c6401198d356de85bcde62ccd9c9e9e5eb956667ef736527ca1b66f Jun 09 11:07:27.206502 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:27.206427 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae67b253_e67a_42ee_b1b4_a6c26204ff9f.slice/crio-1c93cef8fccb06e3f74ecc115e4459f0ce13e9bb4fd5fb32b218ab0275377774 WatchSource:0}: Error finding container 1c93cef8fccb06e3f74ecc115e4459f0ce13e9bb4fd5fb32b218ab0275377774: Status 404 returned error can't find the container with id 1c93cef8fccb06e3f74ecc115e4459f0ce13e9bb4fd5fb32b218ab0275377774 Jun 09 11:07:27.207941 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:27.207909 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45861504_7f9b_4628_bb0f_e54074f31d71.slice/crio-fc21d5003b42884b327a6b17fb221181a40a9f9ec086a112ba91ec99134aee6f WatchSource:0}: Error finding container fc21d5003b42884b327a6b17fb221181a40a9f9ec086a112ba91ec99134aee6f: Status 404 returned error can't find the container with id fc21d5003b42884b327a6b17fb221181a40a9f9ec086a112ba91ec99134aee6f Jun 09 11:07:27.208700 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:27.208686 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b30eae0_cd00_4a3f_9406_1c8bae36286a.slice/crio-916e19abb275cd50df35fb85c0e6a1dafea88a8ec915fbdd2fdb7acc8935b9a8 WatchSource:0}: Error finding container 916e19abb275cd50df35fb85c0e6a1dafea88a8ec915fbdd2fdb7acc8935b9a8: Status 404 returned error can't find the container with id 916e19abb275cd50df35fb85c0e6a1dafea88a8ec915fbdd2fdb7acc8935b9a8 Jun 09 11:07:27.209900 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:07:27.209861 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3041b5f_fb01_4263_ac00_feae98ffd75b.slice/crio-41af9698f5bc5b0586aa3bcbbbf7df2f1623849c00ef22967d82bc26f6bae61d WatchSource:0}: Error finding container 41af9698f5bc5b0586aa3bcbbbf7df2f1623849c00ef22967d82bc26f6bae61d: Status 404 returned error can't find the container with id 41af9698f5bc5b0586aa3bcbbbf7df2f1623849c00ef22967d82bc26f6bae61d Jun 09 11:07:27.240397 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.240377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc77z\" (UniqueName: \"kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z\") pod \"network-check-target-tnz62\" (UID: \"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65\") " pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:27.240525 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:27.240507 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:07:27.240525 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:27.240525 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:07:27.240672 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:27.240534 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tc77z for pod openshift-network-diagnostics/network-check-target-tnz62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:27.240672 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:27.240583 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z podName:5fb47958-5ed9-4a06-8ce5-d1962f5aeb65 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:28.240567909 +0000 UTC m=+4.148953213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc77z" (UniqueName: "kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z") pod "network-check-target-tnz62" (UID: "5fb47958-5ed9-4a06-8ce5-d1962f5aeb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:27.472864 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.472808 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:02:26 +0000 UTC" deadline="2028-01-16 13:13:41.350403758 +0000 UTC" Jun 09 11:07:27.473217 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.472863 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14066h6m13.877545093s" Jun 09 11:07:27.495720 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.495690 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l675b" event={"ID":"cb3cf9c1-c138-4a7f-a389-7327c645757d","Type":"ContainerStarted","Data":"25eef5671c6401198d356de85bcde62ccd9c9e9e5eb956667ef736527ca1b66f"} Jun 09 11:07:27.496954 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.496932 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s6vzx" event={"ID":"5d4e7287-8535-4c9f-951e-4fbab9770dcd","Type":"ContainerStarted","Data":"80297250908f125f5d33a2eb7e7ab6ef097f81b211d531256e2708379b1e2bc0"} Jun 09 11:07:27.499027 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.499007 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal" event={"ID":"f3ac2bd76351f2f2779b6b727bf860f7","Type":"ContainerStarted","Data":"b4e160a17ca6d313e522fc6cbac6ef5ef908995a54eed587fbdc37bc19aea7f8"} Jun 09 11:07:27.500283 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.500263 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxpxr" event={"ID":"b3041b5f-fb01-4263-ac00-feae98ffd75b","Type":"ContainerStarted","Data":"41af9698f5bc5b0586aa3bcbbbf7df2f1623849c00ef22967d82bc26f6bae61d"} Jun 09 11:07:27.501478 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.501430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" event={"ID":"ae67b253-e67a-42ee-b1b4-a6c26204ff9f","Type":"ContainerStarted","Data":"1c93cef8fccb06e3f74ecc115e4459f0ce13e9bb4fd5fb32b218ab0275377774"} Jun 09 11:07:27.502403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.502380 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" event={"ID":"bd7796a9-b81f-4533-b45d-7ee056cb5221","Type":"ContainerStarted","Data":"b1032459383ae23979c0efe579d91496b549ed79640c1937c43470282d7f87ca"} Jun 09 11:07:27.503377 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.503357 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ln24x" event={"ID":"55c63786-c0b0-4457-843a-eb1d16b62564","Type":"ContainerStarted","Data":"85099b4f8e37adacf0c4625e3f168114cb07a13f232fda1d226f44ff9a453bb7"} Jun 09 11:07:27.504279 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.504261 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wpnv2" event={"ID":"04267d35-9ac0-4466-a7db-9740e669c681","Type":"ContainerStarted","Data":"ac68eb0f8737fc999e6db44eed417e224940108f528eaeb171efce965355c28d"} Jun 09 11:07:27.506758 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.506733 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9xqst" event={"ID":"0b30eae0-cd00-4a3f-9406-1c8bae36286a","Type":"ContainerStarted","Data":"916e19abb275cd50df35fb85c0e6a1dafea88a8ec915fbdd2fdb7acc8935b9a8"} Jun 09 11:07:27.509303 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.509277 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" event={"ID":"45861504-7f9b-4628-bb0f-e54074f31d71","Type":"ContainerStarted","Data":"fc21d5003b42884b327a6b17fb221181a40a9f9ec086a112ba91ec99134aee6f"} Jun 09 11:07:27.526295 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:27.526251 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-194.ec2.internal" podStartSLOduration=2.526238468 podStartE2EDuration="2.526238468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:27.52567283 +0000 UTC m=+3.434058157" watchObservedRunningTime="2026-06-09 11:07:27.526238468 +0000 UTC m=+3.434623793" Jun 09 11:07:28.047663 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.047353 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:28.047663 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.047442 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:28.047663 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.047557 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:28.047663 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.047559 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:28.047663 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.047615 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs podName:1e0a06bb-e1b3-42c5-be16-57d0a40b8990 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:30.047597037 +0000 UTC m=+5.955982353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs") pod "network-metrics-daemon-kb4nv" (UID: "1e0a06bb-e1b3-42c5-be16-57d0a40b8990") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:28.047663 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.047634 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret podName:d35dc75d-89f4-405b-8e36-b479b12f9687 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:30.047624078 +0000 UTC m=+5.956009389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret") pod "global-pull-secret-syncer-565cd" (UID: "d35dc75d-89f4-405b-8e36-b479b12f9687") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:28.250116 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.249550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc77z\" (UniqueName: \"kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z\") pod \"network-check-target-tnz62\" (UID: \"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65\") " pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:28.250116 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.249698 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:07:28.250116 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.249718 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:07:28.250116 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.249731 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tc77z for pod openshift-network-diagnostics/network-check-target-tnz62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:28.250116 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.249784 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z podName:5fb47958-5ed9-4a06-8ce5-d1962f5aeb65 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:30.249766827 +0000 UTC m=+6.158152137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc77z" (UniqueName: "kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z") pod "network-check-target-tnz62" (UID: "5fb47958-5ed9-4a06-8ce5-d1962f5aeb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:28.473738 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.473567 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:02:26 +0000 UTC" deadline="2028-01-12 13:52:01.766939914 +0000 UTC" Jun 09 11:07:28.473738 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.473649 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13970h44m33.293295758s" Jun 09 11:07:28.489950 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.489048 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:28.489950 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.489171 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:28.489950 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.489537 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:28.489950 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.489640 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:28.489950 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.489701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:28.489950 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:28.489822 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:28.532121 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.531252 2558 generic.go:356] "Generic (PLEG): container finished" podID="5a9677444b9c2bbc2d4544716d99c13c" containerID="7b85bf0ce60fedf534059c97bebc2c47c6d93cf4a5df1484ae97db3a18c76792" exitCode=0 Jun 09 11:07:28.532121 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.531378 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" event={"ID":"5a9677444b9c2bbc2d4544716d99c13c","Type":"ContainerDied","Data":"7b85bf0ce60fedf534059c97bebc2c47c6d93cf4a5df1484ae97db3a18c76792"} Jun 09 11:07:28.532121 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:28.531598 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:07:29.565744 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:29.565710 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" event={"ID":"5a9677444b9c2bbc2d4544716d99c13c","Type":"ContainerStarted","Data":"d9540f1d8895f017fde482ed378e182921ee23cd3f3f4ebf599ccc657470341e"} Jun 09 11:07:30.067808 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:30.067764 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:30.068049 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:30.067888 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:30.068049 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.068016 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:30.068232 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.068079 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs podName:1e0a06bb-e1b3-42c5-be16-57d0a40b8990 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:34.068061586 +0000 UTC m=+9.976446894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs") pod "network-metrics-daemon-kb4nv" (UID: "1e0a06bb-e1b3-42c5-be16-57d0a40b8990") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:30.068502 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.068479 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:30.068582 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.068538 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret podName:d35dc75d-89f4-405b-8e36-b479b12f9687 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:34.068522946 +0000 UTC m=+9.976908256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret") pod "global-pull-secret-syncer-565cd" (UID: "d35dc75d-89f4-405b-8e36-b479b12f9687") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:30.269365 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:30.269330 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc77z\" (UniqueName: \"kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z\") pod \"network-check-target-tnz62\" (UID: \"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65\") " pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:30.269537 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.269521 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:07:30.269602 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.269541 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:07:30.269602 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.269554 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tc77z for pod openshift-network-diagnostics/network-check-target-tnz62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:30.269701 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.269619 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z podName:5fb47958-5ed9-4a06-8ce5-d1962f5aeb65 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:34.269600079 +0000 UTC m=+10.177985384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc77z" (UniqueName: "kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z") pod "network-check-target-tnz62" (UID: "5fb47958-5ed9-4a06-8ce5-d1962f5aeb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:30.489277 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:30.486831 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:30.489277 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.486974 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:30.489277 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:30.487094 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:30.489277 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.487211 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:30.489277 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:30.487354 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:30.489277 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:30.487427 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:32.486135 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:32.486103 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:32.486576 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:32.486241 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:32.486576 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:32.486102 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:32.486576 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:32.486277 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:32.486576 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:32.486332 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:32.486576 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:32.486431 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:34.098575 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:34.098530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:34.099029 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:34.098590 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:34.099029 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.098709 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:34.099029 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.098711 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:34.099029 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.098769 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret podName:d35dc75d-89f4-405b-8e36-b479b12f9687 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:42.098751311 +0000 UTC m=+18.007136622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret") pod "global-pull-secret-syncer-565cd" (UID: "d35dc75d-89f4-405b-8e36-b479b12f9687") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:34.099029 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.098791 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs podName:1e0a06bb-e1b3-42c5-be16-57d0a40b8990 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:42.098780245 +0000 UTC m=+18.007165553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs") pod "network-metrics-daemon-kb4nv" (UID: "1e0a06bb-e1b3-42c5-be16-57d0a40b8990") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:34.300646 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:34.300348 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc77z\" (UniqueName: \"kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z\") pod \"network-check-target-tnz62\" (UID: \"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65\") " pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:34.300646 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.300506 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:07:34.300646 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.300527 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:07:34.300646 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.300540 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tc77z for pod openshift-network-diagnostics/network-check-target-tnz62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:34.300646 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.300602 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z podName:5fb47958-5ed9-4a06-8ce5-d1962f5aeb65 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:42.300582392 +0000 UTC m=+18.208967705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc77z" (UniqueName: "kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z") pod "network-check-target-tnz62" (UID: "5fb47958-5ed9-4a06-8ce5-d1962f5aeb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:34.488436 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:34.488019 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:34.488436 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:34.488104 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:34.488436 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:34.488149 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:34.488436 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.488146 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:34.488436 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.488237 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:34.488436 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:34.488311 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:36.486010 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:36.485978 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:36.486010 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:36.486006 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:36.486520 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:36.485978 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:36.486520 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:36.486102 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:36.486520 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:36.486189 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:36.486520 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:36.486317 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:38.486658 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:38.486603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:38.486658 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:38.486624 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:38.487220 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:38.486722 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:38.487220 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:38.486792 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:38.487220 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:38.486884 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:38.487220 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:38.486964 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:40.486153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:40.486119 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:40.486153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:40.486139 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:40.486652 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:40.486128 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:40.486652 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:40.486250 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:40.486652 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:40.486330 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:40.486652 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:40.486411 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:42.168257 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:42.168226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:42.168764 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:42.168267 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:42.168764 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.168374 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:42.168764 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.168389 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:42.168764 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.168436 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret podName:d35dc75d-89f4-405b-8e36-b479b12f9687 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:58.1684168 +0000 UTC m=+34.076802109 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret") pod "global-pull-secret-syncer-565cd" (UID: "d35dc75d-89f4-405b-8e36-b479b12f9687") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:42.168764 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.168451 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs podName:1e0a06bb-e1b3-42c5-be16-57d0a40b8990 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:58.16844456 +0000 UTC m=+34.076829863 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs") pod "network-metrics-daemon-kb4nv" (UID: "1e0a06bb-e1b3-42c5-be16-57d0a40b8990") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:42.369772 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:42.369739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc77z\" (UniqueName: \"kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z\") pod \"network-check-target-tnz62\" (UID: \"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65\") " pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:42.369956 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.369927 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:07:42.369956 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.369949 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:07:42.370041 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.369963 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tc77z for pod openshift-network-diagnostics/network-check-target-tnz62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:42.370041 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.370020 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z podName:5fb47958-5ed9-4a06-8ce5-d1962f5aeb65 nodeName:}" failed. No retries permitted until 2026-06-09 11:07:58.370004109 +0000 UTC m=+34.278389427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc77z" (UniqueName: "kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z") pod "network-check-target-tnz62" (UID: "5fb47958-5ed9-4a06-8ce5-d1962f5aeb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:42.486458 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:42.486419 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:42.486607 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:42.486544 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:42.486607 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.486551 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:42.486607 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:42.486579 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:42.486775 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.486700 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:42.486836 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:42.486812 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:44.486636 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:44.486609 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:44.487254 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:44.486713 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:44.487254 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:44.486740 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:44.487254 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:44.486707 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:44.487254 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:44.486802 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:44.487254 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:44.486892 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:46.487278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.486897 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:46.487840 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.486900 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:46.487840 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:46.487376 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:46.487840 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.486934 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:46.487840 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:46.487440 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:46.487840 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:46.487503 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:46.598412 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.598388 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxpxr" event={"ID":"b3041b5f-fb01-4263-ac00-feae98ffd75b","Type":"ContainerStarted","Data":"ad2e23025c1a5197c974aa7a449e4ccb8ac1669bdfd7a7ecf654840c2afbd73c"} Jun 09 11:07:46.599742 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.599720 2558 generic.go:356] "Generic (PLEG): container finished" podID="ae67b253-e67a-42ee-b1b4-a6c26204ff9f" containerID="c33690f3f233567aaf48e0d1a9abc0ade7b69412b5800edc8049fa614228efe2" exitCode=0 Jun 09 11:07:46.599820 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.599790 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" event={"ID":"ae67b253-e67a-42ee-b1b4-a6c26204ff9f","Type":"ContainerDied","Data":"c33690f3f233567aaf48e0d1a9abc0ade7b69412b5800edc8049fa614228efe2"} Jun 09 11:07:46.601122 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.601103 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" event={"ID":"bd7796a9-b81f-4533-b45d-7ee056cb5221","Type":"ContainerStarted","Data":"4c7c36c24b1f82736e72c5b1a8ebd0f7b03d02c6cb025eb1a8a0f2bc4408196d"} Jun 09 11:07:46.602483 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.602419 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ln24x" event={"ID":"55c63786-c0b0-4457-843a-eb1d16b62564","Type":"ContainerStarted","Data":"49e985068d38056b2cdafb1345fbad8712bf24ccae3476d52231fe6dcb9fb0b6"} Jun 09 11:07:46.606091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.606069 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wpnv2" event={"ID":"04267d35-9ac0-4466-a7db-9740e669c681","Type":"ContainerStarted","Data":"c2983c2d82d91d50eb97536e532a45c2458775247da9deca30fe48e44200c17d"} Jun 09 11:07:46.607336 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.607317 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9xqst" event={"ID":"0b30eae0-cd00-4a3f-9406-1c8bae36286a","Type":"ContainerStarted","Data":"81fec61bf1897b94c39c11b3f4c067762378576db562ec6041dcdeae75f2ccd4"} Jun 09 11:07:46.609638 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.609619 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" event={"ID":"45861504-7f9b-4628-bb0f-e54074f31d71","Type":"ContainerStarted","Data":"8d8f29fc551d1bdb7a0a67154eacdb10e6b0833f23b9a97d135148f42d418e9a"} Jun 09 11:07:46.609722 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.609670 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" event={"ID":"45861504-7f9b-4628-bb0f-e54074f31d71","Type":"ContainerStarted","Data":"31377a8264eaaa031dc2be547a2cb8aee6449f2ab7706a33121995f2e79997af"} Jun 09 11:07:46.609722 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.609708 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" event={"ID":"45861504-7f9b-4628-bb0f-e54074f31d71","Type":"ContainerStarted","Data":"230e04a3beb94d20cc5c01de6a45428ad54dd63a8ff8ebd3c7f128d6128b255b"} Jun 09 11:07:46.609796 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.609749 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" event={"ID":"45861504-7f9b-4628-bb0f-e54074f31d71","Type":"ContainerStarted","Data":"7ddc22b02868cb699c2ea51611f46f7fbb94272e88ded090f73298e878b4ac3f"} Jun 09 11:07:46.609796 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.609779 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" event={"ID":"45861504-7f9b-4628-bb0f-e54074f31d71","Type":"ContainerStarted","Data":"d60e4f061a304bb6aebe227fd75cc05722004ad8361829c4ad126c277d7f8438"} Jun 09 11:07:46.610706 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.610686 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l675b" event={"ID":"cb3cf9c1-c138-4a7f-a389-7327c645757d","Type":"ContainerStarted","Data":"084c8e1c8a1a2e8700273b9143ad0cfcad0ca6ff29c6cf3f489d05fa0447c276"} Jun 09 11:07:46.617891 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.617839 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-194.ec2.internal" podStartSLOduration=21.617827904 podStartE2EDuration="21.617827904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:29.606278497 +0000 UTC m=+5.514663824" watchObservedRunningTime="2026-06-09 11:07:46.617827904 +0000 UTC m=+22.526213230" Jun 09 11:07:46.617974 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.617929 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dxpxr" podStartSLOduration=3.7459515899999998 podStartE2EDuration="22.617921779s" totalImagesPullingTime="18.871970189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:46.617465343 +0000 UTC m=+22.525850668" watchObservedRunningTime="2026-06-09 11:07:46.617921779 +0000 UTC m=+22.526307168" Jun 09 11:07:46.637610 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.637574 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ln24x" podStartSLOduration=3.825271105 podStartE2EDuration="22.637562927s" totalImagesPullingTime="18.812291822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:46.637019881 +0000 UTC m=+22.545405206" watchObservedRunningTime="2026-06-09 11:07:46.637562927 +0000 UTC m=+22.545948252" Jun 09 11:07:46.652670 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.652634 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wpnv2" podStartSLOduration=4.236917653 podStartE2EDuration="22.65262462s" totalImagesPullingTime="18.415706967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:46.652354 +0000 UTC m=+22.560739320" watchObservedRunningTime="2026-06-09 11:07:46.65262462 +0000 UTC m=+22.561009946" Jun 09 11:07:46.702429 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.702373 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9xqst" podStartSLOduration=4.326736242 podStartE2EDuration="22.702362428s" totalImagesPullingTime="18.375626186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:46.70210411 +0000 UTC m=+22.610489439" watchObservedRunningTime="2026-06-09 11:07:46.702362428 +0000 UTC m=+22.610747753" Jun 09 11:07:46.726171 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.726136 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l675b" podStartSLOduration=8.661337576 podStartE2EDuration="22.726126996s" totalImagesPullingTime="14.06478942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:46.725014515 +0000 UTC m=+22.633399864" watchObservedRunningTime="2026-06-09 11:07:46.726126996 +0000 UTC m=+22.634512322" Jun 09 11:07:46.779348 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.779321 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:46.849084 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:46.849058 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:47.332850 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.332789 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:47.333419 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.333399 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:47.515103 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.515073 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:47.582672 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.582453 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:47.590611 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.590552 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 11:07:47.614778 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.614751 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" event={"ID":"bd7796a9-b81f-4533-b45d-7ee056cb5221","Type":"ContainerStarted","Data":"5c275ba201e80102e4b829f6c8ade5f0883e241f8082b76fe058f7b78925028c"} Jun 09 11:07:47.618073 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.618052 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" event={"ID":"45861504-7f9b-4628-bb0f-e54074f31d71","Type":"ContainerStarted","Data":"1c77620510cef0a2f176d20ae54288d2e42fec3dae38c9c661b7ec3872d2cd47"} Jun 09 11:07:47.619484 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.619451 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s6vzx" event={"ID":"5d4e7287-8535-4c9f-951e-4fbab9770dcd","Type":"ContainerStarted","Data":"eaad8f075da4073a33c7b8797908941577f13d85bad3b9b623a5a28f2109db6e"} Jun 09 11:07:47.620274 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.620256 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:47.620530 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.620510 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l675b" Jun 09 11:07:47.651664 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.651615 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s6vzx" podStartSLOduration=4.9151576519999995 podStartE2EDuration="23.651598429s" totalImagesPullingTime="18.736440777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:47.635539573 +0000 UTC m=+23.543924902" watchObservedRunningTime="2026-06-09 11:07:47.651598429 +0000 UTC m=+23.559983771" Jun 09 11:07:47.735302 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.735274 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:47.837588 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.837558 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:47.897958 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.897887 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:47.956794 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:47.956765 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:48.247963 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.247935 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:48.319861 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.319820 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:48.480553 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.480470 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T11:07:47.590572816Z","UUID":"3d534202-95d9-4cb6-97f1-d3719b1dbecc","Handler":null,"Name":"","Endpoint":""} Jun 09 11:07:48.481857 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.481836 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 11:07:48.482001 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.481893 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 11:07:48.486209 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.486189 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:48.486386 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.486223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:48.486386 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.486189 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:48.486386 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:48.486302 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:48.486583 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:48.486405 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:48.486583 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:48.486510 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:48.537850 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.537782 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:48.628374 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.628347 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:48.725064 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.725034 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:48.825821 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.825796 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:48.935480 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:48.935449 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:49.047525 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:49.047452 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:49.135608 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:49.135585 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9xqst_0b30eae0-cd00-4a3f-9406-1c8bae36286a/dns-node-resolver/0.log" Jun 09 11:07:49.257896 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:49.257835 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:49.339564 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:49.339474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:49.626145 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:49.626061 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" event={"ID":"bd7796a9-b81f-4533-b45d-7ee056cb5221","Type":"ContainerStarted","Data":"3f1de4a73c505efeb4da8657aa02f8912d62c3b515e3484876af5c165774e42f"} Jun 09 11:07:49.629664 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:49.629641 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" event={"ID":"45861504-7f9b-4628-bb0f-e54074f31d71","Type":"ContainerStarted","Data":"0de791201e85afd5ed297d9bdde6bafaab46511ba2ad9e913d07fec669ba1935"} Jun 09 11:07:49.646933 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:49.646889 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwv5f" podStartSLOduration=5.000133374 podStartE2EDuration="25.646853435s" totalImagesPullingTime="20.646720061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:49.645446527 +0000 UTC m=+25.553831854" watchObservedRunningTime="2026-06-09 11:07:49.646853435 +0000 UTC m=+25.555238762" Jun 09 11:07:50.486845 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:50.486775 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:50.486845 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:50.486787 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:50.486845 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:50.486812 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:50.487146 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:50.486932 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:50.487146 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:50.487002 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:50.487146 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:50.487070 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:50.535540 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:50.535514 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wpnv2_04267d35-9ac0-4466-a7db-9740e669c681/node-ca/0.log" Jun 09 11:07:50.944628 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:50.944596 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:51.050085 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.049966 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:51.417010 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.416979 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:51.515919 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.515847 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:51.636016 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.635993 2558 generic.go:356] "Generic (PLEG): container finished" podID="ae67b253-e67a-42ee-b1b4-a6c26204ff9f" containerID="b723d48910b73e4f680ee49a0706060e8c95b50c4371d3b7746c3bb50b64e626" exitCode=0 Jun 09 11:07:51.636119 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.636082 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" event={"ID":"ae67b253-e67a-42ee-b1b4-a6c26204ff9f","Type":"ContainerDied","Data":"b723d48910b73e4f680ee49a0706060e8c95b50c4371d3b7746c3bb50b64e626"} Jun 09 11:07:51.640772 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.640543 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" event={"ID":"45861504-7f9b-4628-bb0f-e54074f31d71","Type":"ContainerStarted","Data":"997e57b720145e42b2f1d5a9833b188c918a5020c43a40af6dad9ce1e4eb7c55"} Jun 09 11:07:51.640962 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.640919 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:51.641016 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.640987 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:51.641070 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.641030 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:51.656048 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.656031 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:51.656436 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:51.656416 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:07:52.083517 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:52.083481 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:52.486582 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:52.486553 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:52.486776 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:52.486553 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:52.486776 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:52.486696 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:52.486776 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:52.486692 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:52.486927 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:52.486795 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:52.486927 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:52.486896 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:52.805297 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:52.805269 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:52.987521 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:52.987373 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:53.011865 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.011793 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" podStartSLOduration=10.19963904 podStartE2EDuration="29.011779535s" totalImagesPullingTime="18.812140495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:51.696453246 +0000 UTC m=+27.604838571" watchObservedRunningTime="2026-06-09 11:07:53.011779535 +0000 UTC m=+28.920164861" Jun 09 11:07:53.012527 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.012510 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kb4nv"] Jun 09 11:07:53.012635 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.012624 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:53.012719 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:53.012703 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:53.016931 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.016910 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-565cd"] Jun 09 11:07:53.017026 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.017012 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:53.017136 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:53.017110 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:53.045288 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.045268 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tnz62"] Jun 09 11:07:53.045358 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.045339 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:53.045412 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:53.045397 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:53.114994 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.114961 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:53.221817 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.221789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:53.326177 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.326107 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:53.496274 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.496248 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:53.647129 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.647061 2558 generic.go:356] "Generic (PLEG): container finished" podID="ae67b253-e67a-42ee-b1b4-a6c26204ff9f" containerID="b7b40781755c4ad8b65e5f5c1aa3bd0bd1f642ca44dc7e6f8961d291d334ba8e" exitCode=0 Jun 09 11:07:53.647129 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:53.647102 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" event={"ID":"ae67b253-e67a-42ee-b1b4-a6c26204ff9f","Type":"ContainerDied","Data":"b7b40781755c4ad8b65e5f5c1aa3bd0bd1f642ca44dc7e6f8961d291d334ba8e"} Jun 09 11:07:54.487003 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:54.486980 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:54.487494 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:54.487089 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:54.487494 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:54.487136 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:54.487494 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:54.487188 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:54.487494 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:54.487221 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:54.487494 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:54.487323 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:54.497819 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:54.497790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:54.913012 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:54.912975 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:55.093182 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:55.093139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:55.300549 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:55.300470 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:55.394599 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:55.394570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:55.573919 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:55.573837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:55.655008 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:55.654983 2558 generic.go:356] "Generic (PLEG): container finished" podID="ae67b253-e67a-42ee-b1b4-a6c26204ff9f" containerID="d7e45b879140f51ddd3c266af3bde791cd5b6f05d9433a0c5ccf31636b1d1cf7" exitCode=0 Jun 09 11:07:55.655113 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:55.655035 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" event={"ID":"ae67b253-e67a-42ee-b1b4-a6c26204ff9f","Type":"ContainerDied","Data":"d7e45b879140f51ddd3c266af3bde791cd5b6f05d9433a0c5ccf31636b1d1cf7"} Jun 09 11:07:55.691580 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:55.691554 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:55.777225 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:55.777198 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:56.486209 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:56.486172 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:56.486376 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:56.486289 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:56.486376 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:56.486322 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:56.486505 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:56.486446 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:56.486505 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:56.486288 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:56.486597 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:56.486544 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:56.487602 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:56.487568 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:56.587533 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:56.587501 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:56.689953 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:56.689853 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:56.894455 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:56.894415 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:57.298698 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:57.298657 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:57.368899 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:57.368851 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:57.709213 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:57.709184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:58.190992 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:58.190964 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:58.191166 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:58.191013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:58.191166 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.191118 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:58.191166 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.191130 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:58.191295 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.191178 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs podName:1e0a06bb-e1b3-42c5-be16-57d0a40b8990 nodeName:}" failed. No retries permitted until 2026-06-09 11:08:30.191162469 +0000 UTC m=+66.099547778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs") pod "network-metrics-daemon-kb4nv" (UID: "1e0a06bb-e1b3-42c5-be16-57d0a40b8990") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:07:58.191295 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.191192 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret podName:d35dc75d-89f4-405b-8e36-b479b12f9687 nodeName:}" failed. No retries permitted until 2026-06-09 11:08:30.191185817 +0000 UTC m=+66.099571120 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret") pod "global-pull-secret-syncer-565cd" (UID: "d35dc75d-89f4-405b-8e36-b479b12f9687") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:07:58.325703 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:58.325670 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:58.392671 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:58.392632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc77z\" (UniqueName: \"kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z\") pod \"network-check-target-tnz62\" (UID: \"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65\") " pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:58.392829 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.392807 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:07:58.392829 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.392829 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:07:58.392979 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.392841 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tc77z for pod openshift-network-diagnostics/network-check-target-tnz62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:58.392979 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.392932 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z podName:5fb47958-5ed9-4a06-8ce5-d1962f5aeb65 nodeName:}" failed. No retries permitted until 2026-06-09 11:08:30.392911654 +0000 UTC m=+66.301296973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc77z" (UniqueName: "kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z") pod "network-check-target-tnz62" (UID: "5fb47958-5ed9-4a06-8ce5-d1962f5aeb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:07:58.486188 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:58.486109 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:07:58.486336 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:58.486115 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:07:58.486336 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.486231 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:07:58.486336 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:58.486243 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:07:58.486494 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.486352 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:07:58.486494 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:07:58.486439 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:07:58.912002 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:58.911916 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:59.112640 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:59.112605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:59.208698 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:59.208635 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:59.310384 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:59.310347 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:59.413846 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:59.413813 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:59.692614 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:07:59.692583 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:00.485259 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:00.485072 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:00.486885 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:00.486859 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:00.486975 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:00.486860 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:00.486975 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:00.486968 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:08:00.487075 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:00.486984 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:00.487075 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:00.487057 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:08:00.487189 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:00.487161 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:08:00.668730 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:00.668695 2558 generic.go:356] "Generic (PLEG): container finished" podID="ae67b253-e67a-42ee-b1b4-a6c26204ff9f" containerID="fc9edc8cf9adae04d284ed5d43202ad85e832f8ba7a939be69dcf159623e210c" exitCode=0 Jun 09 11:08:00.668908 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:00.668743 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" event={"ID":"ae67b253-e67a-42ee-b1b4-a6c26204ff9f","Type":"ContainerDied","Data":"fc9edc8cf9adae04d284ed5d43202ad85e832f8ba7a939be69dcf159623e210c"} Jun 09 11:08:00.684414 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:00.684386 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:01.087680 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:01.087565 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:01.190446 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:01.190399 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:01.295272 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:01.295234 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:01.676173 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:01.676139 2558 generic.go:356] "Generic (PLEG): container finished" podID="ae67b253-e67a-42ee-b1b4-a6c26204ff9f" containerID="3311ba18eb8a415a8203b1e9ebff93eebb6479cd3f58d70eccae1d8d62473617" exitCode=0 Jun 09 11:08:01.676530 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:01.676181 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" event={"ID":"ae67b253-e67a-42ee-b1b4-a6c26204ff9f","Type":"ContainerDied","Data":"3311ba18eb8a415a8203b1e9ebff93eebb6479cd3f58d70eccae1d8d62473617"} Jun 09 11:08:01.688597 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:01.688574 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:02.090409 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:02.090382 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:02.486686 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:02.486662 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:02.486686 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:02.486672 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:02.486936 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:02.486800 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:02.486936 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:02.486760 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:08:02.486936 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:02.486902 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:08:02.487103 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:02.486992 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:08:02.682016 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:02.681984 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" event={"ID":"ae67b253-e67a-42ee-b1b4-a6c26204ff9f","Type":"ContainerStarted","Data":"61de7a6d8e18974376958d1a60fa813f995ab8d5d62b8d37b2207efa2d27f332"} Jun 09 11:08:02.695003 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:02.694978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:02.713277 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:02.713237 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fqd6x" podStartSLOduration=9.226053169 podStartE2EDuration="38.713220664s" totalImagesPullingTime="29.487167495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:02.71277546 +0000 UTC m=+38.621160787" watchObservedRunningTime="2026-06-09 11:08:02.713220664 +0000 UTC m=+38.621605992" Jun 09 11:08:02.872401 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:02.872345 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:02.972151 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:02.972125 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:03.122683 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:03.122620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:03.299945 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:03.299925 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:03.507980 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:03.507948 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:03.604278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:03.604249 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:03.795722 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:03.795653 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:04.486975 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:04.486951 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:04.487121 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:04.487033 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:08:04.487121 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:04.487067 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:04.487121 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:04.487116 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:08:04.487221 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:04.487140 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:04.487221 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:04.487195 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:08:06.381113 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:06.381076 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:06.477984 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:06.477948 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:06.486761 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:06.486742 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:06.486761 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:06.486756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:06.486923 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:06.486756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:06.486923 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:06.486825 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:08:06.486997 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:06.486958 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:08:06.487032 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:06.487003 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:08:06.544526 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:06.544483 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:06.679231 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:06.679165 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:06.861215 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:06.861188 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:06.924192 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:06.924174 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:07.271819 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:07.271790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:07.348615 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:07.348590 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:07.662823 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:07.662752 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:07.739706 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:07.739675 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:07.873673 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:07.873646 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:08.071408 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:08.071382 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:08.486240 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:08.486217 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:08.486240 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:08.486228 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:08.486475 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:08.486228 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:08.486475 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:08.486333 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:08:08.486475 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:08.486381 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:08:08.486475 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:08.486440 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:08:08.810699 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:08.810622 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:08.890712 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:08.890684 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:08.961984 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:08.961955 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:10.486604 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:10.486575 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:10.486604 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:10.486597 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:10.487043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:10.486665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:10.487043 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:10.486676 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:08:10.487043 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:10.486769 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:08:10.487043 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:10.486847 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:08:12.489206 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:12.489177 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:12.489607 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:12.489264 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:12.489607 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:12.489270 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:12.489607 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:12.489350 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-565cd" podUID="d35dc75d-89f4-405b-8e36-b479b12f9687" Jun 09 11:08:12.489607 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:12.489267 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnz62" podUID="5fb47958-5ed9-4a06-8ce5-d1962f5aeb65" Jun 09 11:08:12.489607 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:12.489415 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb4nv" podUID="1e0a06bb-e1b3-42c5-be16-57d0a40b8990" Jun 09 11:08:12.495252 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:12.495221 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:12.597153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:12.597118 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:13.540655 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:13.540621 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:13.639637 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:13.639596 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:13.742242 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:13.742214 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:13.930591 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:13.930528 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:13.976359 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:13.976342 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-194.ec2.internal" event="NodeReady" Jun 09 11:08:13.976477 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:13.976455 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 11:08:14.008361 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.008335 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:14.026851 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.026828 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-866bc55cb7-8nfch"] Jun 09 11:08:14.049566 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.049541 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-866bc55cb7-8nfch"] Jun 09 11:08:14.049650 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.049579 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tfxhn"] Jun 09 11:08:14.049650 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.049640 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.054179 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.054125 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lgh6s\"" Jun 09 11:08:14.054179 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.054132 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 11:08:14.054407 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.054390 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 11:08:14.054759 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.054745 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 11:08:14.060798 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.060781 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 11:08:14.064655 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.064630 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dprqh"] Jun 09 11:08:14.064798 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.064768 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.067251 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.067229 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 11:08:14.067386 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.067233 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 11:08:14.067660 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.067643 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5k287\"" Jun 09 11:08:14.082682 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.082662 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dprqh"] Jun 09 11:08:14.082762 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.082689 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tfxhn"] Jun 09 11:08:14.082762 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.082707 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7rbx9"] Jun 09 11:08:14.082843 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.082778 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dprqh" Jun 09 11:08:14.085364 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.085316 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 11:08:14.085464 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.085373 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 11:08:14.085519 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.085481 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 11:08:14.085519 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.085481 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qxgvb\"" Jun 09 11:08:14.102857 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.102838 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7rbx9"] Jun 09 11:08:14.102959 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.102942 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.105702 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.105664 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 11:08:14.105937 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.105923 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-st677\"" Jun 09 11:08:14.106199 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.106186 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 11:08:14.106261 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.106189 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 11:08:14.108091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.108075 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 11:08:14.113141 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113117 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af85f2f8-f1f8-4d8e-8911-0569da059f64-registry-tls\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.113231 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113148 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af85f2f8-f1f8-4d8e-8911-0569da059f64-ca-trust-extracted\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.113231 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113167 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-tmp-dir\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.113344 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113238 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3855fc3e-327f-4768-b01b-af138bcc65eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.113344 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113275 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af85f2f8-f1f8-4d8e-8911-0569da059f64-bound-sa-token\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.113344 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg6dx\" (UniqueName: \"kubernetes.io/projected/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-kube-api-access-rg6dx\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.113491 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113357 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af85f2f8-f1f8-4d8e-8911-0569da059f64-trusted-ca\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.113491 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3855fc3e-327f-4768-b01b-af138bcc65eb-crio-socket\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.113491 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3855fc3e-327f-4768-b01b-af138bcc65eb-data-volume\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.113491 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3855fc3e-327f-4768-b01b-af138bcc65eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.113491 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113458 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af85f2f8-f1f8-4d8e-8911-0569da059f64-installation-pull-secrets\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.113662 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113503 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsnp5\" (UniqueName: \"kubernetes.io/projected/af85f2f8-f1f8-4d8e-8911-0569da059f64-kube-api-access-rsnp5\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.113662 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af85f2f8-f1f8-4d8e-8911-0569da059f64-registry-certificates\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.113662 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113549 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-config-volume\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.113662 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-metrics-tls\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.113662 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113590 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af85f2f8-f1f8-4d8e-8911-0569da059f64-image-registry-private-configuration\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.113662 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113615 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60af79fd-4dda-4e86-8fb5-2f329d0e405d-cert\") pod \"ingress-canary-dprqh\" (UID: \"60af79fd-4dda-4e86-8fb5-2f329d0e405d\") " pod="openshift-ingress-canary/ingress-canary-dprqh" Jun 09 11:08:14.113662 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113642 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zvfv\" (UniqueName: \"kubernetes.io/projected/60af79fd-4dda-4e86-8fb5-2f329d0e405d-kube-api-access-5zvfv\") pod \"ingress-canary-dprqh\" (UID: \"60af79fd-4dda-4e86-8fb5-2f329d0e405d\") " pod="openshift-ingress-canary/ingress-canary-dprqh" Jun 09 11:08:14.113894 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.113667 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk4lx\" (UniqueName: \"kubernetes.io/projected/3855fc3e-327f-4768-b01b-af138bcc65eb-kube-api-access-nk4lx\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.163301 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.163275 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-664647f7bf-mrbxs"] Jun 09 11:08:14.167830 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.167807 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:14.176430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.176414 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.179212 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.179189 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 11:08:14.179311 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.179230 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664647f7bf-mrbxs"] Jun 09 11:08:14.179311 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.179276 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 11:08:14.179702 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.179679 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 11:08:14.179989 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.179827 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 11:08:14.179989 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.179955 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 11:08:14.180153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.179998 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-grmsd\"" Jun 09 11:08:14.180204 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.180195 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 11:08:14.180300 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.180286 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 11:08:14.214697 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60af79fd-4dda-4e86-8fb5-2f329d0e405d-cert\") pod \"ingress-canary-dprqh\" (UID: \"60af79fd-4dda-4e86-8fb5-2f329d0e405d\") " pod="openshift-ingress-canary/ingress-canary-dprqh" Jun 09 11:08:14.214804 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zvfv\" (UniqueName: \"kubernetes.io/projected/60af79fd-4dda-4e86-8fb5-2f329d0e405d-kube-api-access-5zvfv\") pod \"ingress-canary-dprqh\" (UID: \"60af79fd-4dda-4e86-8fb5-2f329d0e405d\") " pod="openshift-ingress-canary/ingress-canary-dprqh" Jun 09 11:08:14.214804 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk4lx\" (UniqueName: \"kubernetes.io/projected/3855fc3e-327f-4768-b01b-af138bcc65eb-kube-api-access-nk4lx\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.214804 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214735 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af85f2f8-f1f8-4d8e-8911-0569da059f64-registry-tls\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.214804 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214749 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af85f2f8-f1f8-4d8e-8911-0569da059f64-ca-trust-extracted\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.214804 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-tmp-dir\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.215091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3855fc3e-327f-4768-b01b-af138bcc65eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.215091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214888 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af85f2f8-f1f8-4d8e-8911-0569da059f64-bound-sa-token\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.215091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-serving-cert\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.215091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-service-ca\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.215091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214971 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg6dx\" (UniqueName: \"kubernetes.io/projected/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-kube-api-access-rg6dx\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.215091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.214995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-console-config\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.215091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cqbh\" (UniqueName: \"kubernetes.io/projected/292e442f-5175-47e3-a0e0-0328b011359c-kube-api-access-5cqbh\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.215430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215129 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-tmp-dir\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.215430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215141 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af85f2f8-f1f8-4d8e-8911-0569da059f64-trusted-ca\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.215430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215165 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af85f2f8-f1f8-4d8e-8911-0569da059f64-ca-trust-extracted\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.215430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3855fc3e-327f-4768-b01b-af138bcc65eb-crio-socket\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.215430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215208 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3855fc3e-327f-4768-b01b-af138bcc65eb-data-volume\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.215430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215232 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3855fc3e-327f-4768-b01b-af138bcc65eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.215430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215322 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3855fc3e-327f-4768-b01b-af138bcc65eb-crio-socket\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.215430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215368 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af85f2f8-f1f8-4d8e-8911-0569da059f64-installation-pull-secrets\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.215430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsnp5\" (UniqueName: \"kubernetes.io/projected/af85f2f8-f1f8-4d8e-8911-0569da059f64-kube-api-access-rsnp5\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.215430 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215432 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-oauth-serving-cert\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.215930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215460 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af85f2f8-f1f8-4d8e-8911-0569da059f64-registry-certificates\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.215930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215481 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-config-volume\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.215930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-metrics-tls\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.215930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-oauth-config\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.215930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215537 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3855fc3e-327f-4768-b01b-af138bcc65eb-data-volume\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.215930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215579 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af85f2f8-f1f8-4d8e-8911-0569da059f64-image-registry-private-configuration\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.215930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.215813 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3855fc3e-327f-4768-b01b-af138bcc65eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.216315 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.216176 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af85f2f8-f1f8-4d8e-8911-0569da059f64-trusted-ca\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.216315 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.216216 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af85f2f8-f1f8-4d8e-8911-0569da059f64-registry-certificates\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.216315 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.216305 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-config-volume\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.219225 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.219125 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-metrics-tls\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.219334 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.219252 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af85f2f8-f1f8-4d8e-8911-0569da059f64-image-registry-private-configuration\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.219334 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.219278 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60af79fd-4dda-4e86-8fb5-2f329d0e405d-cert\") pod \"ingress-canary-dprqh\" (UID: \"60af79fd-4dda-4e86-8fb5-2f329d0e405d\") " pod="openshift-ingress-canary/ingress-canary-dprqh" Jun 09 11:08:14.219334 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.219287 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3855fc3e-327f-4768-b01b-af138bcc65eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.219334 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.219314 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af85f2f8-f1f8-4d8e-8911-0569da059f64-installation-pull-secrets\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.219542 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.219472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af85f2f8-f1f8-4d8e-8911-0569da059f64-registry-tls\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.228141 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.228096 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg6dx\" (UniqueName: \"kubernetes.io/projected/54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3-kube-api-access-rg6dx\") pod \"dns-default-tfxhn\" (UID: \"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3\") " pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.228497 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.228475 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk4lx\" (UniqueName: \"kubernetes.io/projected/3855fc3e-327f-4768-b01b-af138bcc65eb-kube-api-access-nk4lx\") pod \"insights-runtime-extractor-7rbx9\" (UID: \"3855fc3e-327f-4768-b01b-af138bcc65eb\") " pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.228725 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.228696 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsnp5\" (UniqueName: \"kubernetes.io/projected/af85f2f8-f1f8-4d8e-8911-0569da059f64-kube-api-access-rsnp5\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.228809 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.228795 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zvfv\" (UniqueName: \"kubernetes.io/projected/60af79fd-4dda-4e86-8fb5-2f329d0e405d-kube-api-access-5zvfv\") pod \"ingress-canary-dprqh\" (UID: \"60af79fd-4dda-4e86-8fb5-2f329d0e405d\") " pod="openshift-ingress-canary/ingress-canary-dprqh" Jun 09 11:08:14.229712 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.229698 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af85f2f8-f1f8-4d8e-8911-0569da059f64-bound-sa-token\") pod \"image-registry-866bc55cb7-8nfch\" (UID: \"af85f2f8-f1f8-4d8e-8911-0569da059f64\") " pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.263657 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.263638 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:14.316247 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.316226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-serving-cert\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.316357 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.316252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-service-ca\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.316357 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.316269 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-console-config\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.316357 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.316344 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cqbh\" (UniqueName: \"kubernetes.io/projected/292e442f-5175-47e3-a0e0-0328b011359c-kube-api-access-5cqbh\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.316512 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.316423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-oauth-serving-cert\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.316566 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.316546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-oauth-config\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.317016 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.316995 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-service-ca\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.317097 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.317043 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-oauth-serving-cert\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.317276 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.317257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-console-config\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.318496 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.318478 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-serving-cert\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.318722 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.318707 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-oauth-config\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.325059 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.325041 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cqbh\" (UniqueName: \"kubernetes.io/projected/292e442f-5175-47e3-a0e0-0328b011359c-kube-api-access-5cqbh\") pod \"console-664647f7bf-mrbxs\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.334188 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.334159 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:14.359192 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.359170 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:14.373583 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.373562 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:14.390701 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.390681 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dprqh" Jun 09 11:08:14.412078 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.412054 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7rbx9" Jun 09 11:08:14.494516 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.494278 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:14.510312 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.508673 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:14.510312 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.509077 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:14.510312 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.509503 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:14.513972 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.512223 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:08:14.513972 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.512612 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:08:14.513972 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.512809 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:08:14.513972 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.513063 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-464pd\"" Jun 09 11:08:14.513972 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.513267 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:08:14.513972 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.513446 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ft8nx\"" Jun 09 11:08:14.619541 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.619516 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-866bc55cb7-8nfch"] Jun 09 11:08:14.625953 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:14.625927 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf85f2f8_f1f8_4d8e_8911_0569da059f64.slice/crio-761c78b1bebc500eb902cc732b65d23b1f9a063ae8830438b4c64d2c5e2aba2d WatchSource:0}: Error finding container 761c78b1bebc500eb902cc732b65d23b1f9a063ae8830438b4c64d2c5e2aba2d: Status 404 returned error can't find the container with id 761c78b1bebc500eb902cc732b65d23b1f9a063ae8830438b4c64d2c5e2aba2d Jun 09 11:08:14.627238 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.627215 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tfxhn"] Jun 09 11:08:14.631782 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:14.631744 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e4f2ff_e9f1_49a7_b9fa_7bdc47e5a6c3.slice/crio-a42478a9b7c89eacc3319cc9ba468f621b59906359a890f26e43e8197d44f223 WatchSource:0}: Error finding container a42478a9b7c89eacc3319cc9ba468f621b59906359a890f26e43e8197d44f223: Status 404 returned error can't find the container with id a42478a9b7c89eacc3319cc9ba468f621b59906359a890f26e43e8197d44f223 Jun 09 11:08:14.693623 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.693601 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664647f7bf-mrbxs"] Jun 09 11:08:14.696484 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:14.696458 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292e442f_5175_47e3_a0e0_0328b011359c.slice/crio-9dc5801940415c951ff9edcd8da370f8e70878366a26659f079d40aeafa7476a WatchSource:0}: Error finding container 9dc5801940415c951ff9edcd8da370f8e70878366a26659f079d40aeafa7476a: Status 404 returned error can't find the container with id 9dc5801940415c951ff9edcd8da370f8e70878366a26659f079d40aeafa7476a Jun 09 11:08:14.707512 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.707490 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664647f7bf-mrbxs" event={"ID":"292e442f-5175-47e3-a0e0-0328b011359c","Type":"ContainerStarted","Data":"9dc5801940415c951ff9edcd8da370f8e70878366a26659f079d40aeafa7476a"} Jun 09 11:08:14.708556 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.708535 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tfxhn" event={"ID":"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3","Type":"ContainerStarted","Data":"a42478a9b7c89eacc3319cc9ba468f621b59906359a890f26e43e8197d44f223"} Jun 09 11:08:14.709808 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.709786 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" event={"ID":"af85f2f8-f1f8-4d8e-8911-0569da059f64","Type":"ContainerStarted","Data":"761c78b1bebc500eb902cc732b65d23b1f9a063ae8830438b4c64d2c5e2aba2d"} Jun 09 11:08:14.843070 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.843039 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dprqh"] Jun 09 11:08:14.846428 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:14.846401 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60af79fd_4dda_4e86_8fb5_2f329d0e405d.slice/crio-586c97ff464614947e1a2a0d2d849858381baef7b946bf417d98a92eb6625f9e WatchSource:0}: Error finding container 586c97ff464614947e1a2a0d2d849858381baef7b946bf417d98a92eb6625f9e: Status 404 returned error can't find the container with id 586c97ff464614947e1a2a0d2d849858381baef7b946bf417d98a92eb6625f9e Jun 09 11:08:14.846911 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:14.846891 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7rbx9"] Jun 09 11:08:14.850028 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:14.850003 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3855fc3e_327f_4768_b01b_af138bcc65eb.slice/crio-c584921b96ad7a69bcb0cad35c9bfe47ed5db1e1d34d2cbe21b2412b71f3c9b2 WatchSource:0}: Error finding container c584921b96ad7a69bcb0cad35c9bfe47ed5db1e1d34d2cbe21b2412b71f3c9b2: Status 404 returned error can't find the container with id c584921b96ad7a69bcb0cad35c9bfe47ed5db1e1d34d2cbe21b2412b71f3c9b2 Jun 09 11:08:15.714005 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:15.713963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" event={"ID":"af85f2f8-f1f8-4d8e-8911-0569da059f64","Type":"ContainerStarted","Data":"b77025bded9287f181a4af55fb9a6f699921860f4c0c1d61339acc28d8ee4616"} Jun 09 11:08:15.714395 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:15.714064 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:15.715264 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:15.715237 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7rbx9" event={"ID":"3855fc3e-327f-4768-b01b-af138bcc65eb","Type":"ContainerStarted","Data":"cd4b66b522c9881458f3ac63f76341dd862cab52d09adc43db97ec4fa88c9102"} Jun 09 11:08:15.715360 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:15.715291 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7rbx9" event={"ID":"3855fc3e-327f-4768-b01b-af138bcc65eb","Type":"ContainerStarted","Data":"c584921b96ad7a69bcb0cad35c9bfe47ed5db1e1d34d2cbe21b2412b71f3c9b2"} Jun 09 11:08:15.716279 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:15.716248 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dprqh" event={"ID":"60af79fd-4dda-4e86-8fb5-2f329d0e405d","Type":"ContainerStarted","Data":"586c97ff464614947e1a2a0d2d849858381baef7b946bf417d98a92eb6625f9e"} Jun 09 11:08:15.739703 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:15.739657 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" podStartSLOduration=2.739644699 podStartE2EDuration="2.739644699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:15.737433452 +0000 UTC m=+51.645818781" watchObservedRunningTime="2026-06-09 11:08:15.739644699 +0000 UTC m=+51.648030025" Jun 09 11:08:16.460128 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.459817 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:16.560671 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.560560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:16.646777 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.646742 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:16.650037 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.650012 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts"] Jun 09 11:08:16.673858 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.673839 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts"] Jun 09 11:08:16.673987 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.673973 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" Jun 09 11:08:16.676855 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.676818 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 11:08:16.676980 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.676853 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zjs9q\"" Jun 09 11:08:16.744093 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.744028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8758f314-ec7e-4f86-8187-c81273d2c130-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kdvts\" (UID: \"8758f314-ec7e-4f86-8187-c81273d2c130\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" Jun 09 11:08:16.845886 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.845847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8758f314-ec7e-4f86-8187-c81273d2c130-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kdvts\" (UID: \"8758f314-ec7e-4f86-8187-c81273d2c130\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" Jun 09 11:08:16.846024 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:16.846008 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 09 11:08:16.846076 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:16.846066 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8758f314-ec7e-4f86-8187-c81273d2c130-tls-certificates podName:8758f314-ec7e-4f86-8187-c81273d2c130 nodeName:}" failed. No retries permitted until 2026-06-09 11:08:17.346048835 +0000 UTC m=+53.254434152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8758f314-ec7e-4f86-8187-c81273d2c130-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-kdvts" (UID: "8758f314-ec7e-4f86-8187-c81273d2c130") : secret "prometheus-operator-admission-webhook-tls" not found Jun 09 11:08:16.915718 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:16.915688 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:17.350642 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:17.350602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8758f314-ec7e-4f86-8187-c81273d2c130-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kdvts\" (UID: \"8758f314-ec7e-4f86-8187-c81273d2c130\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" Jun 09 11:08:17.353404 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:17.353375 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8758f314-ec7e-4f86-8187-c81273d2c130-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kdvts\" (UID: \"8758f314-ec7e-4f86-8187-c81273d2c130\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" Jun 09 11:08:17.583908 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:17.583862 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" Jun 09 11:08:17.647316 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:17.647243 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:17.723044 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:17.723014 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tfxhn" event={"ID":"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3","Type":"ContainerStarted","Data":"16d277333d8e5079e9e48cc38de4a0af36c18cd51f9c1f3195deb502149b5731"} Jun 09 11:08:17.725230 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:17.725169 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7rbx9" event={"ID":"3855fc3e-327f-4768-b01b-af138bcc65eb","Type":"ContainerStarted","Data":"4e7b1fa1e26187774b5054168f6e02f42fccfaf2dda0fbe8138e732ca12bb6a4"} Jun 09 11:08:17.725567 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:17.725546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:17.972761 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:17.972729 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:18.073646 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.073498 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:18.305838 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.305751 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:18.308953 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.308911 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b7d8d7fbf-zww7r"] Jun 09 11:08:18.373233 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.373205 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7d8d7fbf-zww7r"] Jun 09 11:08:18.373389 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.373292 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.387348 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.387318 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 11:08:18.403520 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.403486 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:18.461080 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.461042 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-trusted-ca-bundle\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.461222 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.461091 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-service-ca\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.461222 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.461180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-oauth-serving-cert\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.461341 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.461235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b68b9\" (UniqueName: \"kubernetes.io/projected/fe4ecc69-14d0-44a6-8e16-492de60d9f53-kube-api-access-b68b9\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.461341 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.461278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-oauth-config\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.461441 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.461343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-serving-cert\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.461441 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.461395 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-config\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562017 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.561946 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-trusted-ca-bundle\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562163 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.562082 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-service-ca\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562163 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.562116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-oauth-serving-cert\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562163 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.562133 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b68b9\" (UniqueName: \"kubernetes.io/projected/fe4ecc69-14d0-44a6-8e16-492de60d9f53-kube-api-access-b68b9\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562318 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.562162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-oauth-config\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562318 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.562226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-serving-cert\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562318 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.562278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-config\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562775 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.562754 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-service-ca\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562891 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.562776 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-trusted-ca-bundle\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562957 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.562889 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-oauth-serving-cert\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.562957 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.562906 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-config\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.564998 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.564973 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-oauth-config\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.565230 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.565211 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-serving-cert\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.572494 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.572474 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b68b9\" (UniqueName: \"kubernetes.io/projected/fe4ecc69-14d0-44a6-8e16-492de60d9f53-kube-api-access-b68b9\") pod \"console-7b7d8d7fbf-zww7r\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:18.685861 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:18.685842 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:19.270576 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.270519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:19.368329 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.368291 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:19.375977 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.375916 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts"] Jun 09 11:08:19.380646 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:19.380617 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8758f314_ec7e_4f86_8187_c81273d2c130.slice/crio-2de4d7055fb86287dff88a9e6b2ea4f86d73088f7c96bad8521dc74e2ae6d52e WatchSource:0}: Error finding container 2de4d7055fb86287dff88a9e6b2ea4f86d73088f7c96bad8521dc74e2ae6d52e: Status 404 returned error can't find the container with id 2de4d7055fb86287dff88a9e6b2ea4f86d73088f7c96bad8521dc74e2ae6d52e Jun 09 11:08:19.401362 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.401306 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7d8d7fbf-zww7r"] Jun 09 11:08:19.404707 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:19.404684 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4ecc69_14d0_44a6_8e16_492de60d9f53.slice/crio-a48d384242b1f08161a7cf8521e1203dff81e78a8d0067d19d6606bd2a1dbc85 WatchSource:0}: Error finding container a48d384242b1f08161a7cf8521e1203dff81e78a8d0067d19d6606bd2a1dbc85: Status 404 returned error can't find the container with id a48d384242b1f08161a7cf8521e1203dff81e78a8d0067d19d6606bd2a1dbc85 Jun 09 11:08:19.732596 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.732566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dprqh" event={"ID":"60af79fd-4dda-4e86-8fb5-2f329d0e405d","Type":"ContainerStarted","Data":"c0c193da4b49bbc0af9c8b5600cf13f7b05b0a779c6000710eef7f2145ca345b"} Jun 09 11:08:19.734175 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.734148 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7d8d7fbf-zww7r" event={"ID":"fe4ecc69-14d0-44a6-8e16-492de60d9f53","Type":"ContainerStarted","Data":"d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612"} Jun 09 11:08:19.734308 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.734196 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7d8d7fbf-zww7r" event={"ID":"fe4ecc69-14d0-44a6-8e16-492de60d9f53","Type":"ContainerStarted","Data":"a48d384242b1f08161a7cf8521e1203dff81e78a8d0067d19d6606bd2a1dbc85"} Jun 09 11:08:19.735271 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.735252 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" event={"ID":"8758f314-ec7e-4f86-8187-c81273d2c130","Type":"ContainerStarted","Data":"2de4d7055fb86287dff88a9e6b2ea4f86d73088f7c96bad8521dc74e2ae6d52e"} Jun 09 11:08:19.736539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.736519 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664647f7bf-mrbxs" event={"ID":"292e442f-5175-47e3-a0e0-0328b011359c","Type":"ContainerStarted","Data":"c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3"} Jun 09 11:08:19.738241 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.738221 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tfxhn" event={"ID":"54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3","Type":"ContainerStarted","Data":"8b471e63f60005dcb4cf2c0f0124778a4f2a74cc0c8bc214f6653d332286f989"} Jun 09 11:08:19.738341 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.738274 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:19.740136 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.740111 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7rbx9" event={"ID":"3855fc3e-327f-4768-b01b-af138bcc65eb","Type":"ContainerStarted","Data":"8e914fe2448a434543fd1e7f9495958c2ad76545a590ef7abe3b73a937e8dad1"} Jun 09 11:08:19.771440 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.771399 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dprqh" podStartSLOduration=1.3923368219999999 podStartE2EDuration="5.771387686s" totalImagesPullingTime="4.379050864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:19.771284959 +0000 UTC m=+55.679670285" watchObservedRunningTime="2026-06-09 11:08:19.771387686 +0000 UTC m=+55.679773006" Jun 09 11:08:19.807211 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.807086 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-664647f7bf-mrbxs" podStartSLOduration=1.270689128 podStartE2EDuration="5.80707008s" totalImagesPullingTime="4.536380952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:19.807005557 +0000 UTC m=+55.715390883" watchObservedRunningTime="2026-06-09 11:08:19.80707008 +0000 UTC m=+55.715455409" Jun 09 11:08:19.854016 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.853968 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b7d8d7fbf-zww7r" podStartSLOduration=1.8539525700000001 podStartE2EDuration="1.85395257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:19.851572606 +0000 UTC m=+55.759957933" watchObservedRunningTime="2026-06-09 11:08:19.85395257 +0000 UTC m=+55.762337894" Jun 09 11:08:19.881201 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.881149 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tfxhn" podStartSLOduration=3.705805798 podStartE2EDuration="5.881103694s" totalImagesPullingTime="2.175297896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:19.880400329 +0000 UTC m=+55.788785656" watchObservedRunningTime="2026-06-09 11:08:19.881103694 +0000 UTC m=+55.789489024" Jun 09 11:08:19.907662 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:19.907612 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7rbx9" podStartSLOduration=1.683713923 podStartE2EDuration="5.907595251s" totalImagesPullingTime="4.223881328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:08:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:19.906162932 +0000 UTC m=+55.814548259" watchObservedRunningTime="2026-06-09 11:08:19.907595251 +0000 UTC m=+55.815980578" Jun 09 11:08:20.744884 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:20.744831 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" event={"ID":"8758f314-ec7e-4f86-8187-c81273d2c130","Type":"ContainerStarted","Data":"5148dd4aa7a5eacc53c15fa0af10803c79a54477e1f61c350f74d3279b0f25f2"} Jun 09 11:08:20.745671 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:20.745647 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" Jun 09 11:08:20.749572 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:20.749552 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" Jun 09 11:08:20.765353 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:20.765313 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kdvts" podStartSLOduration=3.7631307229999997 podStartE2EDuration="4.765299894s" totalImagesPullingTime="1.002169171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:20.764702729 +0000 UTC m=+56.673088082" watchObservedRunningTime="2026-06-09 11:08:20.765299894 +0000 UTC m=+56.673685220" Jun 09 11:08:20.853150 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:20.853116 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:20.935303 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:20.935271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:21.683022 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:21.682986 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:21.755968 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:21.755941 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:22.252063 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:22.252029 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:22.900885 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:22.900840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:22.957237 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:22.957203 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:23.657979 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:23.657953 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nm45q" Jun 09 11:08:23.831001 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:23.830969 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:23.892176 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:23.892137 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:24.495559 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:24.495528 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:24.495912 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:24.495576 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:24.496746 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:24.496725 2558 patch_prober.go:28] interesting pod/console-664647f7bf-mrbxs container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" start-of-body= Jun 09 11:08:24.496786 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:24.496766 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-664647f7bf-mrbxs" podUID="292e442f-5175-47e3-a0e0-0328b011359c" containerName="console" probeResult="failure" output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" Jun 09 11:08:25.431085 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:25.431055 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:26.507222 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:26.507189 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:26.747704 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:26.747680 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tfxhn" Jun 09 11:08:27.863510 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:27.863469 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:28.161489 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.161405 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:28.215925 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.215895 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx"] Jun 09 11:08:28.218749 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.218734 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.222774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.222746 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 11:08:28.222774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.222774 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 11:08:28.222965 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.222747 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 11:08:28.222965 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.222746 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 11:08:28.222965 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.222777 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 11:08:28.222965 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.222747 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-69pg9\"" Jun 09 11:08:28.231703 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.231681 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx"] Jun 09 11:08:28.242395 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.242373 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd"] Jun 09 11:08:28.244536 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.244521 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.247189 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.247174 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6nmbj\"" Jun 09 11:08:28.247255 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.247204 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 11:08:28.247741 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.247725 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 11:08:28.247849 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.247835 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 11:08:28.256033 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.256008 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fnk7k"] Jun 09 11:08:28.258665 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.258645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd"] Jun 09 11:08:28.258752 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.258744 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.261186 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.261165 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 11:08:28.261289 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.261183 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 11:08:28.261490 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.261472 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z8srh\"" Jun 09 11:08:28.261635 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.261612 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 11:08:28.267921 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.267898 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:28.339260 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.339222 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:28.343227 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4384b8d3-6af8-4da2-bd40-e266e46787e0-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.343323 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-textfile\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.343323 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlstk\" (UniqueName: \"kubernetes.io/projected/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-api-access-jlstk\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.343323 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.343472 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343340 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4384b8d3-6af8-4da2-bd40-e266e46787e0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.343472 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e04d5d70-0394-4895-81fe-c1e71f84d804-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.343472 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5c4ed4-b890-4334-b6fd-087944f5eaba-metrics-client-ca\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.343590 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343491 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.343590 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04d5d70-0394-4895-81fe-c1e71f84d804-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.343590 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343523 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.343590 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.343725 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab5c4ed4-b890-4334-b6fd-087944f5eaba-sys\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.343725 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt4wl\" (UniqueName: \"kubernetes.io/projected/ab5c4ed4-b890-4334-b6fd-087944f5eaba-kube-api-access-bt4wl\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.343725 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343651 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab5c4ed4-b890-4334-b6fd-087944f5eaba-root\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.343725 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4384b8d3-6af8-4da2-bd40-e266e46787e0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.343725 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343702 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.343914 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rspr6\" (UniqueName: \"kubernetes.io/projected/4384b8d3-6af8-4da2-bd40-e266e46787e0-kube-api-access-rspr6\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.343914 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343760 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-tls\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.343914 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.343789 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-wtmp\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.438074 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.437980 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:28.445015 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.444976 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab5c4ed4-b890-4334-b6fd-087944f5eaba-sys\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445124 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445022 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt4wl\" (UniqueName: \"kubernetes.io/projected/ab5c4ed4-b890-4334-b6fd-087944f5eaba-kube-api-access-bt4wl\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445124 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445055 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab5c4ed4-b890-4334-b6fd-087944f5eaba-root\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445124 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4384b8d3-6af8-4da2-bd40-e266e46787e0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.445124 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445083 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab5c4ed4-b890-4334-b6fd-087944f5eaba-sys\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445124 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445124 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445124 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rspr6\" (UniqueName: \"kubernetes.io/projected/4384b8d3-6af8-4da2-bd40-e266e46787e0-kube-api-access-rspr6\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.445414 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-tls\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445414 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445163 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab5c4ed4-b890-4334-b6fd-087944f5eaba-root\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445414 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445185 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-wtmp\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445414 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:28.445295 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 11:08:28.445414 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445321 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-wtmp\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445414 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445348 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4384b8d3-6af8-4da2-bd40-e266e46787e0-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.445414 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:28.445369 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-tls podName:ab5c4ed4-b890-4334-b6fd-087944f5eaba nodeName:}" failed. No retries permitted until 2026-06-09 11:08:28.945349023 +0000 UTC m=+64.853734330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-tls") pod "node-exporter-fnk7k" (UID: "ab5c4ed4-b890-4334-b6fd-087944f5eaba") : secret "node-exporter-tls" not found Jun 09 11:08:28.445414 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445406 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-textfile\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445822 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445435 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlstk\" (UniqueName: \"kubernetes.io/projected/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-api-access-jlstk\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.445822 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445467 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445822 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4384b8d3-6af8-4da2-bd40-e266e46787e0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.445822 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445538 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e04d5d70-0394-4895-81fe-c1e71f84d804-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.445822 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445762 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.445822 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445762 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-textfile\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.446145 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5c4ed4-b890-4334-b6fd-087944f5eaba-metrics-client-ca\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.446145 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445908 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.446145 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445933 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e04d5d70-0394-4895-81fe-c1e71f84d804-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.446145 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445939 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04d5d70-0394-4895-81fe-c1e71f84d804-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.446145 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.445968 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.446395 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.446160 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4384b8d3-6af8-4da2-bd40-e266e46787e0-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.446395 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.446211 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.446505 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.446445 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5c4ed4-b890-4334-b6fd-087944f5eaba-metrics-client-ca\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.446610 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.446591 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.446931 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.446909 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04d5d70-0394-4895-81fe-c1e71f84d804-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.448013 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.447991 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4384b8d3-6af8-4da2-bd40-e266e46787e0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.448154 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.448138 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.448945 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.448925 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4384b8d3-6af8-4da2-bd40-e266e46787e0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.449048 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.449032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.449091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.449041 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.455706 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.455680 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rspr6\" (UniqueName: \"kubernetes.io/projected/4384b8d3-6af8-4da2-bd40-e266e46787e0-kube-api-access-rspr6\") pod \"openshift-state-metrics-65f78d5c66-zsmcx\" (UID: \"4384b8d3-6af8-4da2-bd40-e266e46787e0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.455821 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.455810 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt4wl\" (UniqueName: \"kubernetes.io/projected/ab5c4ed4-b890-4334-b6fd-087944f5eaba-kube-api-access-bt4wl\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.456132 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.456109 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlstk\" (UniqueName: \"kubernetes.io/projected/e04d5d70-0394-4895-81fe-c1e71f84d804-kube-api-access-jlstk\") pod \"kube-state-metrics-57bbf8bfb5-67qpd\" (UID: \"e04d5d70-0394-4895-81fe-c1e71f84d804\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.520795 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.520760 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:28.527524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.527495 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" Jun 09 11:08:28.553261 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.553238 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" Jun 09 11:08:28.666458 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.666430 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx"] Jun 09 11:08:28.668724 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:28.668691 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4384b8d3_6af8_4da2_bd40_e266e46787e0.slice/crio-18cccaba050cc3e4ec451a7149301c70c660d50f86b6f64c7d9a1b98ea61d082 WatchSource:0}: Error finding container 18cccaba050cc3e4ec451a7149301c70c660d50f86b6f64c7d9a1b98ea61d082: Status 404 returned error can't find the container with id 18cccaba050cc3e4ec451a7149301c70c660d50f86b6f64c7d9a1b98ea61d082 Jun 09 11:08:28.685955 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.685936 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:28.686044 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.685987 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:08:28.690485 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.687918 2558 patch_prober.go:28] interesting pod/console-7b7d8d7fbf-zww7r container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.12:8443/health\": dial tcp 10.133.0.12:8443: connect: connection refused" start-of-body= Jun 09 11:08:28.690485 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.687967 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b7d8d7fbf-zww7r" podUID="fe4ecc69-14d0-44a6-8e16-492de60d9f53" containerName="console" probeResult="failure" output="Get \"https://10.133.0.12:8443/health\": dial tcp 10.133.0.12:8443: connect: connection refused" Jun 09 11:08:28.695669 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.695646 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd"] Jun 09 11:08:28.698840 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:28.698817 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04d5d70_0394_4895_81fe_c1e71f84d804.slice/crio-0f27bb5d20dbae366a7a253a3925588f858b99446eb3bcfc315b7c1e63aacaa2 WatchSource:0}: Error finding container 0f27bb5d20dbae366a7a253a3925588f858b99446eb3bcfc315b7c1e63aacaa2: Status 404 returned error can't find the container with id 0f27bb5d20dbae366a7a253a3925588f858b99446eb3bcfc315b7c1e63aacaa2 Jun 09 11:08:28.705582 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.705548 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:28.771786 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.771439 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" event={"ID":"4384b8d3-6af8-4da2-bd40-e266e46787e0","Type":"ContainerStarted","Data":"7c7a796c2d8b85dd2118fd788d1b94ca058a10e725fc2ee95596e4f80efadb9a"} Jun 09 11:08:28.771786 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.771506 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" event={"ID":"4384b8d3-6af8-4da2-bd40-e266e46787e0","Type":"ContainerStarted","Data":"18cccaba050cc3e4ec451a7149301c70c660d50f86b6f64c7d9a1b98ea61d082"} Jun 09 11:08:28.773455 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.773435 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" event={"ID":"e04d5d70-0394-4895-81fe-c1e71f84d804","Type":"ContainerStarted","Data":"0f27bb5d20dbae366a7a253a3925588f858b99446eb3bcfc315b7c1e63aacaa2"} Jun 09 11:08:28.897544 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.897512 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:28.950744 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.950678 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-tls\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:28.952826 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:28.952808 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab5c4ed4-b890-4334-b6fd-087944f5eaba-node-exporter-tls\") pod \"node-exporter-fnk7k\" (UID: \"ab5c4ed4-b890-4334-b6fd-087944f5eaba\") " pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:29.124942 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:29.124906 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:29.168978 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:29.168943 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnk7k" Jun 09 11:08:29.179075 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:29.179044 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5c4ed4_b890_4334_b6fd_087944f5eaba.slice/crio-06b21071a89669177f7762e148892f28c518d323ba5ba35c2ff7e1939ec9ef9e WatchSource:0}: Error finding container 06b21071a89669177f7762e148892f28c518d323ba5ba35c2ff7e1939ec9ef9e: Status 404 returned error can't find the container with id 06b21071a89669177f7762e148892f28c518d323ba5ba35c2ff7e1939ec9ef9e Jun 09 11:08:29.212224 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:29.212145 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:29.567774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:29.567688 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:29.779911 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:29.779857 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" event={"ID":"4384b8d3-6af8-4da2-bd40-e266e46787e0","Type":"ContainerStarted","Data":"6852e39efd088add437e31fdf46fa3b450c0d1652fb20ef0b0d9e6d056b35c92"} Jun 09 11:08:29.781213 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:29.781180 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnk7k" event={"ID":"ab5c4ed4-b890-4334-b6fd-087944f5eaba","Type":"ContainerStarted","Data":"06b21071a89669177f7762e148892f28c518d323ba5ba35c2ff7e1939ec9ef9e"} Jun 09 11:08:30.263759 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.263720 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:30.264241 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.263804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:30.266782 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.266761 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:08:30.267737 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.267720 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:08:30.277397 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.277374 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d35dc75d-89f4-405b-8e36-b479b12f9687-original-pull-secret\") pod \"global-pull-secret-syncer-565cd\" (UID: \"d35dc75d-89f4-405b-8e36-b479b12f9687\") " pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:30.277515 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.277438 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e0a06bb-e1b3-42c5-be16-57d0a40b8990-metrics-certs\") pod \"network-metrics-daemon-kb4nv\" (UID: \"1e0a06bb-e1b3-42c5-be16-57d0a40b8990\") " pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:30.453525 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.453498 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-565cd" Jun 09 11:08:30.464614 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.464592 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-464pd\"" Jun 09 11:08:30.464819 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.464799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc77z\" (UniqueName: \"kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z\") pod \"network-check-target-tnz62\" (UID: \"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65\") " pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:30.467152 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.467134 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:08:30.472250 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.472228 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb4nv" Jun 09 11:08:30.478176 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.478156 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:08:30.487967 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.487937 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc77z\" (UniqueName: \"kubernetes.io/projected/5fb47958-5ed9-4a06-8ce5-d1962f5aeb65-kube-api-access-tc77z\") pod \"network-check-target-tnz62\" (UID: \"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65\") " pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:30.613812 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.613688 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-565cd"] Jun 09 11:08:30.616401 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:30.616364 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35dc75d_89f4_405b_8e36_b479b12f9687.slice/crio-0cad68d08cdf720304b1cab7bfeb49087bcd5655b1f3bdd5bd16f32f5b3985cd WatchSource:0}: Error finding container 0cad68d08cdf720304b1cab7bfeb49087bcd5655b1f3bdd5bd16f32f5b3985cd: Status 404 returned error can't find the container with id 0cad68d08cdf720304b1cab7bfeb49087bcd5655b1f3bdd5bd16f32f5b3985cd Jun 09 11:08:30.648311 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.647142 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kb4nv"] Jun 09 11:08:30.652413 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:30.652382 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0a06bb_e1b3_42c5_be16_57d0a40b8990.slice/crio-bace95ef3689657b2a07e495fa1d0778d21a55209830b9922d35681d1e05018d WatchSource:0}: Error finding container bace95ef3689657b2a07e495fa1d0778d21a55209830b9922d35681d1e05018d: Status 404 returned error can't find the container with id bace95ef3689657b2a07e495fa1d0778d21a55209830b9922d35681d1e05018d Jun 09 11:08:30.741412 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.741392 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ft8nx\"" Jun 09 11:08:30.749178 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.749142 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:30.790114 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.790037 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kb4nv" event={"ID":"1e0a06bb-e1b3-42c5-be16-57d0a40b8990","Type":"ContainerStarted","Data":"bace95ef3689657b2a07e495fa1d0778d21a55209830b9922d35681d1e05018d"} Jun 09 11:08:30.791020 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.790996 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-565cd" event={"ID":"d35dc75d-89f4-405b-8e36-b479b12f9687","Type":"ContainerStarted","Data":"0cad68d08cdf720304b1cab7bfeb49087bcd5655b1f3bdd5bd16f32f5b3985cd"} Jun 09 11:08:30.793142 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.793122 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" event={"ID":"4384b8d3-6af8-4da2-bd40-e266e46787e0","Type":"ContainerStarted","Data":"0b2df9d07481e1aa9f9bdc02b03b4ee65708409796792d28542f90291d8bd7cd"} Jun 09 11:08:30.794957 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.794932 2558 generic.go:356] "Generic (PLEG): container finished" podID="ab5c4ed4-b890-4334-b6fd-087944f5eaba" containerID="0d96d0a74c39a188815827ed326d12f5da9782710c34b2743a3ad5311f54de92" exitCode=0 Jun 09 11:08:30.795078 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.795011 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnk7k" event={"ID":"ab5c4ed4-b890-4334-b6fd-087944f5eaba","Type":"ContainerDied","Data":"0d96d0a74c39a188815827ed326d12f5da9782710c34b2743a3ad5311f54de92"} Jun 09 11:08:30.798278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.798247 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" event={"ID":"e04d5d70-0394-4895-81fe-c1e71f84d804","Type":"ContainerStarted","Data":"cbc5b64e2b6f965b24c89cfb9939c3ad8880b440d548b0f3b7ca47c2ac8c1ca9"} Jun 09 11:08:30.798381 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.798296 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" event={"ID":"e04d5d70-0394-4895-81fe-c1e71f84d804","Type":"ContainerStarted","Data":"bf0fa237941f83efe4e83f4ea3666309fc2281b32348e5dbba519c89a1d038e4"} Jun 09 11:08:30.798381 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.798324 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" event={"ID":"e04d5d70-0394-4895-81fe-c1e71f84d804","Type":"ContainerStarted","Data":"94b0870c0820dfaa2ab23220ebc5c55d27099d49686ed56723f390664db65c9e"} Jun 09 11:08:30.813165 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.813102 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zsmcx" podStartSLOduration=1.159452651 podStartE2EDuration="2.813081067s" totalImagesPullingTime="1.653628416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:30.811038283 +0000 UTC m=+66.719423613" watchObservedRunningTime="2026-06-09 11:08:30.813081067 +0000 UTC m=+66.721466394" Jun 09 11:08:30.834024 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.833534 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-67qpd" podStartSLOduration=1.097517159 podStartE2EDuration="2.833512443s" totalImagesPullingTime="1.735995284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:30.832608705 +0000 UTC m=+66.740994032" watchObservedRunningTime="2026-06-09 11:08:30.833512443 +0000 UTC m=+66.741897772" Jun 09 11:08:30.921087 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:30.921061 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tnz62"] Jun 09 11:08:30.925067 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:30.924966 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb47958_5ed9_4a06_8ce5_d1962f5aeb65.slice/crio-a849a86c75d397de95e9f5816f0640f5df82a3722e97edfa65d6fe1115d8b5b7 WatchSource:0}: Error finding container a849a86c75d397de95e9f5816f0640f5df82a3722e97edfa65d6fe1115d8b5b7: Status 404 returned error can't find the container with id a849a86c75d397de95e9f5816f0640f5df82a3722e97edfa65d6fe1115d8b5b7 Jun 09 11:08:31.070290 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:31.070192 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:31.139034 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:31.138994 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:31.432322 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:31.432242 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:31.544477 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:31.544439 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:31.806940 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:31.806840 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnk7k" event={"ID":"ab5c4ed4-b890-4334-b6fd-087944f5eaba","Type":"ContainerStarted","Data":"ca5d179f9566e7b0d678b0d57ed93da665b582efb728fdda83297385996d51d7"} Jun 09 11:08:31.806940 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:31.806922 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnk7k" event={"ID":"ab5c4ed4-b890-4334-b6fd-087944f5eaba","Type":"ContainerStarted","Data":"c455e558c5cb140011f892a2f9a588331c2e6892f57d1a5f6a13761dd95e9a4f"} Jun 09 11:08:31.808697 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:31.808671 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tnz62" event={"ID":"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65","Type":"ContainerStarted","Data":"a849a86c75d397de95e9f5816f0640f5df82a3722e97edfa65d6fe1115d8b5b7"} Jun 09 11:08:31.831470 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:31.831405 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fnk7k" podStartSLOduration=2.475800103 podStartE2EDuration="3.831382285s" totalImagesPullingTime="1.253437543s" totalInitContainerRuntime="102.144639ms" isStatefulPod=true podCreationTimestamp="2026-06-09 11:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:31.829303634 +0000 UTC m=+67.737688962" watchObservedRunningTime="2026-06-09 11:08:31.831382285 +0000 UTC m=+67.739767612" Jun 09 11:08:32.815438 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:32.815331 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kb4nv" event={"ID":"1e0a06bb-e1b3-42c5-be16-57d0a40b8990","Type":"ContainerStarted","Data":"3c7fe2e0b862debba2022420f3ef707ba9acaa96a2cd76cde9509af2d81b933f"} Jun 09 11:08:32.815438 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:32.815389 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kb4nv" event={"ID":"1e0a06bb-e1b3-42c5-be16-57d0a40b8990","Type":"ContainerStarted","Data":"00d1569f1663ea7ed4e3970957c24b380a24208cda1e6631b163c9db7ec45158"} Jun 09 11:08:32.837348 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:32.837279 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kb4nv" podStartSLOduration=67.610617579 podStartE2EDuration="1m8.837254314s" totalImagesPullingTime="1.226636735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:32.836303787 +0000 UTC m=+68.744689114" watchObservedRunningTime="2026-06-09 11:08:32.837254314 +0000 UTC m=+68.745639644" Jun 09 11:08:32.981242 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:32.981198 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:33.091974 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:33.091813 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:33.160939 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:33.160857 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:33.911404 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:33.911361 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664647f7bf-mrbxs"] Jun 09 11:08:33.940564 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:33.939917 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7759fbf58c-s2jq5"] Jun 09 11:08:33.943153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:33.943127 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:33.958444 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:33.958409 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7759fbf58c-s2jq5"] Jun 09 11:08:34.102249 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.102212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-oauth-config\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.102448 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.102257 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v5j8\" (UniqueName: \"kubernetes.io/projected/636722a9-a340-4244-a4aa-d1ea930b28d3-kube-api-access-4v5j8\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.102448 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.102293 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-service-ca\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.102448 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.102367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-oauth-serving-cert\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.102448 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.102410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-serving-cert\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.102448 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.102442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-console-config\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.102690 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.102468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-trusted-ca-bundle\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.203048 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.203009 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-oauth-config\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.203048 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.203052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v5j8\" (UniqueName: \"kubernetes.io/projected/636722a9-a340-4244-a4aa-d1ea930b28d3-kube-api-access-4v5j8\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.203289 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.203121 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-service-ca\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.203289 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.203150 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-oauth-serving-cert\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.203289 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.203178 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-serving-cert\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.203289 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.203208 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-console-config\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.203289 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.203228 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-trusted-ca-bundle\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.204032 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.204003 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-service-ca\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.204032 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.204026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-oauth-serving-cert\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.204462 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.204438 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-console-config\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.204739 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.204718 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-trusted-ca-bundle\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.205931 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.205907 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-oauth-config\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.206024 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.205997 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-serving-cert\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.212545 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.212524 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v5j8\" (UniqueName: \"kubernetes.io/projected/636722a9-a340-4244-a4aa-d1ea930b28d3-kube-api-access-4v5j8\") pod \"console-7759fbf58c-s2jq5\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.252974 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.252945 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:34.330367 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.330327 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:34.365676 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.365639 2558 patch_prober.go:28] interesting pod/image-registry-866bc55cb7-8nfch container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:08:34.365842 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.365709 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" podUID="af85f2f8-f1f8-4d8e-8911-0569da059f64" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:08:34.774344 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.774311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:34.873891 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:34.873837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:35.831053 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:35.831023 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-565cd" event={"ID":"d35dc75d-89f4-405b-8e36-b479b12f9687","Type":"ContainerStarted","Data":"72926fb8f6ac5d5f27eb45d527c352ff2d7328294152db6ee9349b8c7835f2f3"} Jun 09 11:08:35.833443 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:35.833409 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tnz62" event={"ID":"5fb47958-5ed9-4a06-8ce5-d1962f5aeb65","Type":"ContainerStarted","Data":"116c44de0f27638e6a194e834b3028e0ce5a9f14dd7c3d8c8a99119932f7954d"} Jun 09 11:08:35.833570 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:35.833477 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:08:35.848694 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:35.848616 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-565cd" podStartSLOduration=66.746826345 podStartE2EDuration="1m11.848600738s" totalImagesPullingTime="5.101774393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:35.847581977 +0000 UTC m=+71.755967332" watchObservedRunningTime="2026-06-09 11:08:35.848600738 +0000 UTC m=+71.756986063" Jun 09 11:08:35.855689 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:35.855661 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7759fbf58c-s2jq5"] Jun 09 11:08:35.860477 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:35.860436 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636722a9_a340_4244_a4aa_d1ea930b28d3.slice/crio-b9ac9781afac05e4567839915ea586f5f5551e7ccebe7b0a057231a8639cc084 WatchSource:0}: Error finding container b9ac9781afac05e4567839915ea586f5f5551e7ccebe7b0a057231a8639cc084: Status 404 returned error can't find the container with id b9ac9781afac05e4567839915ea586f5f5551e7ccebe7b0a057231a8639cc084 Jun 09 11:08:35.867923 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:35.867855 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tnz62" podStartSLOduration=67.070801506 podStartE2EDuration="1m11.867838014s" totalImagesPullingTime="4.797036508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:35.866610101 +0000 UTC m=+71.774995463" watchObservedRunningTime="2026-06-09 11:08:35.867838014 +0000 UTC m=+71.776223340" Jun 09 11:08:35.879251 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:35.879213 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:35.959449 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:35.959411 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:36.723062 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:36.723034 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-866bc55cb7-8nfch" Jun 09 11:08:36.838739 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:36.838698 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759fbf58c-s2jq5" event={"ID":"636722a9-a340-4244-a4aa-d1ea930b28d3","Type":"ContainerStarted","Data":"43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9"} Jun 09 11:08:36.839219 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:36.838746 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759fbf58c-s2jq5" event={"ID":"636722a9-a340-4244-a4aa-d1ea930b28d3","Type":"ContainerStarted","Data":"b9ac9781afac05e4567839915ea586f5f5551e7ccebe7b0a057231a8639cc084"} Jun 09 11:08:36.853920 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:36.853865 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:36.876954 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:36.876901 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7759fbf58c-s2jq5" podStartSLOduration=3.876862172 podStartE2EDuration="3.876862172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:36.875738873 +0000 UTC m=+72.784124198" watchObservedRunningTime="2026-06-09 11:08:36.876862172 +0000 UTC m=+72.785247498" Jun 09 11:08:36.915080 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:36.915040 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:36.976543 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:36.976465 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:37.906092 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:37.906058 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b7d8d7fbf-zww7r"] Jun 09 11:08:37.943943 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:37.943916 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-798fb68676-rtm9s"] Jun 09 11:08:37.947074 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:37.947060 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:37.957308 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:37.957288 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798fb68676-rtm9s"] Jun 09 11:08:38.031759 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.031734 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-config\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.031759 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.031764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-service-ca\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.031945 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.031782 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-trusted-ca-bundle\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.031945 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.031798 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqqw4\" (UniqueName: \"kubernetes.io/projected/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-kube-api-access-lqqw4\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.031945 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.031843 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-serving-cert\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.031945 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.031911 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-oauth-config\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.032068 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.031952 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-oauth-serving-cert\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.133028 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.132996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-oauth-config\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.133113 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.133042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-oauth-serving-cert\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.133113 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.133080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-config\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.133113 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.133097 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-service-ca\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.133231 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.133113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-trusted-ca-bundle\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.133231 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.133129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqqw4\" (UniqueName: \"kubernetes.io/projected/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-kube-api-access-lqqw4\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.133231 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.133151 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-serving-cert\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.133951 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.133926 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-service-ca\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.134087 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.133926 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-oauth-serving-cert\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.134087 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.133984 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-config\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.134351 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.134328 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-trusted-ca-bundle\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.135471 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.135444 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-serving-cert\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.135564 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.135533 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-oauth-config\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.141636 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.141618 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqqw4\" (UniqueName: \"kubernetes.io/projected/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-kube-api-access-lqqw4\") pod \"console-798fb68676-rtm9s\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.255791 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.255766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:38.378931 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.378898 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798fb68676-rtm9s"] Jun 09 11:08:38.381008 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:08:38.380983 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba47a107_f0c0_41a9_ab79_88a9385c2d9f.slice/crio-f6d9532cbbedcf98e0143f0358ea1cea40a83c29fdb643f0233244f556ab1116 WatchSource:0}: Error finding container f6d9532cbbedcf98e0143f0358ea1cea40a83c29fdb643f0233244f556ab1116: Status 404 returned error can't find the container with id f6d9532cbbedcf98e0143f0358ea1cea40a83c29fdb643f0233244f556ab1116 Jun 09 11:08:38.849069 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.849035 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798fb68676-rtm9s" event={"ID":"ba47a107-f0c0-41a9-ab79-88a9385c2d9f","Type":"ContainerStarted","Data":"410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a"} Jun 09 11:08:38.849230 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.849109 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798fb68676-rtm9s" event={"ID":"ba47a107-f0c0-41a9-ab79-88a9385c2d9f","Type":"ContainerStarted","Data":"f6d9532cbbedcf98e0143f0358ea1cea40a83c29fdb643f0233244f556ab1116"} Jun 09 11:08:38.870119 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:38.870073 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-798fb68676-rtm9s" podStartSLOduration=1.870058979 podStartE2EDuration="1.870058979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:38.869631848 +0000 UTC m=+74.778017188" watchObservedRunningTime="2026-06-09 11:08:38.870058979 +0000 UTC m=+74.778444304" Jun 09 11:08:40.005948 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:40.005907 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:40.106697 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:40.106663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:40.167645 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:40.167604 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:40.933499 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:40.933470 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:41.005805 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:41.005780 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:41.065877 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:41.065852 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:43.169317 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:43.169189 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:43.283350 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:43.283311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:44.253339 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:44.253296 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:44.253726 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:44.253385 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:44.257748 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:44.257729 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:44.872858 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:44.872829 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:08:44.962927 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:44.962898 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:45.095608 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:45.095580 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:45.197355 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:45.197329 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:47.864749 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:47.864702 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:47.961964 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:47.961934 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:48.255881 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:48.255852 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:48.256047 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:48.255965 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:48.260715 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:48.260693 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:48.569269 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:48.569188 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:48.670526 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:48.670494 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:48.886517 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:48.886454 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:08:48.936074 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:48.936047 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7759fbf58c-s2jq5"] Jun 09 11:08:49.054723 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:49.054688 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:49.155302 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:49.155229 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:49.256913 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:49.256864 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:49.324544 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:49.324517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:50.067591 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:50.067555 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:50.171794 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:50.171766 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:58.938278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:58.938223 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-664647f7bf-mrbxs" podUID="292e442f-5175-47e3-a0e0-0328b011359c" containerName="console" containerID="cri-o://c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3" gracePeriod=15 Jun 09 11:08:59.171683 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.171661 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:59.191359 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.191333 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-oauth-serving-cert\") pod \"292e442f-5175-47e3-a0e0-0328b011359c\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " Jun 09 11:08:59.191510 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.191375 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-serving-cert\") pod \"292e442f-5175-47e3-a0e0-0328b011359c\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " Jun 09 11:08:59.191510 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.191392 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-service-ca\") pod \"292e442f-5175-47e3-a0e0-0328b011359c\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " Jun 09 11:08:59.191510 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.191433 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-oauth-config\") pod \"292e442f-5175-47e3-a0e0-0328b011359c\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " Jun 09 11:08:59.191510 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.191459 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-console-config\") pod \"292e442f-5175-47e3-a0e0-0328b011359c\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " Jun 09 11:08:59.191510 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.191498 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cqbh\" (UniqueName: \"kubernetes.io/projected/292e442f-5175-47e3-a0e0-0328b011359c-kube-api-access-5cqbh\") pod \"292e442f-5175-47e3-a0e0-0328b011359c\" (UID: \"292e442f-5175-47e3-a0e0-0328b011359c\") " Jun 09 11:08:59.191831 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.191808 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "292e442f-5175-47e3-a0e0-0328b011359c" (UID: "292e442f-5175-47e3-a0e0-0328b011359c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:08:59.191920 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.191839 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-service-ca" (OuterVolumeSpecName: "service-ca") pod "292e442f-5175-47e3-a0e0-0328b011359c" (UID: "292e442f-5175-47e3-a0e0-0328b011359c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:08:59.191920 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.191848 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-console-config" (OuterVolumeSpecName: "console-config") pod "292e442f-5175-47e3-a0e0-0328b011359c" (UID: "292e442f-5175-47e3-a0e0-0328b011359c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:08:59.194105 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.194053 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "292e442f-5175-47e3-a0e0-0328b011359c" (UID: "292e442f-5175-47e3-a0e0-0328b011359c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:08:59.194231 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.194194 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "292e442f-5175-47e3-a0e0-0328b011359c" (UID: "292e442f-5175-47e3-a0e0-0328b011359c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:08:59.194403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.194373 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292e442f-5175-47e3-a0e0-0328b011359c-kube-api-access-5cqbh" (OuterVolumeSpecName: "kube-api-access-5cqbh") pod "292e442f-5175-47e3-a0e0-0328b011359c" (UID: "292e442f-5175-47e3-a0e0-0328b011359c"). InnerVolumeSpecName "kube-api-access-5cqbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:08:59.292125 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.292086 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cqbh\" (UniqueName: \"kubernetes.io/projected/292e442f-5175-47e3-a0e0-0328b011359c-kube-api-access-5cqbh\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:08:59.292125 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.292120 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-oauth-serving-cert\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:08:59.292125 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.292133 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-serving-cert\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:08:59.292359 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.292146 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-service-ca\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:08:59.292359 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.292160 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/292e442f-5175-47e3-a0e0-0328b011359c-console-oauth-config\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:08:59.292359 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.292173 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/292e442f-5175-47e3-a0e0-0328b011359c-console-config\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:08:59.923504 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.923469 2558 generic.go:356] "Generic (PLEG): container finished" podID="292e442f-5175-47e3-a0e0-0328b011359c" containerID="c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3" exitCode=0 Jun 09 11:08:59.923667 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.923512 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664647f7bf-mrbxs" Jun 09 11:08:59.923667 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.923560 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664647f7bf-mrbxs" event={"ID":"292e442f-5175-47e3-a0e0-0328b011359c","Type":"ContainerDied","Data":"c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3"} Jun 09 11:08:59.923667 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.923609 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664647f7bf-mrbxs" event={"ID":"292e442f-5175-47e3-a0e0-0328b011359c","Type":"ContainerDied","Data":"9dc5801940415c951ff9edcd8da370f8e70878366a26659f079d40aeafa7476a"} Jun 09 11:08:59.923667 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.923634 2558 scope.go:117] "RemoveContainer" containerID="c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3" Jun 09 11:08:59.932642 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.932627 2558 scope.go:117] "RemoveContainer" containerID="c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3" Jun 09 11:08:59.932917 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:08:59.932898 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3\": container with ID starting with c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3 not found: ID does not exist" containerID="c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3" Jun 09 11:08:59.932977 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.932926 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3"} err="failed to get container status \"c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3\": rpc error: code = NotFound desc = could not find container \"c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3\": container with ID starting with c7170dfb3f9aa3a370948b512b68097e6f4ae602d255c79c7114a2cc5abbcbd3 not found: ID does not exist" Jun 09 11:08:59.947361 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.947338 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664647f7bf-mrbxs"] Jun 09 11:08:59.949398 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:08:59.949378 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-664647f7bf-mrbxs"] Jun 09 11:09:00.490766 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:00.490734 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292e442f-5175-47e3-a0e0-0328b011359c" path="/var/lib/kubelet/pods/292e442f-5175-47e3-a0e0-0328b011359c/volumes" Jun 09 11:09:02.924844 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:02.924723 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b7d8d7fbf-zww7r" podUID="fe4ecc69-14d0-44a6-8e16-492de60d9f53" containerName="console" containerID="cri-o://d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612" gracePeriod=15 Jun 09 11:09:03.166507 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.166480 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:09:03.223331 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223306 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b68b9\" (UniqueName: \"kubernetes.io/projected/fe4ecc69-14d0-44a6-8e16-492de60d9f53-kube-api-access-b68b9\") pod \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " Jun 09 11:09:03.223509 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223343 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-service-ca\") pod \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " Jun 09 11:09:03.223509 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223389 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-oauth-serving-cert\") pod \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " Jun 09 11:09:03.223509 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223430 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-oauth-config\") pod \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " Jun 09 11:09:03.223509 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223463 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-config\") pod \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " Jun 09 11:09:03.223509 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223492 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-trusted-ca-bundle\") pod \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " Jun 09 11:09:03.223768 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223524 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-serving-cert\") pod \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\" (UID: \"fe4ecc69-14d0-44a6-8e16-492de60d9f53\") " Jun 09 11:09:03.224000 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223959 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-service-ca" (OuterVolumeSpecName: "service-ca") pod "fe4ecc69-14d0-44a6-8e16-492de60d9f53" (UID: "fe4ecc69-14d0-44a6-8e16-492de60d9f53"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:09:03.224000 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223975 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fe4ecc69-14d0-44a6-8e16-492de60d9f53" (UID: "fe4ecc69-14d0-44a6-8e16-492de60d9f53"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:09:03.224000 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223987 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-config" (OuterVolumeSpecName: "console-config") pod "fe4ecc69-14d0-44a6-8e16-492de60d9f53" (UID: "fe4ecc69-14d0-44a6-8e16-492de60d9f53"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:09:03.224163 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.223997 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fe4ecc69-14d0-44a6-8e16-492de60d9f53" (UID: "fe4ecc69-14d0-44a6-8e16-492de60d9f53"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:09:03.225636 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.225607 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fe4ecc69-14d0-44a6-8e16-492de60d9f53" (UID: "fe4ecc69-14d0-44a6-8e16-492de60d9f53"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:09:03.225731 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.225659 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fe4ecc69-14d0-44a6-8e16-492de60d9f53" (UID: "fe4ecc69-14d0-44a6-8e16-492de60d9f53"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:09:03.225731 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.225656 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4ecc69-14d0-44a6-8e16-492de60d9f53-kube-api-access-b68b9" (OuterVolumeSpecName: "kube-api-access-b68b9") pod "fe4ecc69-14d0-44a6-8e16-492de60d9f53" (UID: "fe4ecc69-14d0-44a6-8e16-492de60d9f53"). InnerVolumeSpecName "kube-api-access-b68b9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:09:03.324794 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.324758 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b68b9\" (UniqueName: \"kubernetes.io/projected/fe4ecc69-14d0-44a6-8e16-492de60d9f53-kube-api-access-b68b9\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:03.324794 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.324787 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-service-ca\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:03.324794 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.324796 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-oauth-serving-cert\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:03.325043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.324805 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-oauth-config\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:03.325043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.324813 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-config\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:03.325043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.324821 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4ecc69-14d0-44a6-8e16-492de60d9f53-trusted-ca-bundle\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:03.325043 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.324829 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4ecc69-14d0-44a6-8e16-492de60d9f53-console-serving-cert\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:03.940705 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.940666 2558 generic.go:356] "Generic (PLEG): container finished" podID="fe4ecc69-14d0-44a6-8e16-492de60d9f53" containerID="d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612" exitCode=0 Jun 09 11:09:03.941128 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.940714 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7d8d7fbf-zww7r" Jun 09 11:09:03.941128 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.940747 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7d8d7fbf-zww7r" event={"ID":"fe4ecc69-14d0-44a6-8e16-492de60d9f53","Type":"ContainerDied","Data":"d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612"} Jun 09 11:09:03.941128 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.940802 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7d8d7fbf-zww7r" event={"ID":"fe4ecc69-14d0-44a6-8e16-492de60d9f53","Type":"ContainerDied","Data":"a48d384242b1f08161a7cf8521e1203dff81e78a8d0067d19d6606bd2a1dbc85"} Jun 09 11:09:03.941128 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.940821 2558 scope.go:117] "RemoveContainer" containerID="d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612" Jun 09 11:09:03.948933 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.948918 2558 scope.go:117] "RemoveContainer" containerID="d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612" Jun 09 11:09:03.949203 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:09:03.949187 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612\": container with ID starting with d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612 not found: ID does not exist" containerID="d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612" Jun 09 11:09:03.949262 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.949212 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612"} err="failed to get container status \"d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612\": rpc error: code = NotFound desc = could not find container \"d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612\": container with ID starting with d4c4319c9edba35d37fc9642c01b8962b723faaf203cb2d5463de8f521fe5612 not found: ID does not exist" Jun 09 11:09:03.963813 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.963790 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b7d8d7fbf-zww7r"] Jun 09 11:09:03.975676 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:03.975656 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b7d8d7fbf-zww7r"] Jun 09 11:09:04.490948 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:04.490916 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe4ecc69-14d0-44a6-8e16-492de60d9f53" path="/var/lib/kubelet/pods/fe4ecc69-14d0-44a6-8e16-492de60d9f53/volumes" Jun 09 11:09:06.841567 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:06.841532 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tnz62" Jun 09 11:09:13.956144 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:13.956081 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7759fbf58c-s2jq5" podUID="636722a9-a340-4244-a4aa-d1ea930b28d3" containerName="console" containerID="cri-o://43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9" gracePeriod=15 Jun 09 11:09:14.198105 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.198083 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:09:14.300631 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.300555 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-console-config\") pod \"636722a9-a340-4244-a4aa-d1ea930b28d3\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " Jun 09 11:09:14.300631 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.300621 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-serving-cert\") pod \"636722a9-a340-4244-a4aa-d1ea930b28d3\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " Jun 09 11:09:14.300831 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.300661 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-oauth-config\") pod \"636722a9-a340-4244-a4aa-d1ea930b28d3\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " Jun 09 11:09:14.300831 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.300679 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-service-ca\") pod \"636722a9-a340-4244-a4aa-d1ea930b28d3\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " Jun 09 11:09:14.300831 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.300706 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-oauth-serving-cert\") pod \"636722a9-a340-4244-a4aa-d1ea930b28d3\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " Jun 09 11:09:14.300831 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.300736 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v5j8\" (UniqueName: \"kubernetes.io/projected/636722a9-a340-4244-a4aa-d1ea930b28d3-kube-api-access-4v5j8\") pod \"636722a9-a340-4244-a4aa-d1ea930b28d3\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " Jun 09 11:09:14.300831 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.300766 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-trusted-ca-bundle\") pod \"636722a9-a340-4244-a4aa-d1ea930b28d3\" (UID: \"636722a9-a340-4244-a4aa-d1ea930b28d3\") " Jun 09 11:09:14.301060 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.301036 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-console-config" (OuterVolumeSpecName: "console-config") pod "636722a9-a340-4244-a4aa-d1ea930b28d3" (UID: "636722a9-a340-4244-a4aa-d1ea930b28d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:09:14.301134 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.301109 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "636722a9-a340-4244-a4aa-d1ea930b28d3" (UID: "636722a9-a340-4244-a4aa-d1ea930b28d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:09:14.301411 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.301362 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "636722a9-a340-4244-a4aa-d1ea930b28d3" (UID: "636722a9-a340-4244-a4aa-d1ea930b28d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:09:14.301411 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.301385 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "636722a9-a340-4244-a4aa-d1ea930b28d3" (UID: "636722a9-a340-4244-a4aa-d1ea930b28d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:09:14.302938 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.302905 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "636722a9-a340-4244-a4aa-d1ea930b28d3" (UID: "636722a9-a340-4244-a4aa-d1ea930b28d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:09:14.303046 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.302994 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "636722a9-a340-4244-a4aa-d1ea930b28d3" (UID: "636722a9-a340-4244-a4aa-d1ea930b28d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:09:14.303046 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.302992 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636722a9-a340-4244-a4aa-d1ea930b28d3-kube-api-access-4v5j8" (OuterVolumeSpecName: "kube-api-access-4v5j8") pod "636722a9-a340-4244-a4aa-d1ea930b28d3" (UID: "636722a9-a340-4244-a4aa-d1ea930b28d3"). InnerVolumeSpecName "kube-api-access-4v5j8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:09:14.401772 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.401743 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-console-config\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:14.401772 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.401766 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-serving-cert\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:14.401772 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.401779 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/636722a9-a340-4244-a4aa-d1ea930b28d3-console-oauth-config\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:14.402007 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.401790 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-service-ca\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:14.402007 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.401801 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-oauth-serving-cert\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:14.402007 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.401812 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v5j8\" (UniqueName: \"kubernetes.io/projected/636722a9-a340-4244-a4aa-d1ea930b28d3-kube-api-access-4v5j8\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:14.402007 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.401823 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636722a9-a340-4244-a4aa-d1ea930b28d3-trusted-ca-bundle\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:09:14.979314 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.979280 2558 generic.go:356] "Generic (PLEG): container finished" podID="636722a9-a340-4244-a4aa-d1ea930b28d3" containerID="43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9" exitCode=0 Jun 09 11:09:14.979717 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.979321 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759fbf58c-s2jq5" Jun 09 11:09:14.979717 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.979342 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759fbf58c-s2jq5" event={"ID":"636722a9-a340-4244-a4aa-d1ea930b28d3","Type":"ContainerDied","Data":"43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9"} Jun 09 11:09:14.979717 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.979381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759fbf58c-s2jq5" event={"ID":"636722a9-a340-4244-a4aa-d1ea930b28d3","Type":"ContainerDied","Data":"b9ac9781afac05e4567839915ea586f5f5551e7ccebe7b0a057231a8639cc084"} Jun 09 11:09:14.979717 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.979399 2558 scope.go:117] "RemoveContainer" containerID="43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9" Jun 09 11:09:14.988357 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.988338 2558 scope.go:117] "RemoveContainer" containerID="43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9" Jun 09 11:09:14.988676 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:09:14.988657 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9\": container with ID starting with 43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9 not found: ID does not exist" containerID="43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9" Jun 09 11:09:14.988730 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.988684 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9"} err="failed to get container status \"43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9\": rpc error: code = NotFound desc = could not find container \"43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9\": container with ID starting with 43ad5ff509b965ad2c9b65c974cebcfdd70bd5d07c31b57f91f42790256b71e9 not found: ID does not exist" Jun 09 11:09:14.998225 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:14.998200 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7759fbf58c-s2jq5"] Jun 09 11:09:15.002163 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:15.002140 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7759fbf58c-s2jq5"] Jun 09 11:09:16.490347 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:16.490315 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="636722a9-a340-4244-a4aa-d1ea930b28d3" path="/var/lib/kubelet/pods/636722a9-a340-4244-a4aa-d1ea930b28d3/volumes" Jun 09 11:09:17.897566 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:17.897531 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:17.964038 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:17.964004 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:19.317142 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:19.317104 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:43.864638 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:43.864597 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:44.322740 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:44.322703 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:44.410894 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:44.410837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:54.228957 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.228922 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f499c7d-6bcct"] Jun 09 11:09:54.229425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.229156 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292e442f-5175-47e3-a0e0-0328b011359c" containerName="console" Jun 09 11:09:54.229425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.229167 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="292e442f-5175-47e3-a0e0-0328b011359c" containerName="console" Jun 09 11:09:54.229425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.229182 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636722a9-a340-4244-a4aa-d1ea930b28d3" containerName="console" Jun 09 11:09:54.229425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.229187 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="636722a9-a340-4244-a4aa-d1ea930b28d3" containerName="console" Jun 09 11:09:54.229425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.229196 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4ecc69-14d0-44a6-8e16-492de60d9f53" containerName="console" Jun 09 11:09:54.229425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.229202 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4ecc69-14d0-44a6-8e16-492de60d9f53" containerName="console" Jun 09 11:09:54.229425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.229242 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="636722a9-a340-4244-a4aa-d1ea930b28d3" containerName="console" Jun 09 11:09:54.229425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.229249 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="292e442f-5175-47e3-a0e0-0328b011359c" containerName="console" Jun 09 11:09:54.229425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.229257 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4ecc69-14d0-44a6-8e16-492de60d9f53" containerName="console" Jun 09 11:09:54.232106 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.232083 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.250758 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.250736 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f499c7d-6bcct"] Jun 09 11:09:54.281816 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.281788 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:54.349977 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.349941 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:54.386603 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.386577 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-serving-cert\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.386759 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.386619 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-oauth-config\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.386759 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.386638 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-service-ca\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.386759 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.386657 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-console-config\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.386759 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.386692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljggw\" (UniqueName: \"kubernetes.io/projected/de4c3a53-ba66-462f-aa49-25041eb46223-kube-api-access-ljggw\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.386759 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.386714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-trusted-ca-bundle\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.386947 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.386772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-oauth-serving-cert\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.488146 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.488060 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-serving-cert\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.488146 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.488103 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-oauth-config\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.488146 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.488122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-service-ca\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.488146 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.488142 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-console-config\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.488456 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.488162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljggw\" (UniqueName: \"kubernetes.io/projected/de4c3a53-ba66-462f-aa49-25041eb46223-kube-api-access-ljggw\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.488456 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.488304 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-trusted-ca-bundle\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.488456 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.488397 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-oauth-serving-cert\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.488954 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.488928 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-console-config\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.489084 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.488986 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-service-ca\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.489084 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.489053 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-oauth-serving-cert\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.489378 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.489346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-trusted-ca-bundle\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.490645 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.490627 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-oauth-config\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.490899 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.490858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-serving-cert\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.497426 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.497407 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljggw\" (UniqueName: \"kubernetes.io/projected/de4c3a53-ba66-462f-aa49-25041eb46223-kube-api-access-ljggw\") pod \"console-86f499c7d-6bcct\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.541033 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.541001 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:09:54.666065 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:54.666022 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f499c7d-6bcct"] Jun 09 11:09:54.668800 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:09:54.668775 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4c3a53_ba66_462f_aa49_25041eb46223.slice/crio-10ec7191d6bfc061fdcc13dac80bfa74e60b5b002d8ae0034d6bfaec2f65ede7 WatchSource:0}: Error finding container 10ec7191d6bfc061fdcc13dac80bfa74e60b5b002d8ae0034d6bfaec2f65ede7: Status 404 returned error can't find the container with id 10ec7191d6bfc061fdcc13dac80bfa74e60b5b002d8ae0034d6bfaec2f65ede7 Jun 09 11:09:55.111691 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:55.111659 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f499c7d-6bcct" event={"ID":"de4c3a53-ba66-462f-aa49-25041eb46223","Type":"ContainerStarted","Data":"912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79"} Jun 09 11:09:55.111858 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:55.111709 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f499c7d-6bcct" event={"ID":"de4c3a53-ba66-462f-aa49-25041eb46223","Type":"ContainerStarted","Data":"10ec7191d6bfc061fdcc13dac80bfa74e60b5b002d8ae0034d6bfaec2f65ede7"} Jun 09 11:09:55.141403 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:55.141351 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86f499c7d-6bcct" podStartSLOduration=1.141336566 podStartE2EDuration="1.141336566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:09:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:09:55.140953065 +0000 UTC m=+151.049338391" watchObservedRunningTime="2026-06-09 11:09:55.141336566 +0000 UTC m=+151.049721892" Jun 09 11:09:56.185168 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:56.185135 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:56.254950 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:09:56.254915 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:10:02.873318 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:02.873230 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:10:02.973395 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:02.973363 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:10:04.541751 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:04.541721 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:10:04.542169 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:04.541936 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:10:04.546488 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:04.546466 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:10:05.146533 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:05.146506 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:10:05.193091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:05.193063 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798fb68676-rtm9s"] Jun 09 11:10:05.295328 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:05.295296 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:10:05.351891 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:05.351841 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:10:05.409097 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:05.409006 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:10:10.245681 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:10.245633 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:10:13.583582 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:13.583502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:10:30.213919 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.213837 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-798fb68676-rtm9s" podUID="ba47a107-f0c0-41a9-ab79-88a9385c2d9f" containerName="console" containerID="cri-o://410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a" gracePeriod=15 Jun 09 11:10:30.453357 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.453334 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:10:30.553270 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553180 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-serving-cert\") pod \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " Jun 09 11:10:30.553270 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553220 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-trusted-ca-bundle\") pod \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " Jun 09 11:10:30.553270 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553244 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-oauth-serving-cert\") pod \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " Jun 09 11:10:30.553535 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553325 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-config\") pod \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " Jun 09 11:10:30.553535 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553348 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-service-ca\") pod \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " Jun 09 11:10:30.553535 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553379 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-oauth-config\") pod \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " Jun 09 11:10:30.553535 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553415 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqqw4\" (UniqueName: \"kubernetes.io/projected/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-kube-api-access-lqqw4\") pod \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\" (UID: \"ba47a107-f0c0-41a9-ab79-88a9385c2d9f\") " Jun 09 11:10:30.553730 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553641 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba47a107-f0c0-41a9-ab79-88a9385c2d9f" (UID: "ba47a107-f0c0-41a9-ab79-88a9385c2d9f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:10:30.553730 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553673 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba47a107-f0c0-41a9-ab79-88a9385c2d9f" (UID: "ba47a107-f0c0-41a9-ab79-88a9385c2d9f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:10:30.553730 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553694 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-config" (OuterVolumeSpecName: "console-config") pod "ba47a107-f0c0-41a9-ab79-88a9385c2d9f" (UID: "ba47a107-f0c0-41a9-ab79-88a9385c2d9f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:10:30.553942 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.553920 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba47a107-f0c0-41a9-ab79-88a9385c2d9f" (UID: "ba47a107-f0c0-41a9-ab79-88a9385c2d9f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:10:30.555374 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.555348 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba47a107-f0c0-41a9-ab79-88a9385c2d9f" (UID: "ba47a107-f0c0-41a9-ab79-88a9385c2d9f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:10:30.555484 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.555462 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba47a107-f0c0-41a9-ab79-88a9385c2d9f" (UID: "ba47a107-f0c0-41a9-ab79-88a9385c2d9f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:10:30.555524 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.555483 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-kube-api-access-lqqw4" (OuterVolumeSpecName: "kube-api-access-lqqw4") pod "ba47a107-f0c0-41a9-ab79-88a9385c2d9f" (UID: "ba47a107-f0c0-41a9-ab79-88a9385c2d9f"). InnerVolumeSpecName "kube-api-access-lqqw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:10:30.654591 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.654548 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-trusted-ca-bundle\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:10:30.654591 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.654585 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-oauth-serving-cert\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:10:30.654591 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.654598 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-config\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:10:30.654591 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.654608 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-service-ca\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:10:30.654841 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.654617 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-oauth-config\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:10:30.654841 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.654626 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqqw4\" (UniqueName: \"kubernetes.io/projected/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-kube-api-access-lqqw4\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:10:30.654841 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:30.654634 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba47a107-f0c0-41a9-ab79-88a9385c2d9f-console-serving-cert\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:10:31.232211 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:31.232178 2558 generic.go:356] "Generic (PLEG): container finished" podID="ba47a107-f0c0-41a9-ab79-88a9385c2d9f" containerID="410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a" exitCode=0 Jun 09 11:10:31.232641 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:31.232223 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798fb68676-rtm9s" Jun 09 11:10:31.232641 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:31.232227 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798fb68676-rtm9s" event={"ID":"ba47a107-f0c0-41a9-ab79-88a9385c2d9f","Type":"ContainerDied","Data":"410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a"} Jun 09 11:10:31.232641 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:31.232267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798fb68676-rtm9s" event={"ID":"ba47a107-f0c0-41a9-ab79-88a9385c2d9f","Type":"ContainerDied","Data":"f6d9532cbbedcf98e0143f0358ea1cea40a83c29fdb643f0233244f556ab1116"} Jun 09 11:10:31.232641 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:31.232287 2558 scope.go:117] "RemoveContainer" containerID="410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a" Jun 09 11:10:31.240426 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:31.240411 2558 scope.go:117] "RemoveContainer" containerID="410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a" Jun 09 11:10:31.240695 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:10:31.240672 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a\": container with ID starting with 410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a not found: ID does not exist" containerID="410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a" Jun 09 11:10:31.240794 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:31.240701 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a"} err="failed to get container status \"410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a\": rpc error: code = NotFound desc = could not find container \"410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a\": container with ID starting with 410c25969a844fe329fad3291f080c03a5e6aeba9b232b6aae7678136e44bb9a not found: ID does not exist" Jun 09 11:10:31.256343 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:31.256317 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798fb68676-rtm9s"] Jun 09 11:10:31.258577 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:31.258556 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-798fb68676-rtm9s"] Jun 09 11:10:32.492528 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:32.492493 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba47a107-f0c0-41a9-ab79-88a9385c2d9f" path="/var/lib/kubelet/pods/ba47a107-f0c0-41a9-ab79-88a9385c2d9f/volumes" Jun 09 11:10:39.499241 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:39.499202 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:10:39.561551 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:10:39.561520 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:11:00.581833 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:11:00.581793 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:05.384761 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:05.384728 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:06.505143 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:06.505107 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:24.438431 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:24.438401 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 11:12:44.908636 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:44.908601 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:45.011575 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.011543 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:45.648379 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.648339 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:45.668471 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.668443 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch"] Jun 09 11:12:45.668733 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.668718 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba47a107-f0c0-41a9-ab79-88a9385c2d9f" containerName="console" Jun 09 11:12:45.668805 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.668736 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba47a107-f0c0-41a9-ab79-88a9385c2d9f" containerName="console" Jun 09 11:12:45.668856 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.668815 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba47a107-f0c0-41a9-ab79-88a9385c2d9f" containerName="console" Jun 09 11:12:45.671623 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.671604 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" Jun 09 11:12:45.674525 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.674506 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jun 09 11:12:45.675676 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.675657 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-d76qq\"" Jun 09 11:12:45.675763 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.675691 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jun 09 11:12:45.690289 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.690266 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch"] Jun 09 11:12:45.753991 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.753967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g25zj\" (UniqueName: \"kubernetes.io/projected/16c16c19-9e06-46ac-a414-768574c6f0a6-kube-api-access-g25zj\") pod \"feast-operator-controller-manager-6976c8f54f-hxnch\" (UID: \"16c16c19-9e06-46ac-a414-768574c6f0a6\") " pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" Jun 09 11:12:45.854926 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.854860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g25zj\" (UniqueName: \"kubernetes.io/projected/16c16c19-9e06-46ac-a414-768574c6f0a6-kube-api-access-g25zj\") pod \"feast-operator-controller-manager-6976c8f54f-hxnch\" (UID: \"16c16c19-9e06-46ac-a414-768574c6f0a6\") " pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" Jun 09 11:12:45.864230 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.864197 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g25zj\" (UniqueName: \"kubernetes.io/projected/16c16c19-9e06-46ac-a414-768574c6f0a6-kube-api-access-g25zj\") pod \"feast-operator-controller-manager-6976c8f54f-hxnch\" (UID: \"16c16c19-9e06-46ac-a414-768574c6f0a6\") " pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" Jun 09 11:12:45.981258 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:45.981233 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" Jun 09 11:12:46.103255 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:46.103226 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch"] Jun 09 11:12:46.106208 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:12:46.106186 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c16c19_9e06_46ac_a414_768574c6f0a6.slice/crio-708c6853c07f9639310f6455fd9c48637725ae1a81b4cc3316685991b0b7de33 WatchSource:0}: Error finding container 708c6853c07f9639310f6455fd9c48637725ae1a81b4cc3316685991b0b7de33: Status 404 returned error can't find the container with id 708c6853c07f9639310f6455fd9c48637725ae1a81b4cc3316685991b0b7de33 Jun 09 11:12:46.108211 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:46.108194 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:12:46.681508 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:46.681472 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" event={"ID":"16c16c19-9e06-46ac-a414-768574c6f0a6","Type":"ContainerStarted","Data":"708c6853c07f9639310f6455fd9c48637725ae1a81b4cc3316685991b0b7de33"} Jun 09 11:12:49.692614 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:49.692582 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" event={"ID":"16c16c19-9e06-46ac-a414-768574c6f0a6","Type":"ContainerStarted","Data":"a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616"} Jun 09 11:12:49.693066 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:49.692662 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" Jun 09 11:12:49.713880 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:12:49.713833 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" podStartSLOduration=1.9026906829999999 podStartE2EDuration="4.713819937s" totalImagesPullingTime="2.811129254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:12:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:12:49.71298641 +0000 UTC m=+325.621371747" watchObservedRunningTime="2026-06-09 11:12:49.713819937 +0000 UTC m=+325.622205263" Jun 09 11:13:00.698309 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:00.698278 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" Jun 09 11:13:28.213422 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.213386 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:28.344690 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.344656 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:28.549569 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.549492 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:28.652658 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.652622 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:28.665494 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.665465 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl"] Jun 09 11:13:28.669211 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.669191 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.671921 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.671888 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jun 09 11:13:28.672030 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.671967 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-wx4lc\"" Jun 09 11:13:28.672030 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.671970 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Jun 09 11:13:28.672115 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.671971 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jun 09 11:13:28.672341 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.672327 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jun 09 11:13:28.672395 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.672358 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jun 09 11:13:28.672645 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.672630 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jun 09 11:13:28.672685 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.672630 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jun 09 11:13:28.685501 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.685478 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl"] Jun 09 11:13:28.740648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.740616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-online-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.740648 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.740648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5abbe345-60b0-4794-b6db-eaf86998ef9f-feast-data\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.740826 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.740666 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-offline-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.740826 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.740721 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-ui-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.740826 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.740752 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978qn\" (UniqueName: \"kubernetes.io/projected/5abbe345-60b0-4794-b6db-eaf86998ef9f-kube-api-access-978qn\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.740826 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.740808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-registry-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.749910 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.749887 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:28.841398 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.841319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-registry-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.841398 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.841367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-online-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.841398 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.841382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5abbe345-60b0-4794-b6db-eaf86998ef9f-feast-data\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.841398 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.841401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-offline-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.841681 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.841421 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-ui-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.841681 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.841447 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978qn\" (UniqueName: \"kubernetes.io/projected/5abbe345-60b0-4794-b6db-eaf86998ef9f-kube-api-access-978qn\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.841681 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:13:28.841475 2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jun 09 11:13:28.841681 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:13:28.841476 2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jun 09 11:13:28.841681 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:13:28.841562 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-registry-tls podName:5abbe345-60b0-4794-b6db-eaf86998ef9f nodeName:}" failed. No retries permitted until 2026-06-09 11:13:29.341534684 +0000 UTC m=+365.249919989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-registry-tls") pod "feast-simple-feast-setup-b67b7bdb8-6kpzl" (UID: "5abbe345-60b0-4794-b6db-eaf86998ef9f") : secret "feast-simple-feast-setup-registry-tls" not found Jun 09 11:13:28.841681 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:13:28.841599 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-online-tls podName:5abbe345-60b0-4794-b6db-eaf86998ef9f nodeName:}" failed. No retries permitted until 2026-06-09 11:13:29.341585693 +0000 UTC m=+365.249971000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-online-tls") pod "feast-simple-feast-setup-b67b7bdb8-6kpzl" (UID: "5abbe345-60b0-4794-b6db-eaf86998ef9f") : secret "feast-simple-feast-setup-online-tls" not found Jun 09 11:13:28.841681 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:13:28.841539 2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jun 09 11:13:28.841681 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:13:28.841636 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-ui-tls podName:5abbe345-60b0-4794-b6db-eaf86998ef9f nodeName:}" failed. No retries permitted until 2026-06-09 11:13:29.341626954 +0000 UTC m=+365.250012268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-ui-tls") pod "feast-simple-feast-setup-b67b7bdb8-6kpzl" (UID: "5abbe345-60b0-4794-b6db-eaf86998ef9f") : secret "feast-simple-feast-setup-ui-tls" not found Jun 09 11:13:28.842002 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.841772 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5abbe345-60b0-4794-b6db-eaf86998ef9f-feast-data\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.843846 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.843830 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-offline-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.851084 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.851065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-978qn\" (UniqueName: \"kubernetes.io/projected/5abbe345-60b0-4794-b6db-eaf86998ef9f-kube-api-access-978qn\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:28.924482 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:28.924444 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:29.025204 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.025169 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:29.125296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.125190 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:29.346007 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.345970 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-registry-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:29.346468 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.346021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-online-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:29.346468 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.346050 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-ui-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:29.348485 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.348460 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-online-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:29.348614 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.348558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-registry-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:29.348614 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.348600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-ui-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-6kpzl\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:29.590255 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.590224 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:13:29.723851 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.723828 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl"] Jun 09 11:13:29.726347 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:13:29.726322 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5abbe345_60b0_4794_b6db_eaf86998ef9f.slice/crio-21855397645d46d60da4c691ac3dd96264841d3aecca7371ec62f8086849c7bd WatchSource:0}: Error finding container 21855397645d46d60da4c691ac3dd96264841d3aecca7371ec62f8086849c7bd: Status 404 returned error can't find the container with id 21855397645d46d60da4c691ac3dd96264841d3aecca7371ec62f8086849c7bd Jun 09 11:13:29.826576 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:29.826541 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerStarted","Data":"21855397645d46d60da4c691ac3dd96264841d3aecca7371ec62f8086849c7bd"} Jun 09 11:13:40.252372 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.252334 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c8864465d-psjzz"] Jun 09 11:13:40.255730 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.255701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.268591 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.268562 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c8864465d-psjzz"] Jun 09 11:13:40.333087 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.333056 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:40.425953 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.425929 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ztwb\" (UniqueName: \"kubernetes.io/projected/90dcde54-ff55-4d75-b5c3-5789193112e1-kube-api-access-2ztwb\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.426101 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.425981 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90dcde54-ff55-4d75-b5c3-5789193112e1-console-oauth-config\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.426101 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.426066 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90dcde54-ff55-4d75-b5c3-5789193112e1-console-serving-cert\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.426101 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.426097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-trusted-ca-bundle\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.426258 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.426136 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-oauth-serving-cert\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.426258 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.426164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-service-ca\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.426258 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.426194 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-console-config\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.434116 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.434092 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:40.498555 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.498531 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:40.527142 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.527088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-oauth-serving-cert\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.527142 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.527117 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-service-ca\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.527142 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.527139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-console-config\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.527341 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.527172 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ztwb\" (UniqueName: \"kubernetes.io/projected/90dcde54-ff55-4d75-b5c3-5789193112e1-kube-api-access-2ztwb\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.527341 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.527213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90dcde54-ff55-4d75-b5c3-5789193112e1-console-oauth-config\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.527341 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.527256 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90dcde54-ff55-4d75-b5c3-5789193112e1-console-serving-cert\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.527341 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.527287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-trusted-ca-bundle\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.527889 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.527850 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-oauth-serving-cert\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.527999 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.527964 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-console-config\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.528057 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.527990 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-service-ca\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.528252 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.528231 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90dcde54-ff55-4d75-b5c3-5789193112e1-trusted-ca-bundle\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.529742 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.529714 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90dcde54-ff55-4d75-b5c3-5789193112e1-console-serving-cert\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.529823 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.529766 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90dcde54-ff55-4d75-b5c3-5789193112e1-console-oauth-config\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.536480 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.536462 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ztwb\" (UniqueName: \"kubernetes.io/projected/90dcde54-ff55-4d75-b5c3-5789193112e1-kube-api-access-2ztwb\") pod \"console-c8864465d-psjzz\" (UID: \"90dcde54-ff55-4d75-b5c3-5789193112e1\") " pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.567456 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.567435 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:40.691652 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.691625 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c8864465d-psjzz"] Jun 09 11:13:40.694019 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:13:40.693993 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90dcde54_ff55_4d75_b5c3_5789193112e1.slice/crio-933b0126b6fd2d6c61c60ebd07efb9e3f3b97fa04d1c61d5bb1546c6ad5cd357 WatchSource:0}: Error finding container 933b0126b6fd2d6c61c60ebd07efb9e3f3b97fa04d1c61d5bb1546c6ad5cd357: Status 404 returned error can't find the container with id 933b0126b6fd2d6c61c60ebd07efb9e3f3b97fa04d1c61d5bb1546c6ad5cd357 Jun 09 11:13:40.869319 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.869238 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8864465d-psjzz" event={"ID":"90dcde54-ff55-4d75-b5c3-5789193112e1","Type":"ContainerStarted","Data":"e237a032298a79139269dc33d5c0a59a39535cfd103d314b2e86d8feb29f439f"} Jun 09 11:13:40.869319 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.869290 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8864465d-psjzz" event={"ID":"90dcde54-ff55-4d75-b5c3-5789193112e1","Type":"ContainerStarted","Data":"933b0126b6fd2d6c61c60ebd07efb9e3f3b97fa04d1c61d5bb1546c6ad5cd357"} Jun 09 11:13:40.889950 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:40.889904 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c8864465d-psjzz" podStartSLOduration=0.889891554 podStartE2EDuration="889.891554ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:13:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:13:40.889273732 +0000 UTC m=+376.797659058" watchObservedRunningTime="2026-06-09 11:13:40.889891554 +0000 UTC m=+376.798276933" Jun 09 11:13:41.057196 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:41.057166 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:41.130329 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:41.130259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:47.107142 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:47.107103 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:47.195695 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:47.195659 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:50.568285 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:50.568244 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:50.568705 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:50.568306 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:50.572910 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:50.572862 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:50.911070 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:50.910992 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c8864465d-psjzz" Jun 09 11:13:50.956606 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:50.956570 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f499c7d-6bcct"] Jun 09 11:13:51.071404 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:51.071357 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:51.171938 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:51.171814 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:51.271503 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:13:51.271471 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:07.970419 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:07.970385 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerStarted","Data":"7a2dfb872646379b2a4a65784cd3d88bab5cdd053c7be7c2dda6b25963f12dad"} Jun 09 11:14:11.986027 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:11.985997 2558 generic.go:356] "Generic (PLEG): container finished" podID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerID="7a2dfb872646379b2a4a65784cd3d88bab5cdd053c7be7c2dda6b25963f12dad" exitCode=0 Jun 09 11:14:11.986486 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:11.986035 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerDied","Data":"7a2dfb872646379b2a4a65784cd3d88bab5cdd053c7be7c2dda6b25963f12dad"} Jun 09 11:14:12.991458 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:12.991424 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerStarted","Data":"f5c1de70da0645488c2ede352d1771db15cb27c7a531f6c8173adbbcfced654d"} Jun 09 11:14:15.976067 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:15.976000 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86f499c7d-6bcct" podUID="de4c3a53-ba66-462f-aa49-25041eb46223" containerName="console" containerID="cri-o://912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79" gracePeriod=15 Jun 09 11:14:16.228542 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.228487 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:14:16.313309 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313284 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-service-ca\") pod \"de4c3a53-ba66-462f-aa49-25041eb46223\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " Jun 09 11:14:16.313462 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313318 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-oauth-config\") pod \"de4c3a53-ba66-462f-aa49-25041eb46223\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " Jun 09 11:14:16.313462 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313363 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljggw\" (UniqueName: \"kubernetes.io/projected/de4c3a53-ba66-462f-aa49-25041eb46223-kube-api-access-ljggw\") pod \"de4c3a53-ba66-462f-aa49-25041eb46223\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " Jun 09 11:14:16.313462 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313394 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-oauth-serving-cert\") pod \"de4c3a53-ba66-462f-aa49-25041eb46223\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " Jun 09 11:14:16.313462 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313427 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-console-config\") pod \"de4c3a53-ba66-462f-aa49-25041eb46223\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " Jun 09 11:14:16.313654 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313557 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-trusted-ca-bundle\") pod \"de4c3a53-ba66-462f-aa49-25041eb46223\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " Jun 09 11:14:16.313654 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313611 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-serving-cert\") pod \"de4c3a53-ba66-462f-aa49-25041eb46223\" (UID: \"de4c3a53-ba66-462f-aa49-25041eb46223\") " Jun 09 11:14:16.313772 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313747 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-service-ca" (OuterVolumeSpecName: "service-ca") pod "de4c3a53-ba66-462f-aa49-25041eb46223" (UID: "de4c3a53-ba66-462f-aa49-25041eb46223"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:14:16.313772 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313760 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "de4c3a53-ba66-462f-aa49-25041eb46223" (UID: "de4c3a53-ba66-462f-aa49-25041eb46223"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:14:16.314004 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313945 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-service-ca\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:14:16.314004 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313972 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-oauth-serving-cert\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:14:16.314004 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.313993 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "de4c3a53-ba66-462f-aa49-25041eb46223" (UID: "de4c3a53-ba66-462f-aa49-25041eb46223"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:14:16.314190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.314025 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-console-config" (OuterVolumeSpecName: "console-config") pod "de4c3a53-ba66-462f-aa49-25041eb46223" (UID: "de4c3a53-ba66-462f-aa49-25041eb46223"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:14:16.315532 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.315498 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "de4c3a53-ba66-462f-aa49-25041eb46223" (UID: "de4c3a53-ba66-462f-aa49-25041eb46223"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:14:16.315857 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.315838 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "de4c3a53-ba66-462f-aa49-25041eb46223" (UID: "de4c3a53-ba66-462f-aa49-25041eb46223"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:14:16.315989 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.315864 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de4c3a53-ba66-462f-aa49-25041eb46223-kube-api-access-ljggw" (OuterVolumeSpecName: "kube-api-access-ljggw") pod "de4c3a53-ba66-462f-aa49-25041eb46223" (UID: "de4c3a53-ba66-462f-aa49-25041eb46223"). InnerVolumeSpecName "kube-api-access-ljggw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:14:16.414587 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.414559 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-trusted-ca-bundle\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:14:16.414587 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.414581 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-serving-cert\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:14:16.414587 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.414590 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de4c3a53-ba66-462f-aa49-25041eb46223-console-oauth-config\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:14:16.414773 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.414598 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljggw\" (UniqueName: \"kubernetes.io/projected/de4c3a53-ba66-462f-aa49-25041eb46223-kube-api-access-ljggw\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:14:16.414773 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:16.414608 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de4c3a53-ba66-462f-aa49-25041eb46223-console-config\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:14:17.006531 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:17.006501 2558 generic.go:356] "Generic (PLEG): container finished" podID="de4c3a53-ba66-462f-aa49-25041eb46223" containerID="912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79" exitCode=0 Jun 09 11:14:17.006984 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:17.006564 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f499c7d-6bcct" Jun 09 11:14:17.006984 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:17.006588 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f499c7d-6bcct" event={"ID":"de4c3a53-ba66-462f-aa49-25041eb46223","Type":"ContainerDied","Data":"912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79"} Jun 09 11:14:17.006984 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:17.006631 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f499c7d-6bcct" event={"ID":"de4c3a53-ba66-462f-aa49-25041eb46223","Type":"ContainerDied","Data":"10ec7191d6bfc061fdcc13dac80bfa74e60b5b002d8ae0034d6bfaec2f65ede7"} Jun 09 11:14:17.006984 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:17.006649 2558 scope.go:117] "RemoveContainer" containerID="912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79" Jun 09 11:14:17.016365 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:17.016286 2558 scope.go:117] "RemoveContainer" containerID="912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79" Jun 09 11:14:17.016829 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:14:17.016809 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79\": container with ID starting with 912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79 not found: ID does not exist" containerID="912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79" Jun 09 11:14:17.017020 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:17.016835 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79"} err="failed to get container status \"912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79\": rpc error: code = NotFound desc = could not find container \"912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79\": container with ID starting with 912a0f78129b5b10b8c47b60c8fcaf14161b5dd88597aeb6e5bda83c13817a79 not found: ID does not exist" Jun 09 11:14:17.027519 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:17.027493 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f499c7d-6bcct"] Jun 09 11:14:17.035247 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:17.035223 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86f499c7d-6bcct"] Jun 09 11:14:18.011722 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:18.011694 2558 generic.go:356] "Generic (PLEG): container finished" podID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerID="f5c1de70da0645488c2ede352d1771db15cb27c7a531f6c8173adbbcfced654d" exitCode=0 Jun 09 11:14:18.012206 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:18.011769 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerDied","Data":"f5c1de70da0645488c2ede352d1771db15cb27c7a531f6c8173adbbcfced654d"} Jun 09 11:14:18.494536 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:18.494498 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de4c3a53-ba66-462f-aa49-25041eb46223" path="/var/lib/kubelet/pods/de4c3a53-ba66-462f-aa49-25041eb46223/volumes" Jun 09 11:14:19.021470 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:19.021430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerStarted","Data":"1be34d81432fa954ef0c7191cb69bcde23cf2c68b64609ce618e04bcd8e8d7d7"} Jun 09 11:14:19.021957 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:19.021494 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerStarted","Data":"792b46d46b9f496f7abba7189673c310c98e61efbbb0408404cd16ee551cf025"} Jun 09 11:14:19.021957 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:19.021516 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerStarted","Data":"17b2098d955d2cf0fe67cd54b32fa37fa5993b5174d9424fde6c3723a1b68e4a"} Jun 09 11:14:19.021957 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:19.021536 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerStarted","Data":"39e841dc54278203a320a6913774c28faac4ad56664a13e647f2a21c0fec3b5a"} Jun 09 11:14:19.050401 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:19.050336 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podStartSLOduration=13.789515162 podStartE2EDuration="51.050312863s" totalImagesPullingTime="37.260797701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:14:19.048338986 +0000 UTC m=+414.956724337" watchObservedRunningTime="2026-06-09 11:14:19.050312863 +0000 UTC m=+414.958698192" Jun 09 11:14:19.590637 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:19.590593 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:19.590832 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:19.590668 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:19.590832 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:19.590690 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:19.590832 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:19.590708 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:20.590946 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:20.590914 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:20.591480 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:20.591453 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:20.591480 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:20.591483 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:20.591677 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:20.591502 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:20.593029 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:20.592852 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused" Jun 09 11:14:20.593029 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:20.592896 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 11:14:20.593029 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:20.592942 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused" Jun 09 11:14:20.593029 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:20.592994 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Jun 09 11:14:23.591491 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:23.591462 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:23.591993 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:23.591969 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:23.592153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:23.592138 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:23.592248 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:23.592234 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:23.595846 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:23.595830 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:24.055577 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:24.055551 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:24.055855 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:24.055839 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:24.058108 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:24.058087 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:14:24.455266 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:14:24.455237 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:25.940366 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:25.940334 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:25.950851 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:25.950820 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl"] Jun 09 11:15:25.951149 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:25.951101 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="registry" containerID="cri-o://39e841dc54278203a320a6913774c28faac4ad56664a13e647f2a21c0fec3b5a" gracePeriod=30 Jun 09 11:15:25.951252 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:25.951151 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="ui" containerID="cri-o://1be34d81432fa954ef0c7191cb69bcde23cf2c68b64609ce618e04bcd8e8d7d7" gracePeriod=30 Jun 09 11:15:25.951252 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:25.951156 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="online" containerID="cri-o://17b2098d955d2cf0fe67cd54b32fa37fa5993b5174d9424fde6c3723a1b68e4a" gracePeriod=30 Jun 09 11:15:25.951362 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:25.951162 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="offline" containerID="cri-o://792b46d46b9f496f7abba7189673c310c98e61efbbb0408404cd16ee551cf025" gracePeriod=30 Jun 09 11:15:26.040462 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.040406 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:26.142012 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.141979 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:26.212507 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.212398 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:26.218140 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.218115 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn"] Jun 09 11:15:26.218433 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.218418 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4c3a53-ba66-462f-aa49-25041eb46223" containerName="console" Jun 09 11:15:26.218498 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.218436 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4c3a53-ba66-462f-aa49-25041eb46223" containerName="console" Jun 09 11:15:26.218561 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.218539 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4c3a53-ba66-462f-aa49-25041eb46223" containerName="console" Jun 09 11:15:26.222096 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.222078 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.224750 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.224729 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-rgcb4\"" Jun 09 11:15:26.236341 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.236315 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn"] Jun 09 11:15:26.283151 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.283110 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:26.311483 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.311446 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/51eed737-6e56-4a40-8930-82856361ca95-feast-data\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.311483 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.311485 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-registry-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.311701 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.311525 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-offline-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.311701 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.311582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvdgh\" (UniqueName: \"kubernetes.io/projected/51eed737-6e56-4a40-8930-82856361ca95-kube-api-access-fvdgh\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.311701 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.311609 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-ui-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.311701 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.311645 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-online-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.343963 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.343917 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:26.412244 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.412201 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvdgh\" (UniqueName: \"kubernetes.io/projected/51eed737-6e56-4a40-8930-82856361ca95-kube-api-access-fvdgh\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.412244 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.412245 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-ui-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.412523 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.412274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-online-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.412523 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.412306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/51eed737-6e56-4a40-8930-82856361ca95-feast-data\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.412523 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.412325 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-registry-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.412523 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.412355 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-offline-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.412523 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:15:26.412461 2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jun 09 11:15:26.412523 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:15:26.412484 2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jun 09 11:15:26.412839 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:15:26.412532 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-online-tls podName:51eed737-6e56-4a40-8930-82856361ca95 nodeName:}" failed. No retries permitted until 2026-06-09 11:15:26.912511588 +0000 UTC m=+482.820896908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-online-tls") pod "feast-simple-feast-setup-b67b7bdb8-qb5zn" (UID: "51eed737-6e56-4a40-8930-82856361ca95") : secret "feast-simple-feast-setup-online-tls" not found Jun 09 11:15:26.412839 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:15:26.412552 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-registry-tls podName:51eed737-6e56-4a40-8930-82856361ca95 nodeName:}" failed. No retries permitted until 2026-06-09 11:15:26.912543011 +0000 UTC m=+482.820928321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-registry-tls") pod "feast-simple-feast-setup-b67b7bdb8-qb5zn" (UID: "51eed737-6e56-4a40-8930-82856361ca95") : secret "feast-simple-feast-setup-registry-tls" not found Jun 09 11:15:26.412839 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.412731 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/51eed737-6e56-4a40-8930-82856361ca95-feast-data\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.414967 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.414946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-offline-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.415027 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.414946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-ui-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.420804 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.420783 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvdgh\" (UniqueName: \"kubernetes.io/projected/51eed737-6e56-4a40-8930-82856361ca95-kube-api-access-fvdgh\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.529295 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.529261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:26.648934 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.648903 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:26.915292 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.915224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-online-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.915292 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.915260 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-registry-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.917518 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.917491 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-registry-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:26.917618 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:26.917553 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-online-tls\") pod \"feast-simple-feast-setup-b67b7bdb8-qb5zn\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:27.131747 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:27.131718 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:27.261601 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:27.261580 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn"] Jun 09 11:15:27.263523 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:15:27.263501 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51eed737_6e56_4a40_8930_82856361ca95.slice/crio-e3788ef34895b9e6685a1c2d22d27c15234f0c883c7df09f39d3f4958c7ea92e WatchSource:0}: Error finding container e3788ef34895b9e6685a1c2d22d27c15234f0c883c7df09f39d3f4958c7ea92e: Status 404 returned error can't find the container with id e3788ef34895b9e6685a1c2d22d27c15234f0c883c7df09f39d3f4958c7ea92e Jun 09 11:15:27.273450 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:27.273425 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerStarted","Data":"e3788ef34895b9e6685a1c2d22d27c15234f0c883c7df09f39d3f4958c7ea92e"} Jun 09 11:15:27.281948 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:27.281924 2558 generic.go:356] "Generic (PLEG): container finished" podID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerID="1be34d81432fa954ef0c7191cb69bcde23cf2c68b64609ce618e04bcd8e8d7d7" exitCode=0 Jun 09 11:15:27.281948 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:27.281945 2558 generic.go:356] "Generic (PLEG): container finished" podID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerID="17b2098d955d2cf0fe67cd54b32fa37fa5993b5174d9424fde6c3723a1b68e4a" exitCode=0 Jun 09 11:15:27.282116 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:27.281972 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerDied","Data":"1be34d81432fa954ef0c7191cb69bcde23cf2c68b64609ce618e04bcd8e8d7d7"} Jun 09 11:15:27.282116 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:27.281998 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerDied","Data":"17b2098d955d2cf0fe67cd54b32fa37fa5993b5174d9424fde6c3723a1b68e4a"} Jun 09 11:15:28.288170 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:28.288120 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerStarted","Data":"8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097"} Jun 09 11:15:32.302910 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:32.302854 2558 generic.go:356] "Generic (PLEG): container finished" podID="51eed737-6e56-4a40-8930-82856361ca95" containerID="8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097" exitCode=0 Jun 09 11:15:32.303270 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:32.302927 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerDied","Data":"8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097"} Jun 09 11:15:33.308228 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:33.308195 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerStarted","Data":"b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b"} Jun 09 11:15:34.055425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:34.055382 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 11:15:34.055575 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:34.055395 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Jun 09 11:15:38.326736 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:38.326699 2558 generic.go:356] "Generic (PLEG): container finished" podID="51eed737-6e56-4a40-8930-82856361ca95" containerID="b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b" exitCode=0 Jun 09 11:15:38.327127 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:38.326774 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerDied","Data":"b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b"} Jun 09 11:15:39.336597 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:39.336553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerStarted","Data":"b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2"} Jun 09 11:15:39.337092 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:39.336618 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerStarted","Data":"79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228"} Jun 09 11:15:39.337092 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:39.336640 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerStarted","Data":"6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857"} Jun 09 11:15:39.337092 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:39.336661 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerStarted","Data":"f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97"} Jun 09 11:15:39.363445 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:39.363376 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podStartSLOduration=13.363354596 podStartE2EDuration="13.363354596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:15:39.362340932 +0000 UTC m=+495.270726261" watchObservedRunningTime="2026-06-09 11:15:39.363354596 +0000 UTC m=+495.271739925" Jun 09 11:15:42.132774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:42.132578 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:42.132774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:42.132645 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:42.132774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:42.132665 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:42.132774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:42.132683 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:42.135039 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:42.135001 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.21:6571: connect: connection refused" Jun 09 11:15:42.135276 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:42.135035 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused" Jun 09 11:15:42.135399 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:42.135051 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Jun 09 11:15:42.135399 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:42.135073 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Jun 09 11:15:44.055767 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:44.055729 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 11:15:44.056168 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:44.055764 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Jun 09 11:15:45.133603 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.133574 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.134034 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.133706 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.134103 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.134083 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.134213 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.134199 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.134273 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.134235 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.134273 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.134256 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.134582 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.134562 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.134687 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.134623 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.134687 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.134670 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.138029 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.138012 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.365237 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.365210 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.367910 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.367887 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:15:45.611550 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:45.611511 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:54.055423 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:54.055374 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 11:15:54.056020 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:54.055380 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Jun 09 11:15:54.056020 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:54.055520 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:15:54.056020 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:54.055592 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:15:56.407969 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.407885 2558 generic.go:356] "Generic (PLEG): container finished" podID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerID="792b46d46b9f496f7abba7189673c310c98e61efbbb0408404cd16ee551cf025" exitCode=137 Jun 09 11:15:56.407969 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.407915 2558 generic.go:356] "Generic (PLEG): container finished" podID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerID="39e841dc54278203a320a6913774c28faac4ad56664a13e647f2a21c0fec3b5a" exitCode=137 Jun 09 11:15:56.407969 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.407896 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerDied","Data":"792b46d46b9f496f7abba7189673c310c98e61efbbb0408404cd16ee551cf025"} Jun 09 11:15:56.407969 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.407956 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerDied","Data":"39e841dc54278203a320a6913774c28faac4ad56664a13e647f2a21c0fec3b5a"} Jun 09 11:15:56.601533 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.601510 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:15:56.626578 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.626555 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-online-tls\") pod \"5abbe345-60b0-4794-b6db-eaf86998ef9f\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " Jun 09 11:15:56.626693 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.626590 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-registry-tls\") pod \"5abbe345-60b0-4794-b6db-eaf86998ef9f\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " Jun 09 11:15:56.626693 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.626628 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-978qn\" (UniqueName: \"kubernetes.io/projected/5abbe345-60b0-4794-b6db-eaf86998ef9f-kube-api-access-978qn\") pod \"5abbe345-60b0-4794-b6db-eaf86998ef9f\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " Jun 09 11:15:56.626808 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.626719 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-ui-tls\") pod \"5abbe345-60b0-4794-b6db-eaf86998ef9f\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " Jun 09 11:15:56.626808 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.626797 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5abbe345-60b0-4794-b6db-eaf86998ef9f-feast-data\") pod \"5abbe345-60b0-4794-b6db-eaf86998ef9f\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " Jun 09 11:15:56.626936 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.626820 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-offline-tls\") pod \"5abbe345-60b0-4794-b6db-eaf86998ef9f\" (UID: \"5abbe345-60b0-4794-b6db-eaf86998ef9f\") " Jun 09 11:15:56.628580 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.628524 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5abbe345-60b0-4794-b6db-eaf86998ef9f-feast-data" (OuterVolumeSpecName: "feast-data") pod "5abbe345-60b0-4794-b6db-eaf86998ef9f" (UID: "5abbe345-60b0-4794-b6db-eaf86998ef9f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:15:56.629650 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.629622 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5abbe345-60b0-4794-b6db-eaf86998ef9f-kube-api-access-978qn" (OuterVolumeSpecName: "kube-api-access-978qn") pod "5abbe345-60b0-4794-b6db-eaf86998ef9f" (UID: "5abbe345-60b0-4794-b6db-eaf86998ef9f"). InnerVolumeSpecName "kube-api-access-978qn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:15:56.629650 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.629635 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-online-tls" (OuterVolumeSpecName: "online-tls") pod "5abbe345-60b0-4794-b6db-eaf86998ef9f" (UID: "5abbe345-60b0-4794-b6db-eaf86998ef9f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:15:56.629781 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.629691 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5abbe345-60b0-4794-b6db-eaf86998ef9f" (UID: "5abbe345-60b0-4794-b6db-eaf86998ef9f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:15:56.630041 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.629991 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5abbe345-60b0-4794-b6db-eaf86998ef9f" (UID: "5abbe345-60b0-4794-b6db-eaf86998ef9f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:15:56.630419 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.630386 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5abbe345-60b0-4794-b6db-eaf86998ef9f" (UID: "5abbe345-60b0-4794-b6db-eaf86998ef9f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:15:56.728638 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.728616 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5abbe345-60b0-4794-b6db-eaf86998ef9f-feast-data\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:15:56.728638 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.728636 2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-offline-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:15:56.728766 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.728644 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-online-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:15:56.728766 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.728653 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-registry-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:15:56.728766 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.728666 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-978qn\" (UniqueName: \"kubernetes.io/projected/5abbe345-60b0-4794-b6db-eaf86998ef9f-kube-api-access-978qn\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:15:56.728766 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:56.728675 2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5abbe345-60b0-4794-b6db-eaf86998ef9f-ui-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:15:57.414812 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:57.414768 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" event={"ID":"5abbe345-60b0-4794-b6db-eaf86998ef9f","Type":"ContainerDied","Data":"21855397645d46d60da4c691ac3dd96264841d3aecca7371ec62f8086849c7bd"} Jun 09 11:15:57.415264 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:57.414848 2558 scope.go:117] "RemoveContainer" containerID="1be34d81432fa954ef0c7191cb69bcde23cf2c68b64609ce618e04bcd8e8d7d7" Jun 09 11:15:57.415264 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:57.415117 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl" Jun 09 11:15:57.428637 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:57.428619 2558 scope.go:117] "RemoveContainer" containerID="792b46d46b9f496f7abba7189673c310c98e61efbbb0408404cd16ee551cf025" Jun 09 11:15:57.435639 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:57.435619 2558 scope.go:117] "RemoveContainer" containerID="17b2098d955d2cf0fe67cd54b32fa37fa5993b5174d9424fde6c3723a1b68e4a" Jun 09 11:15:57.440431 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:57.440409 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl"] Jun 09 11:15:57.443839 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:57.443820 2558 scope.go:117] "RemoveContainer" containerID="39e841dc54278203a320a6913774c28faac4ad56664a13e647f2a21c0fec3b5a" Jun 09 11:15:57.444329 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:57.444311 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-6kpzl"] Jun 09 11:15:57.450704 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:57.450686 2558 scope.go:117] "RemoveContainer" containerID="f5c1de70da0645488c2ede352d1771db15cb27c7a531f6c8173adbbcfced654d" Jun 09 11:15:57.457313 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:57.457298 2558 scope.go:117] "RemoveContainer" containerID="7a2dfb872646379b2a4a65784cd3d88bab5cdd053c7be7c2dda6b25963f12dad" Jun 09 11:15:58.490329 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:15:58.490296 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" path="/var/lib/kubelet/pods/5abbe345-60b0-4794-b6db-eaf86998ef9f/volumes" Jun 09 11:16:47.641415 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:47.641382 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:16:47.739996 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:47.739966 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:16:47.952948 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:47.952912 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:16:48.040139 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.040096 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:16:48.048799 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.048772 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n"] Jun 09 11:16:48.049057 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049042 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="feast-apply" Jun 09 11:16:48.049110 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049059 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="feast-apply" Jun 09 11:16:48.049110 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049070 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="feast-init" Jun 09 11:16:48.049110 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049076 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="feast-init" Jun 09 11:16:48.049110 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049087 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="online" Jun 09 11:16:48.049110 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049093 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="online" Jun 09 11:16:48.049110 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049099 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="ui" Jun 09 11:16:48.049110 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049104 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="ui" Jun 09 11:16:48.049110 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049111 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="registry" Jun 09 11:16:48.049353 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049117 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="registry" Jun 09 11:16:48.049353 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049134 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="offline" Jun 09 11:16:48.049353 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049141 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="offline" Jun 09 11:16:48.049353 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049183 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="offline" Jun 09 11:16:48.049353 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049190 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="ui" Jun 09 11:16:48.049353 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049197 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="registry" Jun 09 11:16:48.049353 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.049205 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5abbe345-60b0-4794-b6db-eaf86998ef9f" containerName="online" Jun 09 11:16:48.052224 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.052210 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.057525 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.057497 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jun 09 11:16:48.057662 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.057590 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jun 09 11:16:48.058032 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.057816 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Jun 09 11:16:48.058114 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.058060 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jun 09 11:16:48.058291 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.058267 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jun 09 11:16:48.058369 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.058302 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jun 09 11:16:48.058369 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.058310 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mtkdj\"" Jun 09 11:16:48.058478 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.058431 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jun 09 11:16:48.065511 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.065488 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n"] Jun 09 11:16:48.116339 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.116304 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:16:48.210268 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.210202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-online-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.210268 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.210233 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-offline-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.210268 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.210249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-feast-data\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.210268 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.210267 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-registry-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.210522 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.210300 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-ui-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.210522 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.210387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll6sc\" (UniqueName: \"kubernetes.io/projected/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-kube-api-access-ll6sc\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.216837 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.216808 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:16:48.310929 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.310906 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-online-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.311035 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.310933 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-offline-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.311035 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.310950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-feast-data\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.311035 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.310967 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-registry-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.311035 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.311000 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-ui-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.311242 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.311038 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll6sc\" (UniqueName: \"kubernetes.io/projected/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-kube-api-access-ll6sc\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.311242 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:16:48.311066 2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Jun 09 11:16:48.311242 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:16:48.311131 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-offline-tls podName:d6d2d666-6dd3-4286-a5a6-dc70e8986ae6 nodeName:}" failed. No retries permitted until 2026-06-09 11:16:48.811110755 +0000 UTC m=+564.719496058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-offline-tls") pod "feast-simple-feast-remote-setup-59cd7f8787-9mt2n" (UID: "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6") : secret "feast-simple-feast-remote-setup-offline-tls" not found Jun 09 11:16:48.311496 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.311465 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-feast-data\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.311743 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.311728 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-registry-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.313337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.313319 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-online-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.313425 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.313409 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-ui-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.319954 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.319936 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll6sc\" (UniqueName: \"kubernetes.io/projected/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-kube-api-access-ll6sc\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.454682 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.454647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:16:48.815323 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.815294 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-offline-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.817635 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.817614 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-offline-tls\") pod \"feast-simple-feast-remote-setup-59cd7f8787-9mt2n\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:48.966798 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:48.966774 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:16:49.111499 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:49.111468 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n"] Jun 09 11:16:49.112429 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:16:49.112401 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6d2d666_6dd3_4286_a5a6_dc70e8986ae6.slice/crio-3076126e7a6f7aed8316fe273cffae7ba1a858e621aebd4c7a17a5749dd45505 WatchSource:0}: Error finding container 3076126e7a6f7aed8316fe273cffae7ba1a858e621aebd4c7a17a5749dd45505: Status 404 returned error can't find the container with id 3076126e7a6f7aed8316fe273cffae7ba1a858e621aebd4c7a17a5749dd45505 Jun 09 11:16:49.595940 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:49.595905 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerStarted","Data":"737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da"} Jun 09 11:16:49.596129 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:49.595950 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerStarted","Data":"3076126e7a6f7aed8316fe273cffae7ba1a858e621aebd4c7a17a5749dd45505"} Jun 09 11:16:53.611813 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:53.611784 2558 generic.go:356] "Generic (PLEG): container finished" podID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerID="737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da" exitCode=0 Jun 09 11:16:53.612178 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:53.611838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerDied","Data":"737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da"} Jun 09 11:16:54.616689 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:54.616655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerStarted","Data":"f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3"} Jun 09 11:16:59.637706 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:59.637675 2558 generic.go:356] "Generic (PLEG): container finished" podID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerID="f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3" exitCode=0 Jun 09 11:16:59.638211 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:16:59.637751 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerDied","Data":"f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3"} Jun 09 11:17:00.645980 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:00.645940 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerStarted","Data":"6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779"} Jun 09 11:17:00.646471 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:00.645992 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerStarted","Data":"7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a"} Jun 09 11:17:00.646471 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:00.646007 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerStarted","Data":"8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c"} Jun 09 11:17:00.673407 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:00.673355 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podStartSLOduration=12.673338769 podStartE2EDuration="12.673338769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:17:00.672225501 +0000 UTC m=+576.580610828" watchObservedRunningTime="2026-06-09 11:17:00.673338769 +0000 UTC m=+576.581724094" Jun 09 11:17:00.967582 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:00.967540 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:00.967789 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:00.967702 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:00.967789 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:00.967725 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:00.969193 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:00.969149 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused" Jun 09 11:17:00.969335 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:00.969195 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 11:17:00.969335 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:00.969195 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jun 09 11:17:03.967809 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:03.967748 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused" Jun 09 11:17:03.968284 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:03.967762 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 11:17:03.968284 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:03.967767 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jun 09 11:17:06.968811 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:06.968781 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:06.969254 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:06.968923 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:06.969378 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:06.969347 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:06.969491 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:06.969392 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:06.969640 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:06.969623 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:06.969725 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:06.969711 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:06.972672 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:06.972654 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:07.674962 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:07.674926 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:07.677985 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:07.677959 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:17:07.907208 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:17:07.907174 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:09.212757 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.212693 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n"] Jun 09 11:18:09.213384 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.212935 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:09.213384 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.213239 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="online" containerID="cri-o://8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c" gracePeriod=30 Jun 09 11:18:09.213384 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.213318 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="offline" containerID="cri-o://7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a" gracePeriod=30 Jun 09 11:18:09.213561 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.213324 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="ui" containerID="cri-o://6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779" gracePeriod=30 Jun 09 11:18:09.310508 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.310475 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:09.330843 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.330813 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn"] Jun 09 11:18:09.331095 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.331066 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="registry" containerID="cri-o://f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97" gracePeriod=30 Jun 09 11:18:09.331389 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.331209 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="online" containerID="cri-o://6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857" gracePeriod=30 Jun 09 11:18:09.331517 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.331200 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="ui" containerID="cri-o://b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2" gracePeriod=30 Jun 09 11:18:09.331517 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.331249 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="offline" containerID="cri-o://79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228" gracePeriod=30 Jun 09 11:18:09.376477 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.376448 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:09.440729 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.440697 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:09.900887 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.900800 2558 generic.go:356] "Generic (PLEG): container finished" podID="51eed737-6e56-4a40-8930-82856361ca95" containerID="b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2" exitCode=0 Jun 09 11:18:09.901029 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.900883 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerDied","Data":"b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2"} Jun 09 11:18:09.903552 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.903532 2558 generic.go:356] "Generic (PLEG): container finished" podID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerID="6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779" exitCode=0 Jun 09 11:18:09.903642 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:09.903568 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerDied","Data":"6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779"} Jun 09 11:18:10.910548 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:10.910514 2558 generic.go:356] "Generic (PLEG): container finished" podID="51eed737-6e56-4a40-8930-82856361ca95" containerID="6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857" exitCode=0 Jun 09 11:18:10.910948 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:10.910590 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerDied","Data":"6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857"} Jun 09 11:18:10.913107 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:10.913086 2558 generic.go:356] "Generic (PLEG): container finished" podID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerID="8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c" exitCode=0 Jun 09 11:18:10.913229 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:10.913118 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerDied","Data":"8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c"} Jun 09 11:18:14.589781 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:14.589748 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:15.134228 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:15.134179 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Jun 09 11:18:15.365525 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:15.365482 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Jun 09 11:18:16.970225 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:16.970183 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 11:18:17.675198 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:17.675158 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jun 09 11:18:25.134653 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:25.134610 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Jun 09 11:18:25.366107 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:25.366069 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Jun 09 11:18:26.969684 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:26.969639 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 11:18:27.675809 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:27.675767 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jun 09 11:18:27.959054 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:27.959023 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:28.059819 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:28.059782 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:35.135149 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:35.135103 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Jun 09 11:18:35.135636 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:35.135225 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:18:35.366106 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:35.366064 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Jun 09 11:18:35.366278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:35.366205 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:18:36.969660 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:36.969618 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 11:18:36.970127 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:36.969753 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:18:37.675729 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:37.675683 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jun 09 11:18:37.675939 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:37.675821 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:18:39.435407 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.435386 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:18:39.531357 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.531279 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-ui-tls\") pod \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " Jun 09 11:18:39.531357 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.531316 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-online-tls\") pod \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " Jun 09 11:18:39.531357 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.531352 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-registry-tls\") pod \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " Jun 09 11:18:39.531590 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.531380 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll6sc\" (UniqueName: \"kubernetes.io/projected/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-kube-api-access-ll6sc\") pod \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " Jun 09 11:18:39.531590 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.531406 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-feast-data\") pod \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " Jun 09 11:18:39.531590 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.531477 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-offline-tls\") pod \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\" (UID: \"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6\") " Jun 09 11:18:39.531827 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.531794 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" (UID: "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:18:39.531979 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.531953 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-feast-data" (OuterVolumeSpecName: "feast-data") pod "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" (UID: "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:18:39.533666 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.533642 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-kube-api-access-ll6sc" (OuterVolumeSpecName: "kube-api-access-ll6sc") pod "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" (UID: "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6"). InnerVolumeSpecName "kube-api-access-ll6sc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:18:39.533755 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.533710 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" (UID: "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:18:39.533755 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.533746 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-online-tls" (OuterVolumeSpecName: "online-tls") pod "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" (UID: "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:18:39.533834 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.533785 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" (UID: "d6d2d666-6dd3-4286-a5a6-dc70e8986ae6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:18:39.632928 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.632897 2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-offline-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:39.632928 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.632923 2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-ui-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:39.633119 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.632951 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-online-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:39.633119 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.632960 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-registry-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:39.633119 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.632969 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll6sc\" (UniqueName: \"kubernetes.io/projected/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-kube-api-access-ll6sc\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:39.633119 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.632981 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6-feast-data\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:39.981797 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:39.981774 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:18:40.020408 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.020370 2558 generic.go:356] "Generic (PLEG): container finished" podID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerID="7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a" exitCode=137 Jun 09 11:18:40.020588 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.020436 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" Jun 09 11:18:40.020588 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.020450 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerDied","Data":"7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a"} Jun 09 11:18:40.020588 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.020512 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n" event={"ID":"d6d2d666-6dd3-4286-a5a6-dc70e8986ae6","Type":"ContainerDied","Data":"3076126e7a6f7aed8316fe273cffae7ba1a858e621aebd4c7a17a5749dd45505"} Jun 09 11:18:40.020588 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.020540 2558 scope.go:117] "RemoveContainer" containerID="6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779" Jun 09 11:18:40.023858 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.023836 2558 generic.go:356] "Generic (PLEG): container finished" podID="51eed737-6e56-4a40-8930-82856361ca95" containerID="79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228" exitCode=137 Jun 09 11:18:40.023858 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.023858 2558 generic.go:356] "Generic (PLEG): container finished" podID="51eed737-6e56-4a40-8930-82856361ca95" containerID="f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97" exitCode=137 Jun 09 11:18:40.024062 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.023912 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerDied","Data":"79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228"} Jun 09 11:18:40.024062 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.023942 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" Jun 09 11:18:40.024062 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.023973 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerDied","Data":"f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97"} Jun 09 11:18:40.024062 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.023996 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn" event={"ID":"51eed737-6e56-4a40-8930-82856361ca95","Type":"ContainerDied","Data":"e3788ef34895b9e6685a1c2d22d27c15234f0c883c7df09f39d3f4958c7ea92e"} Jun 09 11:18:40.030331 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.030313 2558 scope.go:117] "RemoveContainer" containerID="7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a" Jun 09 11:18:40.036106 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.036084 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvdgh\" (UniqueName: \"kubernetes.io/projected/51eed737-6e56-4a40-8930-82856361ca95-kube-api-access-fvdgh\") pod \"51eed737-6e56-4a40-8930-82856361ca95\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " Jun 09 11:18:40.036215 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.036118 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-ui-tls\") pod \"51eed737-6e56-4a40-8930-82856361ca95\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " Jun 09 11:18:40.036215 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.036171 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/51eed737-6e56-4a40-8930-82856361ca95-feast-data\") pod \"51eed737-6e56-4a40-8930-82856361ca95\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " Jun 09 11:18:40.036215 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.036195 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-registry-tls\") pod \"51eed737-6e56-4a40-8930-82856361ca95\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " Jun 09 11:18:40.036380 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.036221 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-online-tls\") pod \"51eed737-6e56-4a40-8930-82856361ca95\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " Jun 09 11:18:40.036380 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.036368 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-offline-tls\") pod \"51eed737-6e56-4a40-8930-82856361ca95\" (UID: \"51eed737-6e56-4a40-8930-82856361ca95\") " Jun 09 11:18:40.036786 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.036741 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51eed737-6e56-4a40-8930-82856361ca95-feast-data" (OuterVolumeSpecName: "feast-data") pod "51eed737-6e56-4a40-8930-82856361ca95" (UID: "51eed737-6e56-4a40-8930-82856361ca95"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:18:40.038051 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.037933 2558 scope.go:117] "RemoveContainer" containerID="8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c" Jun 09 11:18:40.043588 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.043569 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n"] Jun 09 11:18:40.045238 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.045195 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-online-tls" (OuterVolumeSpecName: "online-tls") pod "51eed737-6e56-4a40-8930-82856361ca95" (UID: "51eed737-6e56-4a40-8930-82856361ca95"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:18:40.045912 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.045894 2558 scope.go:117] "RemoveContainer" containerID="f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3" Jun 09 11:18:40.047177 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.047159 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-59cd7f8787-9mt2n"] Jun 09 11:18:40.053094 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.053079 2558 scope.go:117] "RemoveContainer" containerID="737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da" Jun 09 11:18:40.056213 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.056162 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "51eed737-6e56-4a40-8930-82856361ca95" (UID: "51eed737-6e56-4a40-8930-82856361ca95"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:18:40.056313 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.056252 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51eed737-6e56-4a40-8930-82856361ca95-kube-api-access-fvdgh" (OuterVolumeSpecName: "kube-api-access-fvdgh") pod "51eed737-6e56-4a40-8930-82856361ca95" (UID: "51eed737-6e56-4a40-8930-82856361ca95"). InnerVolumeSpecName "kube-api-access-fvdgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:18:40.056313 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.056277 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "51eed737-6e56-4a40-8930-82856361ca95" (UID: "51eed737-6e56-4a40-8930-82856361ca95"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:18:40.056313 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.056271 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "51eed737-6e56-4a40-8930-82856361ca95" (UID: "51eed737-6e56-4a40-8930-82856361ca95"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:18:40.059784 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.059765 2558 scope.go:117] "RemoveContainer" containerID="6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779" Jun 09 11:18:40.060029 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.060008 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779\": container with ID starting with 6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779 not found: ID does not exist" containerID="6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779" Jun 09 11:18:40.060080 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.060035 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779"} err="failed to get container status \"6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779\": rpc error: code = NotFound desc = could not find container \"6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779\": container with ID starting with 6a7d24e230938d68e73ab294d68680c5430d79a1825b81c39776f64803622779 not found: ID does not exist" Jun 09 11:18:40.060080 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.060054 2558 scope.go:117] "RemoveContainer" containerID="7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a" Jun 09 11:18:40.060278 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.060261 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a\": container with ID starting with 7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a not found: ID does not exist" containerID="7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a" Jun 09 11:18:40.060338 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.060287 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a"} err="failed to get container status \"7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a\": rpc error: code = NotFound desc = could not find container \"7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a\": container with ID starting with 7b5fff133ae234ff12ce799f48cca9f2dec30bded7b3f807a574425b74b0b45a not found: ID does not exist" Jun 09 11:18:40.060338 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.060309 2558 scope.go:117] "RemoveContainer" containerID="8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c" Jun 09 11:18:40.060559 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.060543 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c\": container with ID starting with 8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c not found: ID does not exist" containerID="8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c" Jun 09 11:18:40.060596 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.060563 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c"} err="failed to get container status \"8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c\": rpc error: code = NotFound desc = could not find container \"8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c\": container with ID starting with 8694098b9e6f3b2ed9b8cd5ee5ff4a567d54472aea11523ca5f196bbc940340c not found: ID does not exist" Jun 09 11:18:40.060596 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.060577 2558 scope.go:117] "RemoveContainer" containerID="f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3" Jun 09 11:18:40.060786 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.060770 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3\": container with ID starting with f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3 not found: ID does not exist" containerID="f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3" Jun 09 11:18:40.060831 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.060790 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3"} err="failed to get container status \"f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3\": rpc error: code = NotFound desc = could not find container \"f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3\": container with ID starting with f062e27d0e619be94b52f20c030f548253f824336ce7e7f18821efaf4b58bef3 not found: ID does not exist" Jun 09 11:18:40.060831 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.060803 2558 scope.go:117] "RemoveContainer" containerID="737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da" Jun 09 11:18:40.061042 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.061025 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da\": container with ID starting with 737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da not found: ID does not exist" containerID="737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da" Jun 09 11:18:40.061111 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.061048 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da"} err="failed to get container status \"737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da\": rpc error: code = NotFound desc = could not find container \"737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da\": container with ID starting with 737bdb76269ba3e060e086deb5d7429cb7e67a2a8bfdea502a3692b3912197da not found: ID does not exist" Jun 09 11:18:40.061111 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.061067 2558 scope.go:117] "RemoveContainer" containerID="b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2" Jun 09 11:18:40.067833 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.067819 2558 scope.go:117] "RemoveContainer" containerID="79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228" Jun 09 11:18:40.074396 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.074379 2558 scope.go:117] "RemoveContainer" containerID="6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857" Jun 09 11:18:40.081064 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.081046 2558 scope.go:117] "RemoveContainer" containerID="f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97" Jun 09 11:18:40.087496 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.087477 2558 scope.go:117] "RemoveContainer" containerID="b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b" Jun 09 11:18:40.093925 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.093904 2558 scope.go:117] "RemoveContainer" containerID="8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097" Jun 09 11:18:40.100279 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.100264 2558 scope.go:117] "RemoveContainer" containerID="b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2" Jun 09 11:18:40.100528 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.100510 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2\": container with ID starting with b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2 not found: ID does not exist" containerID="b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2" Jun 09 11:18:40.100578 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.100536 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2"} err="failed to get container status \"b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2\": rpc error: code = NotFound desc = could not find container \"b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2\": container with ID starting with b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2 not found: ID does not exist" Jun 09 11:18:40.100578 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.100555 2558 scope.go:117] "RemoveContainer" containerID="79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228" Jun 09 11:18:40.100772 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.100755 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228\": container with ID starting with 79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228 not found: ID does not exist" containerID="79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228" Jun 09 11:18:40.100837 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.100780 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228"} err="failed to get container status \"79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228\": rpc error: code = NotFound desc = could not find container \"79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228\": container with ID starting with 79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228 not found: ID does not exist" Jun 09 11:18:40.100837 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.100804 2558 scope.go:117] "RemoveContainer" containerID="6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857" Jun 09 11:18:40.101044 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.101019 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857\": container with ID starting with 6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857 not found: ID does not exist" containerID="6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857" Jun 09 11:18:40.101106 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.101051 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857"} err="failed to get container status \"6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857\": rpc error: code = NotFound desc = could not find container \"6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857\": container with ID starting with 6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857 not found: ID does not exist" Jun 09 11:18:40.101106 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.101070 2558 scope.go:117] "RemoveContainer" containerID="f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97" Jun 09 11:18:40.101294 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.101276 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97\": container with ID starting with f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97 not found: ID does not exist" containerID="f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97" Jun 09 11:18:40.101337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.101298 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97"} err="failed to get container status \"f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97\": rpc error: code = NotFound desc = could not find container \"f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97\": container with ID starting with f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97 not found: ID does not exist" Jun 09 11:18:40.101337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.101313 2558 scope.go:117] "RemoveContainer" containerID="b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b" Jun 09 11:18:40.101504 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.101487 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b\": container with ID starting with b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b not found: ID does not exist" containerID="b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b" Jun 09 11:18:40.101563 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.101510 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b"} err="failed to get container status \"b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b\": rpc error: code = NotFound desc = could not find container \"b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b\": container with ID starting with b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b not found: ID does not exist" Jun 09 11:18:40.101563 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.101533 2558 scope.go:117] "RemoveContainer" containerID="8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097" Jun 09 11:18:40.101779 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:18:40.101763 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097\": container with ID starting with 8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097 not found: ID does not exist" containerID="8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097" Jun 09 11:18:40.101817 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.101784 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097"} err="failed to get container status \"8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097\": rpc error: code = NotFound desc = could not find container \"8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097\": container with ID starting with 8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097 not found: ID does not exist" Jun 09 11:18:40.101817 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.101799 2558 scope.go:117] "RemoveContainer" containerID="b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2" Jun 09 11:18:40.102025 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.102008 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2"} err="failed to get container status \"b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2\": rpc error: code = NotFound desc = could not find container \"b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2\": container with ID starting with b1ce3cc847a74644359162a863e59c5fcdc93583471c7fd9e278e06b120fc3c2 not found: ID does not exist" Jun 09 11:18:40.102089 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.102025 2558 scope.go:117] "RemoveContainer" containerID="79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228" Jun 09 11:18:40.102213 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.102195 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228"} err="failed to get container status \"79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228\": rpc error: code = NotFound desc = could not find container \"79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228\": container with ID starting with 79daa423600909bd1bad46f9fc124d364f9ddd907dc0c49236a136be40999228 not found: ID does not exist" Jun 09 11:18:40.102255 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.102213 2558 scope.go:117] "RemoveContainer" containerID="6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857" Jun 09 11:18:40.102443 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.102425 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857"} err="failed to get container status \"6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857\": rpc error: code = NotFound desc = could not find container \"6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857\": container with ID starting with 6bb9179afb3dc87f4cee8cc3206f7846dea6d5a0d8355bd9b6acc02afae0e857 not found: ID does not exist" Jun 09 11:18:40.102481 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.102443 2558 scope.go:117] "RemoveContainer" containerID="f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97" Jun 09 11:18:40.102661 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.102643 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97"} err="failed to get container status \"f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97\": rpc error: code = NotFound desc = could not find container \"f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97\": container with ID starting with f03d679fd9947e815b4432d625afcee8ef7245267784120871680a9e9ba0ac97 not found: ID does not exist" Jun 09 11:18:40.102703 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.102662 2558 scope.go:117] "RemoveContainer" containerID="b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b" Jun 09 11:18:40.102849 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.102834 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b"} err="failed to get container status \"b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b\": rpc error: code = NotFound desc = could not find container \"b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b\": container with ID starting with b54967d7a900d2151da7358fc83eaa65acc0d61b8da78d3176aaf9185b40461b not found: ID does not exist" Jun 09 11:18:40.102932 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.102849 2558 scope.go:117] "RemoveContainer" containerID="8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097" Jun 09 11:18:40.103070 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.103055 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097"} err="failed to get container status \"8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097\": rpc error: code = NotFound desc = could not find container \"8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097\": container with ID starting with 8a7dc40254e89b4dda50f2b16bf5539774386303325a866c8e12fd69ce684097 not found: ID does not exist" Jun 09 11:18:40.137583 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.137560 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/51eed737-6e56-4a40-8930-82856361ca95-feast-data\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:40.137583 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.137580 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-registry-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:40.137716 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.137588 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-online-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:40.137716 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.137596 2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-offline-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:40.137716 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.137605 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvdgh\" (UniqueName: \"kubernetes.io/projected/51eed737-6e56-4a40-8930-82856361ca95-kube-api-access-fvdgh\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:40.137716 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.137615 2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/51eed737-6e56-4a40-8930-82856361ca95-ui-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:18:40.346792 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.346744 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn"] Jun 09 11:18:40.351007 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.350953 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b67b7bdb8-qb5zn"] Jun 09 11:18:40.491198 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.491170 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51eed737-6e56-4a40-8930-82856361ca95" path="/var/lib/kubelet/pods/51eed737-6e56-4a40-8930-82856361ca95/volumes" Jun 09 11:18:40.491838 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:40.491824 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" path="/var/lib/kubelet/pods/d6d2d666-6dd3-4286-a5a6-dc70e8986ae6/volumes" Jun 09 11:18:44.053814 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:44.053780 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:44.112832 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:44.112798 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:52.231495 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.231465 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:52.444686 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.444650 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-s24p6"] Jun 09 11:18:52.445033 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445016 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="feast-apply" Jun 09 11:18:52.445033 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445035 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="feast-apply" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445046 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="online" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445054 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="online" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445065 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="ui" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445072 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="ui" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445081 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="registry" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445086 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="registry" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445100 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="offline" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445104 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="offline" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445110 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="ui" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445116 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="ui" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445124 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="feast-init" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445129 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="feast-init" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445136 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="feast-apply" Jun 09 11:18:52.445137 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445142 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="feast-apply" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445149 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="feast-init" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445154 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="feast-init" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445161 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="online" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445166 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="online" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445171 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="offline" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445176 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="offline" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445211 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="ui" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445217 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="ui" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445231 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="offline" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445237 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="online" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445242 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="registry" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445246 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51eed737-6e56-4a40-8930-82856361ca95" containerName="offline" Jun 09 11:18:52.445539 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.445251 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6d2d666-6dd3-4286-a5a6-dc70e8986ae6" containerName="online" Jun 09 11:18:52.448123 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.448107 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-s24p6" Jun 09 11:18:52.450834 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.450812 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Jun 09 11:18:52.451958 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.451938 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-ssk8f\"" Jun 09 11:18:52.451958 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.451955 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jun 09 11:18:52.452097 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.451984 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jun 09 11:18:52.455479 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.455457 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-s24p6"] Jun 09 11:18:52.475850 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.475828 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-mg9bt"] Jun 09 11:18:52.478897 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.478863 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-mg9bt" Jun 09 11:18:52.483800 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.483736 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:52.486500 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.486476 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-mg9bt"] Jun 09 11:18:52.514931 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.514906 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s2rc\" (UniqueName: \"kubernetes.io/projected/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-kube-api-access-5s2rc\") pod \"postgres-864846d4f5-s24p6\" (UID: \"02cf54ce-3fdc-43e3-a552-a234cb37e9a9\") " pod="test-ns-feast/postgres-864846d4f5-s24p6" Jun 09 11:18:52.515040 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.514943 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-postgresdata\") pod \"postgres-864846d4f5-s24p6\" (UID: \"02cf54ce-3fdc-43e3-a552-a234cb37e9a9\") " pod="test-ns-feast/postgres-864846d4f5-s24p6" Jun 09 11:18:52.515040 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.514973 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvdkd\" (UniqueName: \"kubernetes.io/projected/252bcba0-43e2-45e6-bd5f-b51a0d0515cb-kube-api-access-vvdkd\") pod \"redis-69bbd798b6-mg9bt\" (UID: \"252bcba0-43e2-45e6-bd5f-b51a0d0515cb\") " pod="test-ns-feast/redis-69bbd798b6-mg9bt" Jun 09 11:18:52.540272 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.540246 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:18:52.615375 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.615346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvdkd\" (UniqueName: \"kubernetes.io/projected/252bcba0-43e2-45e6-bd5f-b51a0d0515cb-kube-api-access-vvdkd\") pod \"redis-69bbd798b6-mg9bt\" (UID: \"252bcba0-43e2-45e6-bd5f-b51a0d0515cb\") " pod="test-ns-feast/redis-69bbd798b6-mg9bt" Jun 09 11:18:52.615492 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.615425 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s2rc\" (UniqueName: \"kubernetes.io/projected/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-kube-api-access-5s2rc\") pod \"postgres-864846d4f5-s24p6\" (UID: \"02cf54ce-3fdc-43e3-a552-a234cb37e9a9\") " pod="test-ns-feast/postgres-864846d4f5-s24p6" Jun 09 11:18:52.615492 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.615453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-postgresdata\") pod \"postgres-864846d4f5-s24p6\" (UID: \"02cf54ce-3fdc-43e3-a552-a234cb37e9a9\") " pod="test-ns-feast/postgres-864846d4f5-s24p6" Jun 09 11:18:52.615938 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.615915 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-postgresdata\") pod \"postgres-864846d4f5-s24p6\" (UID: \"02cf54ce-3fdc-43e3-a552-a234cb37e9a9\") " pod="test-ns-feast/postgres-864846d4f5-s24p6" Jun 09 11:18:52.624714 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.624685 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvdkd\" (UniqueName: \"kubernetes.io/projected/252bcba0-43e2-45e6-bd5f-b51a0d0515cb-kube-api-access-vvdkd\") pod \"redis-69bbd798b6-mg9bt\" (UID: \"252bcba0-43e2-45e6-bd5f-b51a0d0515cb\") " pod="test-ns-feast/redis-69bbd798b6-mg9bt" Jun 09 11:18:52.624800 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.624685 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s2rc\" (UniqueName: \"kubernetes.io/projected/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-kube-api-access-5s2rc\") pod \"postgres-864846d4f5-s24p6\" (UID: \"02cf54ce-3fdc-43e3-a552-a234cb37e9a9\") " pod="test-ns-feast/postgres-864846d4f5-s24p6" Jun 09 11:18:52.773724 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.773654 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-s24p6" Jun 09 11:18:52.789487 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.789464 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-mg9bt" Jun 09 11:18:52.905126 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.905097 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-s24p6"] Jun 09 11:18:52.908318 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:18:52.908288 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02cf54ce_3fdc_43e3_a552_a234cb37e9a9.slice/crio-4a6eeddfbe2c1c6a1196d1e6a54a1c82b97165307d53f503453dde128e4d2985 WatchSource:0}: Error finding container 4a6eeddfbe2c1c6a1196d1e6a54a1c82b97165307d53f503453dde128e4d2985: Status 404 returned error can't find the container with id 4a6eeddfbe2c1c6a1196d1e6a54a1c82b97165307d53f503453dde128e4d2985 Jun 09 11:18:52.910095 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.910080 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:18:52.923848 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:52.923823 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-mg9bt"] Jun 09 11:18:52.927272 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:18:52.927251 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod252bcba0_43e2_45e6_bd5f_b51a0d0515cb.slice/crio-2a22c257cde2cad1d49c6dd0f1311f8bf7083f9bb2f7d7416925a1a4d00a67a6 WatchSource:0}: Error finding container 2a22c257cde2cad1d49c6dd0f1311f8bf7083f9bb2f7d7416925a1a4d00a67a6: Status 404 returned error can't find the container with id 2a22c257cde2cad1d49c6dd0f1311f8bf7083f9bb2f7d7416925a1a4d00a67a6 Jun 09 11:18:53.071801 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:53.071718 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-s24p6" event={"ID":"02cf54ce-3fdc-43e3-a552-a234cb37e9a9","Type":"ContainerStarted","Data":"4a6eeddfbe2c1c6a1196d1e6a54a1c82b97165307d53f503453dde128e4d2985"} Jun 09 11:18:53.072754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:53.072732 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-mg9bt" event={"ID":"252bcba0-43e2-45e6-bd5f-b51a0d0515cb","Type":"ContainerStarted","Data":"2a22c257cde2cad1d49c6dd0f1311f8bf7083f9bb2f7d7416925a1a4d00a67a6"} Jun 09 11:18:55.082958 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:55.082918 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-mg9bt" event={"ID":"252bcba0-43e2-45e6-bd5f-b51a0d0515cb","Type":"ContainerStarted","Data":"b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e"} Jun 09 11:18:55.100281 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:55.100227 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-mg9bt" podStartSLOduration=1.459541626 podStartE2EDuration="3.100208508s" totalImagesPullingTime="1.640666882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:18:55.099221373 +0000 UTC m=+691.007606701" watchObservedRunningTime="2026-06-09 11:18:55.100208508 +0000 UTC m=+691.008593830" Jun 09 11:18:59.102288 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:59.102251 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-s24p6" event={"ID":"02cf54ce-3fdc-43e3-a552-a234cb37e9a9","Type":"ContainerStarted","Data":"7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b"} Jun 09 11:18:59.121100 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:18:59.121053 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-s24p6" podStartSLOduration=1.5702741 podStartE2EDuration="7.121037808s" totalImagesPullingTime="5.550763708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:18:59.119903993 +0000 UTC m=+695.028289316" watchObservedRunningTime="2026-06-09 11:18:59.121037808 +0000 UTC m=+695.029423133" Jun 09 11:19:02.973613 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:02.973572 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:19:03.052907 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.052856 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:19:03.057413 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.057386 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-84c4c74b-lpswh"] Jun 09 11:19:03.060563 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.060547 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.063163 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.063133 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jun 09 11:19:03.063294 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.063179 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Jun 09 11:19:03.063363 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.063299 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Jun 09 11:19:03.063660 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.063636 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-h4ndf\"" Jun 09 11:19:03.063805 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.063790 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Jun 09 11:19:03.074029 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.074008 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c4c74b-lpswh"] Jun 09 11:19:03.200048 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.200021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-registry-tls\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.200190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.200051 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/97fec3fd-e616-4c62-a388-007807e5154e-feast-data\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.200190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.200070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-online-tls\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.200190 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.200101 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-offline-tls\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.200313 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.200200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvj97\" (UniqueName: \"kubernetes.io/projected/97fec3fd-e616-4c62-a388-007807e5154e-kube-api-access-dvj97\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.211013 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.210988 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:19:03.301169 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.301110 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvj97\" (UniqueName: \"kubernetes.io/projected/97fec3fd-e616-4c62-a388-007807e5154e-kube-api-access-dvj97\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.301169 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.301147 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-registry-tls\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.301169 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.301165 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/97fec3fd-e616-4c62-a388-007807e5154e-feast-data\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.301377 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.301180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-online-tls\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.301377 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.301293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-offline-tls\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.301594 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.301574 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/97fec3fd-e616-4c62-a388-007807e5154e-feast-data\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.303615 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.303589 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-online-tls\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.303703 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.303630 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-registry-tls\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.303760 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.303740 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-offline-tls\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.309686 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.309658 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvj97\" (UniqueName: \"kubernetes.io/projected/97fec3fd-e616-4c62-a388-007807e5154e-kube-api-access-dvj97\") pod \"feast-credit-scoring-84c4c74b-lpswh\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.311202 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.311175 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:19:03.369188 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.369168 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:03.411990 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.411960 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:19:03.504208 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:03.504184 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c4c74b-lpswh"] Jun 09 11:19:03.506729 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:19:03.506704 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fec3fd_e616_4c62_a388_007807e5154e.slice/crio-357b6f648a3b28d62a89d7a60880b602e00119ec212b23563e86fc64a215a26c WatchSource:0}: Error finding container 357b6f648a3b28d62a89d7a60880b602e00119ec212b23563e86fc64a215a26c: Status 404 returned error can't find the container with id 357b6f648a3b28d62a89d7a60880b602e00119ec212b23563e86fc64a215a26c Jun 09 11:19:04.121059 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:04.121029 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerStarted","Data":"1027eb61d7c88231bc60d432a6cfaaee3b6157637020eb6e133cc270670a2f11"} Jun 09 11:19:04.121424 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:04.121079 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerStarted","Data":"357b6f648a3b28d62a89d7a60880b602e00119ec212b23563e86fc64a215a26c"} Jun 09 11:19:05.125625 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:05.125592 2558 generic.go:356] "Generic (PLEG): container finished" podID="97fec3fd-e616-4c62-a388-007807e5154e" containerID="1027eb61d7c88231bc60d432a6cfaaee3b6157637020eb6e133cc270670a2f11" exitCode=0 Jun 09 11:19:05.126012 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:05.125640 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerDied","Data":"1027eb61d7c88231bc60d432a6cfaaee3b6157637020eb6e133cc270670a2f11"} Jun 09 11:19:06.135969 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:06.135932 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerStarted","Data":"d86fe82206b6830bd53f27e5fcfab9e48f79fd80a1e3e7cf4bd69ecd215b3886"} Jun 09 11:19:12.158992 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:12.158958 2558 generic.go:356] "Generic (PLEG): container finished" podID="97fec3fd-e616-4c62-a388-007807e5154e" containerID="d86fe82206b6830bd53f27e5fcfab9e48f79fd80a1e3e7cf4bd69ecd215b3886" exitCode=0 Jun 09 11:19:12.158992 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:12.158995 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerDied","Data":"d86fe82206b6830bd53f27e5fcfab9e48f79fd80a1e3e7cf4bd69ecd215b3886"} Jun 09 11:19:13.167237 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:13.167203 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerStarted","Data":"3472c80e7e5e2b0da425bec2e6a5625c64561b8e694c2eba35159dde02786332"} Jun 09 11:19:13.167719 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:13.167263 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerStarted","Data":"913fa1e03e3382f842a48a1028536f78a01e682b48c13a814a9e596920be316c"} Jun 09 11:19:13.167719 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:13.167281 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerStarted","Data":"0c6a4036e9c26fb14a6b431ccdb98150cbe59fda2bf74781822affe0c5766dbf"} Jun 09 11:19:13.194159 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:13.194100 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podStartSLOduration=10.194079975 podStartE2EDuration="10.194079975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:19:13.192045419 +0000 UTC m=+709.100430746" watchObservedRunningTime="2026-06-09 11:19:13.194079975 +0000 UTC m=+709.102465301" Jun 09 11:19:13.370127 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:13.370091 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:13.370325 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:13.370150 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:13.370325 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:13.370172 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:15.370380 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:15.370338 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:15.370797 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:15.370429 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:15.370797 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:15.370458 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:15.372452 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:15.372414 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused" Jun 09 11:19:15.372609 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:15.372457 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jun 09 11:19:15.372609 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:15.372460 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Jun 09 11:19:18.370170 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:18.370123 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Jun 09 11:19:18.371110 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:18.371089 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:18.372003 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:18.371981 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:18.375203 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:18.375186 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:19.197306 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:19.197276 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:21.370150 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:21.370099 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Jun 09 11:19:24.370845 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:24.370811 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:24.371502 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:24.371483 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:19:24.603846 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:19:24.603801 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:20:19.510904 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:19.510851 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:20:24.479487 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.479455 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c4c74b-lpswh"] Jun 09 11:20:24.480103 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.479687 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="registry" containerID="cri-o://0c6a4036e9c26fb14a6b431ccdb98150cbe59fda2bf74781822affe0c5766dbf" gracePeriod=30 Jun 09 11:20:24.480103 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.479787 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="online" containerID="cri-o://913fa1e03e3382f842a48a1028536f78a01e682b48c13a814a9e596920be316c" gracePeriod=30 Jun 09 11:20:24.480103 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.479783 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="offline" containerID="cri-o://3472c80e7e5e2b0da425bec2e6a5625c64561b8e694c2eba35159dde02786332" gracePeriod=30 Jun 09 11:20:24.500253 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.500226 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-s24p6"] Jun 09 11:20:24.500440 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.500406 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-s24p6" podUID="02cf54ce-3fdc-43e3-a552-a234cb37e9a9" containerName="postgres" containerID="cri-o://7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b" gracePeriod=30 Jun 09 11:20:24.507262 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.506816 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-mg9bt"] Jun 09 11:20:24.507262 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.507040 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-mg9bt" podUID="252bcba0-43e2-45e6-bd5f-b51a0d0515cb" containerName="redis" containerID="cri-o://b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e" gracePeriod=30 Jun 09 11:20:24.558442 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.558411 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:20:24.771623 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.771601 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-s24p6" Jun 09 11:20:24.774452 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.774434 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-mg9bt" Jun 09 11:20:24.943590 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.943557 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s2rc\" (UniqueName: \"kubernetes.io/projected/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-kube-api-access-5s2rc\") pod \"02cf54ce-3fdc-43e3-a552-a234cb37e9a9\" (UID: \"02cf54ce-3fdc-43e3-a552-a234cb37e9a9\") " Jun 09 11:20:24.943590 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.943594 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-postgresdata\") pod \"02cf54ce-3fdc-43e3-a552-a234cb37e9a9\" (UID: \"02cf54ce-3fdc-43e3-a552-a234cb37e9a9\") " Jun 09 11:20:24.943786 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.943623 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvdkd\" (UniqueName: \"kubernetes.io/projected/252bcba0-43e2-45e6-bd5f-b51a0d0515cb-kube-api-access-vvdkd\") pod \"252bcba0-43e2-45e6-bd5f-b51a0d0515cb\" (UID: \"252bcba0-43e2-45e6-bd5f-b51a0d0515cb\") " Jun 09 11:20:24.945709 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.945678 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/252bcba0-43e2-45e6-bd5f-b51a0d0515cb-kube-api-access-vvdkd" (OuterVolumeSpecName: "kube-api-access-vvdkd") pod "252bcba0-43e2-45e6-bd5f-b51a0d0515cb" (UID: "252bcba0-43e2-45e6-bd5f-b51a0d0515cb"). InnerVolumeSpecName "kube-api-access-vvdkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:20:24.945709 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.945703 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-kube-api-access-5s2rc" (OuterVolumeSpecName: "kube-api-access-5s2rc") pod "02cf54ce-3fdc-43e3-a552-a234cb37e9a9" (UID: "02cf54ce-3fdc-43e3-a552-a234cb37e9a9"). InnerVolumeSpecName "kube-api-access-5s2rc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:20:24.976796 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:24.976765 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "02cf54ce-3fdc-43e3-a552-a234cb37e9a9" (UID: "02cf54ce-3fdc-43e3-a552-a234cb37e9a9"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:20:25.045242 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.045156 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s2rc\" (UniqueName: \"kubernetes.io/projected/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-kube-api-access-5s2rc\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:20:25.045242 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.045189 2558 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/02cf54ce-3fdc-43e3-a552-a234cb37e9a9-postgresdata\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:20:25.045242 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.045198 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvdkd\" (UniqueName: \"kubernetes.io/projected/252bcba0-43e2-45e6-bd5f-b51a0d0515cb-kube-api-access-vvdkd\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:20:25.198348 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.198297 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:20:25.449603 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.449575 2558 generic.go:356] "Generic (PLEG): container finished" podID="02cf54ce-3fdc-43e3-a552-a234cb37e9a9" containerID="7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b" exitCode=0 Jun 09 11:20:25.449724 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.449616 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-s24p6" Jun 09 11:20:25.449724 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.449660 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-s24p6" event={"ID":"02cf54ce-3fdc-43e3-a552-a234cb37e9a9","Type":"ContainerDied","Data":"7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b"} Jun 09 11:20:25.449724 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.449702 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-s24p6" event={"ID":"02cf54ce-3fdc-43e3-a552-a234cb37e9a9","Type":"ContainerDied","Data":"4a6eeddfbe2c1c6a1196d1e6a54a1c82b97165307d53f503453dde128e4d2985"} Jun 09 11:20:25.449847 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.449726 2558 scope.go:117] "RemoveContainer" containerID="7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b" Jun 09 11:20:25.452741 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.452721 2558 generic.go:356] "Generic (PLEG): container finished" podID="97fec3fd-e616-4c62-a388-007807e5154e" containerID="913fa1e03e3382f842a48a1028536f78a01e682b48c13a814a9e596920be316c" exitCode=0 Jun 09 11:20:25.452883 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.452809 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerDied","Data":"913fa1e03e3382f842a48a1028536f78a01e682b48c13a814a9e596920be316c"} Jun 09 11:20:25.454199 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.454177 2558 generic.go:356] "Generic (PLEG): container finished" podID="252bcba0-43e2-45e6-bd5f-b51a0d0515cb" containerID="b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e" exitCode=0 Jun 09 11:20:25.454326 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.454213 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-mg9bt" event={"ID":"252bcba0-43e2-45e6-bd5f-b51a0d0515cb","Type":"ContainerDied","Data":"b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e"} Jun 09 11:20:25.454326 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.454225 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-mg9bt" Jun 09 11:20:25.454326 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.454238 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-mg9bt" event={"ID":"252bcba0-43e2-45e6-bd5f-b51a0d0515cb","Type":"ContainerDied","Data":"2a22c257cde2cad1d49c6dd0f1311f8bf7083f9bb2f7d7416925a1a4d00a67a6"} Jun 09 11:20:25.459006 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.458989 2558 scope.go:117] "RemoveContainer" containerID="7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b" Jun 09 11:20:25.459254 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:20:25.459236 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b\": container with ID starting with 7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b not found: ID does not exist" containerID="7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b" Jun 09 11:20:25.459302 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.459262 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b"} err="failed to get container status \"7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b\": rpc error: code = NotFound desc = could not find container \"7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b\": container with ID starting with 7c01141d6af938ec50139aaa0d8a4a913c053616fb360d232ea5395f9168e29b not found: ID does not exist" Jun 09 11:20:25.459302 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.459278 2558 scope.go:117] "RemoveContainer" containerID="b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e" Jun 09 11:20:25.467162 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.467146 2558 scope.go:117] "RemoveContainer" containerID="b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e" Jun 09 11:20:25.467414 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:20:25.467397 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e\": container with ID starting with b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e not found: ID does not exist" containerID="b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e" Jun 09 11:20:25.467469 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.467420 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e"} err="failed to get container status \"b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e\": rpc error: code = NotFound desc = could not find container \"b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e\": container with ID starting with b69a2522e7e1213381306dd2bbc427ebb7b08e9b9edf3fc63e0cc900ce98981e not found: ID does not exist" Jun 09 11:20:25.470010 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.469989 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-s24p6"] Jun 09 11:20:25.473774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.473756 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-s24p6"] Jun 09 11:20:25.485393 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.485371 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-mg9bt"] Jun 09 11:20:25.489758 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:25.489738 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-mg9bt"] Jun 09 11:20:26.490775 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:26.490742 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02cf54ce-3fdc-43e3-a552-a234cb37e9a9" path="/var/lib/kubelet/pods/02cf54ce-3fdc-43e3-a552-a234cb37e9a9/volumes" Jun 09 11:20:26.491150 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:26.491051 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="252bcba0-43e2-45e6-bd5f-b51a0d0515cb" path="/var/lib/kubelet/pods/252bcba0-43e2-45e6-bd5f-b51a0d0515cb/volumes" Jun 09 11:20:29.194711 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:29.194673 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jun 09 11:20:39.194609 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:39.194566 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jun 09 11:20:49.195161 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:49.195060 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jun 09 11:20:49.195605 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:49.195214 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:20:54.557155 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:54.557125 2558 generic.go:356] "Generic (PLEG): container finished" podID="97fec3fd-e616-4c62-a388-007807e5154e" containerID="3472c80e7e5e2b0da425bec2e6a5625c64561b8e694c2eba35159dde02786332" exitCode=137 Jun 09 11:20:54.557155 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:54.557151 2558 generic.go:356] "Generic (PLEG): container finished" podID="97fec3fd-e616-4c62-a388-007807e5154e" containerID="0c6a4036e9c26fb14a6b431ccdb98150cbe59fda2bf74781822affe0c5766dbf" exitCode=137 Jun 09 11:20:54.557544 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:54.557180 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerDied","Data":"3472c80e7e5e2b0da425bec2e6a5625c64561b8e694c2eba35159dde02786332"} Jun 09 11:20:54.557544 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:54.557226 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerDied","Data":"0c6a4036e9c26fb14a6b431ccdb98150cbe59fda2bf74781822affe0c5766dbf"} Jun 09 11:20:55.130979 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.130955 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:20:55.160792 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.160761 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-offline-tls\") pod \"97fec3fd-e616-4c62-a388-007807e5154e\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " Jun 09 11:20:55.161091 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.161061 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/97fec3fd-e616-4c62-a388-007807e5154e-feast-data\") pod \"97fec3fd-e616-4c62-a388-007807e5154e\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " Jun 09 11:20:55.161208 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.161105 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvj97\" (UniqueName: \"kubernetes.io/projected/97fec3fd-e616-4c62-a388-007807e5154e-kube-api-access-dvj97\") pod \"97fec3fd-e616-4c62-a388-007807e5154e\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " Jun 09 11:20:55.161208 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.161157 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-online-tls\") pod \"97fec3fd-e616-4c62-a388-007807e5154e\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " Jun 09 11:20:55.161332 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.161227 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-registry-tls\") pod \"97fec3fd-e616-4c62-a388-007807e5154e\" (UID: \"97fec3fd-e616-4c62-a388-007807e5154e\") " Jun 09 11:20:55.164154 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.164126 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "97fec3fd-e616-4c62-a388-007807e5154e" (UID: "97fec3fd-e616-4c62-a388-007807e5154e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:20:55.164154 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.164145 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "97fec3fd-e616-4c62-a388-007807e5154e" (UID: "97fec3fd-e616-4c62-a388-007807e5154e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:20:55.164292 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.164145 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97fec3fd-e616-4c62-a388-007807e5154e-kube-api-access-dvj97" (OuterVolumeSpecName: "kube-api-access-dvj97") pod "97fec3fd-e616-4c62-a388-007807e5154e" (UID: "97fec3fd-e616-4c62-a388-007807e5154e"). InnerVolumeSpecName "kube-api-access-dvj97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:20:55.164521 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.164486 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-online-tls" (OuterVolumeSpecName: "online-tls") pod "97fec3fd-e616-4c62-a388-007807e5154e" (UID: "97fec3fd-e616-4c62-a388-007807e5154e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:20:55.170069 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.170045 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97fec3fd-e616-4c62-a388-007807e5154e-feast-data" (OuterVolumeSpecName: "feast-data") pod "97fec3fd-e616-4c62-a388-007807e5154e" (UID: "97fec3fd-e616-4c62-a388-007807e5154e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:20:55.262239 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.262141 2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-offline-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:20:55.262239 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.262174 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/97fec3fd-e616-4c62-a388-007807e5154e-feast-data\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:20:55.262239 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.262187 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvj97\" (UniqueName: \"kubernetes.io/projected/97fec3fd-e616-4c62-a388-007807e5154e-kube-api-access-dvj97\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:20:55.262239 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.262199 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-online-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:20:55.262239 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.262210 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/97fec3fd-e616-4c62-a388-007807e5154e-registry-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:20:55.564197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.564108 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" event={"ID":"97fec3fd-e616-4c62-a388-007807e5154e","Type":"ContainerDied","Data":"357b6f648a3b28d62a89d7a60880b602e00119ec212b23563e86fc64a215a26c"} Jun 09 11:20:55.564197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.564140 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c4c74b-lpswh" Jun 09 11:20:55.564197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.564175 2558 scope.go:117] "RemoveContainer" containerID="3472c80e7e5e2b0da425bec2e6a5625c64561b8e694c2eba35159dde02786332" Jun 09 11:20:55.576145 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.576126 2558 scope.go:117] "RemoveContainer" containerID="913fa1e03e3382f842a48a1028536f78a01e682b48c13a814a9e596920be316c" Jun 09 11:20:55.583581 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.583556 2558 scope.go:117] "RemoveContainer" containerID="0c6a4036e9c26fb14a6b431ccdb98150cbe59fda2bf74781822affe0c5766dbf" Jun 09 11:20:55.589619 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.589596 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c4c74b-lpswh"] Jun 09 11:20:55.591431 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.591411 2558 scope.go:117] "RemoveContainer" containerID="d86fe82206b6830bd53f27e5fcfab9e48f79fd80a1e3e7cf4bd69ecd215b3886" Jun 09 11:20:55.596402 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.596365 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c4c74b-lpswh"] Jun 09 11:20:55.598990 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:55.598963 2558 scope.go:117] "RemoveContainer" containerID="1027eb61d7c88231bc60d432a6cfaaee3b6157637020eb6e133cc270670a2f11" Jun 09 11:20:56.490605 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:20:56.490563 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97fec3fd-e616-4c62-a388-007807e5154e" path="/var/lib/kubelet/pods/97fec3fd-e616-4c62-a388-007807e5154e/volumes" Jun 09 11:21:02.441518 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:21:02.441465 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:21:02.541048 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:21:02.541016 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:21:02.606021 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:21:02.605973 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:21:03.018031 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:21:03.017999 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:22:42.585253 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.585215 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:22:42.800834 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.800805 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rxzjj"] Jun 09 11:22:42.801131 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801117 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252bcba0-43e2-45e6-bd5f-b51a0d0515cb" containerName="redis" Jun 09 11:22:42.801177 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801133 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="252bcba0-43e2-45e6-bd5f-b51a0d0515cb" containerName="redis" Jun 09 11:22:42.801177 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801142 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="offline" Jun 09 11:22:42.801177 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801147 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="offline" Jun 09 11:22:42.801177 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801159 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cf54ce-3fdc-43e3-a552-a234cb37e9a9" containerName="postgres" Jun 09 11:22:42.801177 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801164 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cf54ce-3fdc-43e3-a552-a234cb37e9a9" containerName="postgres" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801187 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="feast-apply" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801192 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="feast-apply" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801203 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="registry" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801208 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="registry" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801215 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="feast-init" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801221 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="feast-init" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801226 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="online" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801231 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="online" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801278 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="02cf54ce-3fdc-43e3-a552-a234cb37e9a9" containerName="postgres" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801285 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="registry" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801292 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="252bcba0-43e2-45e6-bd5f-b51a0d0515cb" containerName="redis" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801297 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="online" Jun 09 11:22:42.801337 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.801302 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="97fec3fd-e616-4c62-a388-007807e5154e" containerName="offline" Jun 09 11:22:42.804058 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.804044 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" Jun 09 11:22:42.806777 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.806757 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Jun 09 11:22:42.806919 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.806797 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Jun 09 11:22:42.807920 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.807897 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-qkzqb\"" Jun 09 11:22:42.817926 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.817907 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rxzjj"] Jun 09 11:22:42.823086 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.823069 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d22h7\" (UniqueName: \"kubernetes.io/projected/cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62-kube-api-access-d22h7\") pod \"redis-69bbd798b6-rxzjj\" (UID: \"cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62\") " pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" Jun 09 11:22:42.924295 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.924202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d22h7\" (UniqueName: \"kubernetes.io/projected/cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62-kube-api-access-d22h7\") pod \"redis-69bbd798b6-rxzjj\" (UID: \"cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62\") " pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" Jun 09 11:22:42.932843 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:42.932807 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d22h7\" (UniqueName: \"kubernetes.io/projected/cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62-kube-api-access-d22h7\") pod \"redis-69bbd798b6-rxzjj\" (UID: \"cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62\") " pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" Jun 09 11:22:43.124716 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:43.124683 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" Jun 09 11:22:43.248299 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:43.248266 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rxzjj"] Jun 09 11:22:43.251425 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:22:43.251399 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd0ba5db_3630_4f35_9c7e_f2d6b4fcaa62.slice/crio-f1e5af004db1832491f6e9e9e4b673fcd263881d99637ab940ce5a6b3bb44297 WatchSource:0}: Error finding container f1e5af004db1832491f6e9e9e4b673fcd263881d99637ab940ce5a6b3bb44297: Status 404 returned error can't find the container with id f1e5af004db1832491f6e9e9e4b673fcd263881d99637ab940ce5a6b3bb44297 Jun 09 11:22:43.554681 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:43.554605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:22:43.927328 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:43.927238 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" event={"ID":"cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62","Type":"ContainerStarted","Data":"9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17"} Jun 09 11:22:43.927328 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:43.927289 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" event={"ID":"cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62","Type":"ContainerStarted","Data":"f1e5af004db1832491f6e9e9e4b673fcd263881d99637ab940ce5a6b3bb44297"} Jun 09 11:22:43.944244 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:43.944176 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" podStartSLOduration=1.944155883 podStartE2EDuration="1.944155883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:22:43.942806166 +0000 UTC m=+919.851191492" watchObservedRunningTime="2026-06-09 11:22:43.944155883 +0000 UTC m=+919.852541210" Jun 09 11:22:48.233666 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.233627 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-bjnht"] Jun 09 11:22:48.236805 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.236778 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" Jun 09 11:22:48.239363 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.239342 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Jun 09 11:22:48.244885 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.244852 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-bjnht"] Jun 09 11:22:48.263144 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.263121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6dd04afa-be12-4714-970a-a22675c23c0b-postgresdata\") pod \"postgres-864846d4f5-bjnht\" (UID: \"6dd04afa-be12-4714-970a-a22675c23c0b\") " pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" Jun 09 11:22:48.263259 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.263177 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9869q\" (UniqueName: \"kubernetes.io/projected/6dd04afa-be12-4714-970a-a22675c23c0b-kube-api-access-9869q\") pod \"postgres-864846d4f5-bjnht\" (UID: \"6dd04afa-be12-4714-970a-a22675c23c0b\") " pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" Jun 09 11:22:48.266392 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.266371 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:22:48.363931 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.363892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9869q\" (UniqueName: \"kubernetes.io/projected/6dd04afa-be12-4714-970a-a22675c23c0b-kube-api-access-9869q\") pod \"postgres-864846d4f5-bjnht\" (UID: \"6dd04afa-be12-4714-970a-a22675c23c0b\") " pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" Jun 09 11:22:48.364089 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.363947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6dd04afa-be12-4714-970a-a22675c23c0b-postgresdata\") pod \"postgres-864846d4f5-bjnht\" (UID: \"6dd04afa-be12-4714-970a-a22675c23c0b\") " pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" Jun 09 11:22:48.364282 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.364267 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6dd04afa-be12-4714-970a-a22675c23c0b-postgresdata\") pod \"postgres-864846d4f5-bjnht\" (UID: \"6dd04afa-be12-4714-970a-a22675c23c0b\") " pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" Jun 09 11:22:48.372656 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.372637 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9869q\" (UniqueName: \"kubernetes.io/projected/6dd04afa-be12-4714-970a-a22675c23c0b-kube-api-access-9869q\") pod \"postgres-864846d4f5-bjnht\" (UID: \"6dd04afa-be12-4714-970a-a22675c23c0b\") " pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" Jun 09 11:22:48.547198 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.547115 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" Jun 09 11:22:48.669734 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.669701 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-bjnht"] Jun 09 11:22:48.672754 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:22:48.672729 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dd04afa_be12_4714_970a_a22675c23c0b.slice/crio-db8af1c5b6e677751e37a6de396a346646283584610f8741d217c120a73c42a3 WatchSource:0}: Error finding container db8af1c5b6e677751e37a6de396a346646283584610f8741d217c120a73c42a3: Status 404 returned error can't find the container with id db8af1c5b6e677751e37a6de396a346646283584610f8741d217c120a73c42a3 Jun 09 11:22:48.947041 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.947001 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" event={"ID":"6dd04afa-be12-4714-970a-a22675c23c0b","Type":"ContainerStarted","Data":"d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275"} Jun 09 11:22:48.947218 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.947056 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" event={"ID":"6dd04afa-be12-4714-970a-a22675c23c0b","Type":"ContainerStarted","Data":"db8af1c5b6e677751e37a6de396a346646283584610f8741d217c120a73c42a3"} Jun 09 11:22:48.964797 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:48.964745 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" podStartSLOduration=0.964729276 podStartE2EDuration="964.729276ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:22:48.964694465 +0000 UTC m=+924.873079792" watchObservedRunningTime="2026-06-09 11:22:48.964729276 +0000 UTC m=+924.873114598" Jun 09 11:22:53.732385 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:53.732351 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:22:53.833386 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:53.833350 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:22:53.898751 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:53.898715 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5"] Jun 09 11:22:53.902031 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:53.902015 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:53.904526 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:53.904498 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Jun 09 11:22:53.904647 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:53.904505 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Jun 09 11:22:53.904850 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:53.904835 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-zh2lz\"" Jun 09 11:22:53.905025 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:53.905013 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Jun 09 11:22:53.914857 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:53.914835 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5"] Jun 09 11:22:53.941482 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:53.941451 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:22:54.004755 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.004654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-feast-data\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.004755 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.004692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-online-tls\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.004755 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.004709 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-registry-tls\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.005020 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.004833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68cs\" (UniqueName: \"kubernetes.io/projected/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-kube-api-access-x68cs\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.105585 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.105546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68cs\" (UniqueName: \"kubernetes.io/projected/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-kube-api-access-x68cs\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.105752 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.105607 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-feast-data\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.105752 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.105636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-online-tls\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.105752 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.105659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-registry-tls\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.105944 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:22:54.105773 2558 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found Jun 09 11:22:54.105944 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:22:54.105860 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-online-tls podName:2cfe3f82-0c33-4499-9fca-95c5ba5f8563 nodeName:}" failed. No retries permitted until 2026-06-09 11:22:54.605839013 +0000 UTC m=+930.514224330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-online-tls") pod "feast-credit-scoring-567b896f69-rwlf5" (UID: "2cfe3f82-0c33-4499-9fca-95c5ba5f8563") : secret "feast-credit-scoring-online-tls" not found Jun 09 11:22:54.106125 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.106103 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-feast-data\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.108233 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.108207 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-registry-tls\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.114183 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.114164 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68cs\" (UniqueName: \"kubernetes.io/projected/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-kube-api-access-x68cs\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.186723 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.186693 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:22:54.610146 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.610100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-online-tls\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.612484 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.612455 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-online-tls\") pod \"feast-credit-scoring-567b896f69-rwlf5\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.810679 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.810641 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:22:54.940616 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.940588 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5"] Jun 09 11:22:54.943171 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:22:54.943140 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfe3f82_0c33_4499_9fca_95c5ba5f8563.slice/crio-160943ef5c2b41990ba49f3b28cabbbfd895cf10d7aced60a571d6bec98d7947 WatchSource:0}: Error finding container 160943ef5c2b41990ba49f3b28cabbbfd895cf10d7aced60a571d6bec98d7947: Status 404 returned error can't find the container with id 160943ef5c2b41990ba49f3b28cabbbfd895cf10d7aced60a571d6bec98d7947 Jun 09 11:22:54.970095 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:54.970072 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" event={"ID":"2cfe3f82-0c33-4499-9fca-95c5ba5f8563","Type":"ContainerStarted","Data":"160943ef5c2b41990ba49f3b28cabbbfd895cf10d7aced60a571d6bec98d7947"} Jun 09 11:22:55.976171 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:55.976134 2558 generic.go:356] "Generic (PLEG): container finished" podID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerID="03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d" exitCode=0 Jun 09 11:22:55.976565 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:55.976218 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" event={"ID":"2cfe3f82-0c33-4499-9fca-95c5ba5f8563","Type":"ContainerDied","Data":"03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d"} Jun 09 11:22:56.982143 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:22:56.982104 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" event={"ID":"2cfe3f82-0c33-4499-9fca-95c5ba5f8563","Type":"ContainerStarted","Data":"65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788"} Jun 09 11:23:04.010107 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:04.010074 2558 generic.go:356] "Generic (PLEG): container finished" podID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerID="65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788" exitCode=0 Jun 09 11:23:04.010569 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:04.010123 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" event={"ID":"2cfe3f82-0c33-4499-9fca-95c5ba5f8563","Type":"ContainerDied","Data":"65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788"} Jun 09 11:23:05.016902 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:05.016845 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" event={"ID":"2cfe3f82-0c33-4499-9fca-95c5ba5f8563","Type":"ContainerStarted","Data":"0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8"} Jun 09 11:23:05.017339 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:05.016936 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" event={"ID":"2cfe3f82-0c33-4499-9fca-95c5ba5f8563","Type":"ContainerStarted","Data":"69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae"} Jun 09 11:23:05.052729 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:05.052659 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" podStartSLOduration=12.052623964 podStartE2EDuration="12.052623964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:23:05.051009953 +0000 UTC m=+940.959395290" watchObservedRunningTime="2026-06-09 11:23:05.052623964 +0000 UTC m=+940.961009291" Jun 09 11:23:06.811177 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:06.811140 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:23:06.811670 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:06.811206 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:23:06.812739 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:06.812706 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused" Jun 09 11:23:06.812866 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:06.812710 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Jun 09 11:23:09.811720 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:09.811651 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused" Jun 09 11:23:10.046855 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:10.046823 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:23:10.047265 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:10.047242 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:23:10.050050 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:10.050028 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:23:12.811404 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:12.811355 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused" Jun 09 11:23:14.811369 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:14.811313 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:23:15.812099 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:15.812070 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:23:15.812748 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:15.812730 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:23:16.060373 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:16.060340 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:23:19.593578 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.593546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:23:19.694073 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.694036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:23:19.756784 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.756749 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5"] Jun 09 11:23:19.761030 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.761014 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:19.763561 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.763535 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Jun 09 11:23:19.763665 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.763539 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Jun 09 11:23:19.763721 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.763700 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Jun 09 11:23:19.763905 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.763865 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-s5n85\"" Jun 09 11:23:19.771038 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.771019 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5"] Jun 09 11:23:19.794418 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.794392 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:23:19.926803 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.926729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-online-tls\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:19.926803 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.926761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nvnb\" (UniqueName: \"kubernetes.io/projected/9d7a1774-eded-4769-bbb6-342453979ce9-kube-api-access-6nvnb\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:19.926803 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.926805 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9d7a1774-eded-4769-bbb6-342453979ce9-feast-data\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:19.927036 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.926823 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-registry-tls\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:19.976156 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:19.976126 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:23:20.027800 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:20.027767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-online-tls\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:20.027973 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:20.027808 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nvnb\" (UniqueName: \"kubernetes.io/projected/9d7a1774-eded-4769-bbb6-342453979ce9-kube-api-access-6nvnb\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:20.027973 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:20.027887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9d7a1774-eded-4769-bbb6-342453979ce9-feast-data\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:20.027973 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:20.027915 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-registry-tls\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:20.028319 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:20.028293 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9d7a1774-eded-4769-bbb6-342453979ce9-feast-data\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:20.030224 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:20.030198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-registry-tls\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:20.030366 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:20.030346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-online-tls\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:20.038927 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:20.038845 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nvnb\" (UniqueName: \"kubernetes.io/projected/9d7a1774-eded-4769-bbb6-342453979ce9-kube-api-access-6nvnb\") pod \"feast-driver-ranking-7cb6bbdb8b-b58l5\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:20.070630 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:20.070610 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:20.207777 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:20.207749 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5"] Jun 09 11:23:20.210225 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:23:20.210200 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7a1774_eded_4769_bbb6_342453979ce9.slice/crio-4e72ca106496f2d4bdb31a3b3cfec3dde8679af93a331f3a03cb4469d590614b WatchSource:0}: Error finding container 4e72ca106496f2d4bdb31a3b3cfec3dde8679af93a331f3a03cb4469d590614b: Status 404 returned error can't find the container with id 4e72ca106496f2d4bdb31a3b3cfec3dde8679af93a331f3a03cb4469d590614b Jun 09 11:23:21.081277 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:21.081226 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" event={"ID":"9d7a1774-eded-4769-bbb6-342453979ce9","Type":"ContainerStarted","Data":"b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512"} Jun 09 11:23:21.081643 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:21.081297 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" event={"ID":"9d7a1774-eded-4769-bbb6-342453979ce9","Type":"ContainerStarted","Data":"4e72ca106496f2d4bdb31a3b3cfec3dde8679af93a331f3a03cb4469d590614b"} Jun 09 11:23:25.098075 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:25.098044 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d7a1774-eded-4769-bbb6-342453979ce9" containerID="b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512" exitCode=0 Jun 09 11:23:25.098454 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:25.098103 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" event={"ID":"9d7a1774-eded-4769-bbb6-342453979ce9","Type":"ContainerDied","Data":"b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512"} Jun 09 11:23:26.104247 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:26.104211 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" event={"ID":"9d7a1774-eded-4769-bbb6-342453979ce9","Type":"ContainerStarted","Data":"8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e"} Jun 09 11:23:32.126229 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:32.126193 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d7a1774-eded-4769-bbb6-342453979ce9" containerID="8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e" exitCode=0 Jun 09 11:23:32.126599 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:32.126265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" event={"ID":"9d7a1774-eded-4769-bbb6-342453979ce9","Type":"ContainerDied","Data":"8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e"} Jun 09 11:23:32.129825 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:32.129802 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Jun 09 11:23:33.132807 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:33.132767 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" event={"ID":"9d7a1774-eded-4769-bbb6-342453979ce9","Type":"ContainerStarted","Data":"5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc"} Jun 09 11:23:33.133213 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:33.132836 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" event={"ID":"9d7a1774-eded-4769-bbb6-342453979ce9","Type":"ContainerStarted","Data":"38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09"} Jun 09 11:23:33.156528 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:33.156472 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" podStartSLOduration=14.156455703 podStartE2EDuration="14.156455703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:23:33.155278324 +0000 UTC m=+969.063663696" watchObservedRunningTime="2026-06-09 11:23:33.156455703 +0000 UTC m=+969.064841028" Jun 09 11:23:35.071487 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:35.071439 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:35.071918 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:35.071517 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:35.072983 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:35.072955 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" Jun 09 11:23:35.073108 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:35.073001 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Jun 09 11:23:38.071699 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:38.071654 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" Jun 09 11:23:38.277888 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:38.277836 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:38.278235 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:38.278211 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:38.280933 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:38.280911 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:40.071389 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:40.071347 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:41.072035 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:41.071986 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" Jun 09 11:23:44.071747 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:44.071668 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:23:44.072300 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:23:44.072281 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:24:55.934107 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:24:55.934070 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:00.456461 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.456425 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:00.859906 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.859786 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch"] Jun 09 11:25:00.860085 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.860037 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" podUID="16c16c19-9e06-46ac-a414-768574c6f0a6" containerName="manager" containerID="cri-o://a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616" gracePeriod=10 Jun 09 11:25:00.867613 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.867586 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:00.890666 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.890636 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5"] Jun 09 11:25:00.890895 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.890852 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="registry" containerID="cri-o://69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae" gracePeriod=30 Jun 09 11:25:00.891020 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.890911 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="online" containerID="cri-o://0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8" gracePeriod=30 Jun 09 11:25:00.895798 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.895772 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5"] Jun 09 11:25:00.896060 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.896034 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="registry" containerID="cri-o://38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09" gracePeriod=30 Jun 09 11:25:00.896165 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.896064 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="online" containerID="cri-o://5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc" gracePeriod=30 Jun 09 11:25:00.908976 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.908945 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-bjnht"] Jun 09 11:25:00.909146 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.909108 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" podUID="6dd04afa-be12-4714-970a-a22675c23c0b" containerName="postgres" containerID="cri-o://d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275" gracePeriod=30 Jun 09 11:25:00.919944 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.919901 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rxzjj"] Jun 09 11:25:00.920145 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.920123 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" podUID="cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62" containerName="redis" containerID="cri-o://9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17" gracePeriod=30 Jun 09 11:25:00.969619 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:00.969594 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:01.107860 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.107822 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:01.203347 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.203296 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:01.248350 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.248321 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" Jun 09 11:25:01.251312 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.251288 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" Jun 09 11:25:01.255033 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.255011 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" Jun 09 11:25:01.329643 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.329599 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g25zj\" (UniqueName: \"kubernetes.io/projected/16c16c19-9e06-46ac-a414-768574c6f0a6-kube-api-access-g25zj\") pod \"16c16c19-9e06-46ac-a414-768574c6f0a6\" (UID: \"16c16c19-9e06-46ac-a414-768574c6f0a6\") " Jun 09 11:25:01.330120 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.330095 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d22h7\" (UniqueName: \"kubernetes.io/projected/cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62-kube-api-access-d22h7\") pod \"cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62\" (UID: \"cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62\") " Jun 09 11:25:01.330120 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.330129 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6dd04afa-be12-4714-970a-a22675c23c0b-postgresdata\") pod \"6dd04afa-be12-4714-970a-a22675c23c0b\" (UID: \"6dd04afa-be12-4714-970a-a22675c23c0b\") " Jun 09 11:25:01.330342 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.330224 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9869q\" (UniqueName: \"kubernetes.io/projected/6dd04afa-be12-4714-970a-a22675c23c0b-kube-api-access-9869q\") pod \"6dd04afa-be12-4714-970a-a22675c23c0b\" (UID: \"6dd04afa-be12-4714-970a-a22675c23c0b\") " Jun 09 11:25:01.332793 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.332423 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16c16c19-9e06-46ac-a414-768574c6f0a6-kube-api-access-g25zj" (OuterVolumeSpecName: "kube-api-access-g25zj") pod "16c16c19-9e06-46ac-a414-768574c6f0a6" (UID: "16c16c19-9e06-46ac-a414-768574c6f0a6"). InnerVolumeSpecName "kube-api-access-g25zj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:25:01.333255 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.333216 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62-kube-api-access-d22h7" (OuterVolumeSpecName: "kube-api-access-d22h7") pod "cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62" (UID: "cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62"). InnerVolumeSpecName "kube-api-access-d22h7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:25:01.333956 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.333904 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dd04afa-be12-4714-970a-a22675c23c0b-kube-api-access-9869q" (OuterVolumeSpecName: "kube-api-access-9869q") pod "6dd04afa-be12-4714-970a-a22675c23c0b" (UID: "6dd04afa-be12-4714-970a-a22675c23c0b"). InnerVolumeSpecName "kube-api-access-9869q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:25:01.371150 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.371107 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dd04afa-be12-4714-970a-a22675c23c0b-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "6dd04afa-be12-4714-970a-a22675c23c0b" (UID: "6dd04afa-be12-4714-970a-a22675c23c0b"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:25:01.431453 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.431346 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g25zj\" (UniqueName: \"kubernetes.io/projected/16c16c19-9e06-46ac-a414-768574c6f0a6-kube-api-access-g25zj\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:01.431453 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.431379 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d22h7\" (UniqueName: \"kubernetes.io/projected/cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62-kube-api-access-d22h7\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:01.431453 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.431389 2558 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6dd04afa-be12-4714-970a-a22675c23c0b-postgresdata\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:01.431453 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.431397 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9869q\" (UniqueName: \"kubernetes.io/projected/6dd04afa-be12-4714-970a-a22675c23c0b-kube-api-access-9869q\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:01.473602 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.473561 2558 generic.go:356] "Generic (PLEG): container finished" podID="16c16c19-9e06-46ac-a414-768574c6f0a6" containerID="a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616" exitCode=0 Jun 09 11:25:01.474112 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.473621 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" Jun 09 11:25:01.474112 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.473653 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" event={"ID":"16c16c19-9e06-46ac-a414-768574c6f0a6","Type":"ContainerDied","Data":"a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616"} Jun 09 11:25:01.474112 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.473712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch" event={"ID":"16c16c19-9e06-46ac-a414-768574c6f0a6","Type":"ContainerDied","Data":"708c6853c07f9639310f6455fd9c48637725ae1a81b4cc3316685991b0b7de33"} Jun 09 11:25:01.474112 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.473739 2558 scope.go:117] "RemoveContainer" containerID="a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616" Jun 09 11:25:01.475030 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.475003 2558 generic.go:356] "Generic (PLEG): container finished" podID="6dd04afa-be12-4714-970a-a22675c23c0b" containerID="d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275" exitCode=0 Jun 09 11:25:01.475172 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.475051 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" Jun 09 11:25:01.475172 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.475120 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" event={"ID":"6dd04afa-be12-4714-970a-a22675c23c0b","Type":"ContainerDied","Data":"d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275"} Jun 09 11:25:01.475172 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.475153 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-bjnht" event={"ID":"6dd04afa-be12-4714-970a-a22675c23c0b","Type":"ContainerDied","Data":"db8af1c5b6e677751e37a6de396a346646283584610f8741d217c120a73c42a3"} Jun 09 11:25:01.476536 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.476511 2558 generic.go:356] "Generic (PLEG): container finished" podID="cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62" containerID="9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17" exitCode=0 Jun 09 11:25:01.476674 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.476555 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" Jun 09 11:25:01.476674 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.476582 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" event={"ID":"cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62","Type":"ContainerDied","Data":"9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17"} Jun 09 11:25:01.476674 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.476609 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-rxzjj" event={"ID":"cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62","Type":"ContainerDied","Data":"f1e5af004db1832491f6e9e9e4b673fcd263881d99637ab940ce5a6b3bb44297"} Jun 09 11:25:01.488988 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.484800 2558 scope.go:117] "RemoveContainer" containerID="a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616" Jun 09 11:25:01.488988 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:01.485590 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616\": container with ID starting with a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616 not found: ID does not exist" containerID="a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616" Jun 09 11:25:01.488988 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.485631 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616"} err="failed to get container status \"a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616\": rpc error: code = NotFound desc = could not find container \"a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616\": container with ID starting with a952fc82e923d5e4c7627676e1140987b27b02ce75ad8ef003e4d7ca0a526616 not found: ID does not exist" Jun 09 11:25:01.488988 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.485695 2558 scope.go:117] "RemoveContainer" containerID="d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275" Jun 09 11:25:01.502095 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.501984 2558 scope.go:117] "RemoveContainer" containerID="d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275" Jun 09 11:25:01.502698 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:01.502673 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275\": container with ID starting with d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275 not found: ID does not exist" containerID="d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275" Jun 09 11:25:01.502795 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.502705 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275"} err="failed to get container status \"d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275\": rpc error: code = NotFound desc = could not find container \"d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275\": container with ID starting with d9cc0ef3590af5366be66517130c11c6e777735aff691fa41197c219045b6275 not found: ID does not exist" Jun 09 11:25:01.502795 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.502722 2558 scope.go:117] "RemoveContainer" containerID="9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17" Jun 09 11:25:01.511151 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.511128 2558 scope.go:117] "RemoveContainer" containerID="9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17" Jun 09 11:25:01.511537 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:01.511513 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17\": container with ID starting with 9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17 not found: ID does not exist" containerID="9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17" Jun 09 11:25:01.511625 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.511550 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17"} err="failed to get container status \"9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17\": rpc error: code = NotFound desc = could not find container \"9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17\": container with ID starting with 9c3bd398e6ebf6a06bd9fcd1cfafb17b44a10fb014f571723002ec93c410cc17 not found: ID does not exist" Jun 09 11:25:01.512154 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.512130 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-bjnht"] Jun 09 11:25:01.515656 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.515630 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-bjnht"] Jun 09 11:25:01.527522 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.527488 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch"] Jun 09 11:25:01.534273 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.534245 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6976c8f54f-hxnch"] Jun 09 11:25:01.546952 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.546921 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rxzjj"] Jun 09 11:25:01.551422 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:01.551399 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-rxzjj"] Jun 09 11:25:02.482993 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:02.482962 2558 generic.go:356] "Generic (PLEG): container finished" podID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerID="0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8" exitCode=0 Jun 09 11:25:02.483389 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:02.483031 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" event={"ID":"2cfe3f82-0c33-4499-9fca-95c5ba5f8563","Type":"ContainerDied","Data":"0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8"} Jun 09 11:25:02.485081 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:02.485059 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d7a1774-eded-4769-bbb6-342453979ce9" containerID="5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc" exitCode=0 Jun 09 11:25:02.485184 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:02.485132 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" event={"ID":"9d7a1774-eded-4769-bbb6-342453979ce9","Type":"ContainerDied","Data":"5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc"} Jun 09 11:25:02.489978 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:02.489954 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16c16c19-9e06-46ac-a414-768574c6f0a6" path="/var/lib/kubelet/pods/16c16c19-9e06-46ac-a414-768574c6f0a6/volumes" Jun 09 11:25:02.490350 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:02.490332 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dd04afa-be12-4714-970a-a22675c23c0b" path="/var/lib/kubelet/pods/6dd04afa-be12-4714-970a-a22675c23c0b/volumes" Jun 09 11:25:02.490656 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:02.490641 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62" path="/var/lib/kubelet/pods/cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62/volumes" Jun 09 11:25:06.040520 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:06.040485 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:06.093984 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:06.093957 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:08.279317 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:08.279273 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Jun 09 11:25:10.047774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:10.047727 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Jun 09 11:25:11.985624 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:11.985574 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:12.081392 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:12.081359 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:12.536582 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:12.536551 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:18.278413 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:18.278362 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Jun 09 11:25:20.047701 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:20.047650 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Jun 09 11:25:28.278729 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:28.278681 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Jun 09 11:25:28.279278 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:28.278809 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:25:30.047510 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:30.047464 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Jun 09 11:25:30.047931 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:30.047599 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:25:30.764268 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:30.764236 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:30.865779 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:30.865740 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:31.155236 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.155158 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:31.256322 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.256287 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:31.346421 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.346392 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:31.409555 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.409530 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:31.511640 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.511611 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:31.555447 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.555426 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:25:31.557890 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.557859 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:25:31.585836 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.585811 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d7a1774-eded-4769-bbb6-342453979ce9" containerID="38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09" exitCode=137 Jun 09 11:25:31.585939 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.585849 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" Jun 09 11:25:31.585939 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.585899 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" event={"ID":"9d7a1774-eded-4769-bbb6-342453979ce9","Type":"ContainerDied","Data":"38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09"} Jun 09 11:25:31.586042 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.585944 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5" event={"ID":"9d7a1774-eded-4769-bbb6-342453979ce9","Type":"ContainerDied","Data":"4e72ca106496f2d4bdb31a3b3cfec3dde8679af93a331f3a03cb4469d590614b"} Jun 09 11:25:31.586042 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.585970 2558 scope.go:117] "RemoveContainer" containerID="5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc" Jun 09 11:25:31.588491 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.588474 2558 generic.go:356] "Generic (PLEG): container finished" podID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerID="69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae" exitCode=137 Jun 09 11:25:31.588583 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.588513 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" event={"ID":"2cfe3f82-0c33-4499-9fca-95c5ba5f8563","Type":"ContainerDied","Data":"69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae"} Jun 09 11:25:31.588583 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.588534 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" Jun 09 11:25:31.588583 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.588543 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5" event={"ID":"2cfe3f82-0c33-4499-9fca-95c5ba5f8563","Type":"ContainerDied","Data":"160943ef5c2b41990ba49f3b28cabbbfd895cf10d7aced60a571d6bec98d7947"} Jun 09 11:25:31.593771 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.593749 2558 scope.go:117] "RemoveContainer" containerID="38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09" Jun 09 11:25:31.602303 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.602286 2558 scope.go:117] "RemoveContainer" containerID="8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e" Jun 09 11:25:31.609608 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.609591 2558 scope.go:117] "RemoveContainer" containerID="b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512" Jun 09 11:25:31.616232 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.616216 2558 scope.go:117] "RemoveContainer" containerID="5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc" Jun 09 11:25:31.616494 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:31.616477 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc\": container with ID starting with 5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc not found: ID does not exist" containerID="5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc" Jun 09 11:25:31.616538 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.616502 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc"} err="failed to get container status \"5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc\": rpc error: code = NotFound desc = could not find container \"5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc\": container with ID starting with 5c45d57276f4b262e6e799eb328e8e8daa9f90978da47448c9e52fe32fbfa1fc not found: ID does not exist" Jun 09 11:25:31.616538 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.616519 2558 scope.go:117] "RemoveContainer" containerID="38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09" Jun 09 11:25:31.616728 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:31.616713 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09\": container with ID starting with 38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09 not found: ID does not exist" containerID="38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09" Jun 09 11:25:31.616774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.616732 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09"} err="failed to get container status \"38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09\": rpc error: code = NotFound desc = could not find container \"38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09\": container with ID starting with 38bc75f34c324c73775853ee764efb76e7e9452f006cfc41e1bca6359db72a09 not found: ID does not exist" Jun 09 11:25:31.616774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.616745 2558 scope.go:117] "RemoveContainer" containerID="8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e" Jun 09 11:25:31.617005 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:31.616978 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e\": container with ID starting with 8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e not found: ID does not exist" containerID="8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e" Jun 09 11:25:31.617094 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.617005 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e"} err="failed to get container status \"8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e\": rpc error: code = NotFound desc = could not find container \"8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e\": container with ID starting with 8cd7d8400b46bb99a6d1cd876ddcf8fdf4bb43808964176bec8d75c2c8b7170e not found: ID does not exist" Jun 09 11:25:31.617094 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.617020 2558 scope.go:117] "RemoveContainer" containerID="b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512" Jun 09 11:25:31.617265 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:31.617248 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512\": container with ID starting with b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512 not found: ID does not exist" containerID="b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512" Jun 09 11:25:31.617303 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.617270 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512"} err="failed to get container status \"b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512\": rpc error: code = NotFound desc = could not find container \"b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512\": container with ID starting with b082e74187e35f653ed0bae5fb6182d73a2626da6b381a9424d49948e943a512 not found: ID does not exist" Jun 09 11:25:31.617303 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.617282 2558 scope.go:117] "RemoveContainer" containerID="0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8" Jun 09 11:25:31.623808 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.623791 2558 scope.go:117] "RemoveContainer" containerID="69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae" Jun 09 11:25:31.630350 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.630336 2558 scope.go:117] "RemoveContainer" containerID="65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788" Jun 09 11:25:31.636528 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.636514 2558 scope.go:117] "RemoveContainer" containerID="03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d" Jun 09 11:25:31.642843 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.642830 2558 scope.go:117] "RemoveContainer" containerID="0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8" Jun 09 11:25:31.643155 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:31.643129 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8\": container with ID starting with 0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8 not found: ID does not exist" containerID="0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8" Jun 09 11:25:31.643205 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.643160 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8"} err="failed to get container status \"0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8\": rpc error: code = NotFound desc = could not find container \"0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8\": container with ID starting with 0ed43b3a8065e9a703860e7ff78081efa5d0301828b5f10f473eda4af42c3de8 not found: ID does not exist" Jun 09 11:25:31.643205 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.643174 2558 scope.go:117] "RemoveContainer" containerID="69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae" Jun 09 11:25:31.643424 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:31.643409 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae\": container with ID starting with 69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae not found: ID does not exist" containerID="69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae" Jun 09 11:25:31.643480 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.643427 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae"} err="failed to get container status \"69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae\": rpc error: code = NotFound desc = could not find container \"69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae\": container with ID starting with 69391b9f9e7b0a141de59b52a1ba35696442977bdbd84d042bab71407bb1ccae not found: ID does not exist" Jun 09 11:25:31.643480 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.643439 2558 scope.go:117] "RemoveContainer" containerID="65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788" Jun 09 11:25:31.643688 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:31.643672 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788\": container with ID starting with 65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788 not found: ID does not exist" containerID="65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788" Jun 09 11:25:31.643747 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.643691 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788"} err="failed to get container status \"65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788\": rpc error: code = NotFound desc = could not find container \"65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788\": container with ID starting with 65f41d0895fcaaee2010e0d56490eff7101cd67297341b014f07774c54e56788 not found: ID does not exist" Jun 09 11:25:31.643747 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.643709 2558 scope.go:117] "RemoveContainer" containerID="03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d" Jun 09 11:25:31.643967 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:25:31.643944 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d\": container with ID starting with 03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d not found: ID does not exist" containerID="03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d" Jun 09 11:25:31.644065 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.643968 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d"} err="failed to get container status \"03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d\": rpc error: code = NotFound desc = could not find container \"03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d\": container with ID starting with 03b68f4ca54c7c2bef90a0e966eaa8028742d36f1e8b02350933ee86a050937d not found: ID does not exist" Jun 09 11:25:31.651327 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.651263 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x68cs\" (UniqueName: \"kubernetes.io/projected/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-kube-api-access-x68cs\") pod \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " Jun 09 11:25:31.651327 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.651322 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-online-tls\") pod \"9d7a1774-eded-4769-bbb6-342453979ce9\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " Jun 09 11:25:31.651527 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.651387 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-registry-tls\") pod \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " Jun 09 11:25:31.651527 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.651417 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9d7a1774-eded-4769-bbb6-342453979ce9-feast-data\") pod \"9d7a1774-eded-4769-bbb6-342453979ce9\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " Jun 09 11:25:31.651733 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.651715 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nvnb\" (UniqueName: \"kubernetes.io/projected/9d7a1774-eded-4769-bbb6-342453979ce9-kube-api-access-6nvnb\") pod \"9d7a1774-eded-4769-bbb6-342453979ce9\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " Jun 09 11:25:31.651883 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.651852 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-feast-data\") pod \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " Jun 09 11:25:31.652021 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.652006 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-registry-tls\") pod \"9d7a1774-eded-4769-bbb6-342453979ce9\" (UID: \"9d7a1774-eded-4769-bbb6-342453979ce9\") " Jun 09 11:25:31.652140 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.652127 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-online-tls\") pod \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\" (UID: \"2cfe3f82-0c33-4499-9fca-95c5ba5f8563\") " Jun 09 11:25:31.652354 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.651856 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d7a1774-eded-4769-bbb6-342453979ce9-feast-data" (OuterVolumeSpecName: "feast-data") pod "9d7a1774-eded-4769-bbb6-342453979ce9" (UID: "9d7a1774-eded-4769-bbb6-342453979ce9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:25:31.652547 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.652530 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9d7a1774-eded-4769-bbb6-342453979ce9-feast-data\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:31.654536 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.654513 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2cfe3f82-0c33-4499-9fca-95c5ba5f8563" (UID: "2cfe3f82-0c33-4499-9fca-95c5ba5f8563"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:25:31.654782 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.654633 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d7a1774-eded-4769-bbb6-342453979ce9-kube-api-access-6nvnb" (OuterVolumeSpecName: "kube-api-access-6nvnb") pod "9d7a1774-eded-4769-bbb6-342453979ce9" (UID: "9d7a1774-eded-4769-bbb6-342453979ce9"). InnerVolumeSpecName "kube-api-access-6nvnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:25:31.654782 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.654729 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-online-tls" (OuterVolumeSpecName: "online-tls") pod "9d7a1774-eded-4769-bbb6-342453979ce9" (UID: "9d7a1774-eded-4769-bbb6-342453979ce9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:25:31.654975 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.654818 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9d7a1774-eded-4769-bbb6-342453979ce9" (UID: "9d7a1774-eded-4769-bbb6-342453979ce9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:25:31.654975 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.654934 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-online-tls" (OuterVolumeSpecName: "online-tls") pod "2cfe3f82-0c33-4499-9fca-95c5ba5f8563" (UID: "2cfe3f82-0c33-4499-9fca-95c5ba5f8563"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:25:31.656014 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.655959 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-kube-api-access-x68cs" (OuterVolumeSpecName: "kube-api-access-x68cs") pod "2cfe3f82-0c33-4499-9fca-95c5ba5f8563" (UID: "2cfe3f82-0c33-4499-9fca-95c5ba5f8563"). InnerVolumeSpecName "kube-api-access-x68cs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:25:31.662130 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.662108 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-feast-data" (OuterVolumeSpecName: "feast-data") pod "2cfe3f82-0c33-4499-9fca-95c5ba5f8563" (UID: "2cfe3f82-0c33-4499-9fca-95c5ba5f8563"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:25:31.753693 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.753660 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-registry-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:31.753693 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.753693 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nvnb\" (UniqueName: \"kubernetes.io/projected/9d7a1774-eded-4769-bbb6-342453979ce9-kube-api-access-6nvnb\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:31.753693 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.753703 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-feast-data\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:31.753863 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.753713 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-registry-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:31.753863 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.753721 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-online-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:31.753863 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.753728 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x68cs\" (UniqueName: \"kubernetes.io/projected/2cfe3f82-0c33-4499-9fca-95c5ba5f8563-kube-api-access-x68cs\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:31.753863 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.753736 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d7a1774-eded-4769-bbb6-342453979ce9-online-tls\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:25:31.921773 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.921709 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5"] Jun 09 11:25:31.924029 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.924011 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-567b896f69-rwlf5"] Jun 09 11:25:31.936931 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.936907 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5"] Jun 09 11:25:31.941072 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:31.941052 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7cb6bbdb8b-b58l5"] Jun 09 11:25:32.491260 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:32.491225 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" path="/var/lib/kubelet/pods/2cfe3f82-0c33-4499-9fca-95c5ba5f8563/volumes" Jun 09 11:25:32.491709 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:32.491696 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" path="/var/lib/kubelet/pods/9d7a1774-eded-4769-bbb6-342453979ce9/volumes" Jun 09 11:25:38.133848 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:38.133810 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:38.185754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:38.185722 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:25:38.758790 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:25:38.758752 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:26:15.917606 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:26:15.917567 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:26:19.523961 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:26:19.523922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:27:06.582922 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:27:06.582827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:27:06.679308 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:27:06.679270 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:27:06.782467 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:27:06.782427 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:27:06.877124 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:27:06.877038 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:27:06.940323 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:27:06.940281 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:27:07.055501 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:27:07.055453 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:27:07.168959 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:27:07.168853 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:27:07.269305 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:27:07.269282 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:28:28.356629 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:28:28.356597 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:28:29.447346 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:28:29.447312 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:29:37.062748 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:29:37.062710 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:29:50.131424 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:29:50.131333 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:29:50.183201 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:29:50.183168 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:29:50.285818 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:29:50.285781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:29:50.340664 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:29:50.340631 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:29:50.442046 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:29:50.442018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:29:55.469242 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:29:55.469204 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:30:33.196294 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:30:33.196257 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:30:33.362947 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:30:33.362912 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:30:37.704493 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:30:37.704460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:30:38.887299 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:30:38.887265 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:30:38.938661 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:30:38.938628 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:30:59.821122 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:30:59.821083 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:30:59.922839 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:30:59.922810 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:31:00.260388 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:31:00.260358 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:31:00.357200 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:31:00.357162 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:31:00.449349 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:31:00.449319 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:31:00.507410 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:31:00.507376 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:31:00.678039 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:31:00.677951 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:32:22.055812 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:32:22.055782 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:32:22.116135 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:32:22.116108 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:32:22.360517 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:32:22.360442 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:32:54.850388 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:32:54.850311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:33:05.785202 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:33:05.785155 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:33:42.699684 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:33:42.699645 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:33:43.616545 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:33:43.616485 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:33:43.716965 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:33:43.716930 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:04.100535 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:04.100501 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:04.232518 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:04.232481 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:04.333075 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:04.333043 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:04.391546 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:04.391477 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:09.022115 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:09.022079 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:09.079542 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:09.079512 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:09.440440 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:09.440414 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:47.485014 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:47.484939 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:47.604644 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:47.604613 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:53.407216 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.407182 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:53.482417 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.482385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:53.996004 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.995973 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xztgn/must-gather-r2mvs"] Jun 09 11:35:53.996249 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996238 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="feast-init" Jun 09 11:35:53.996296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996251 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="feast-init" Jun 09 11:35:53.996296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996261 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="online" Jun 09 11:35:53.996296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996267 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="online" Jun 09 11:35:53.996296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996273 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="online" Jun 09 11:35:53.996296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996279 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="online" Jun 09 11:35:53.996296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996285 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62" containerName="redis" Jun 09 11:35:53.996296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996290 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62" containerName="redis" Jun 09 11:35:53.996296 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996296 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="feast-apply" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996301 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="feast-apply" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996307 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="feast-init" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996313 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="feast-init" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996326 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd04afa-be12-4714-970a-a22675c23c0b" containerName="postgres" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996331 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd04afa-be12-4714-970a-a22675c23c0b" containerName="postgres" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996338 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="feast-apply" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996343 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="feast-apply" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996350 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16c16c19-9e06-46ac-a414-768574c6f0a6" containerName="manager" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996355 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="16c16c19-9e06-46ac-a414-768574c6f0a6" containerName="manager" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996361 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="registry" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996365 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="registry" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996373 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="registry" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996388 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="registry" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996428 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="registry" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996434 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="registry" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996440 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d7a1774-eded-4769-bbb6-342453979ce9" containerName="online" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996445 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd0ba5db-3630-4f35-9c7e-f2d6b4fcaa62" containerName="redis" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996450 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="16c16c19-9e06-46ac-a414-768574c6f0a6" containerName="manager" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996454 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cfe3f82-0c33-4499-9fca-95c5ba5f8563" containerName="online" Jun 09 11:35:53.996537 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.996459 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd04afa-be12-4714-970a-a22675c23c0b" containerName="postgres" Jun 09 11:35:53.999240 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:53.999223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:35:54.002550 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.002531 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xztgn\"/\"kube-root-ca.crt\"" Jun 09 11:35:54.003653 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.003635 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xztgn\"/\"openshift-service-ca.crt\"" Jun 09 11:35:54.003752 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.003725 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xztgn\"/\"default-dockercfg-5jgv4\"" Jun 09 11:35:54.009556 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.009536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:54.014944 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.014924 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xztgn/must-gather-r2mvs"] Jun 09 11:35:54.082421 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.082382 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t5tr\" (UniqueName: \"kubernetes.io/projected/90e71980-c10f-46b9-9c0c-c22c28d48ab8-kube-api-access-7t5tr\") pod \"must-gather-r2mvs\" (UID: \"90e71980-c10f-46b9-9c0c-c22c28d48ab8\") " pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:35:54.082421 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.082429 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90e71980-c10f-46b9-9c0c-c22c28d48ab8-must-gather-output\") pod \"must-gather-r2mvs\" (UID: \"90e71980-c10f-46b9-9c0c-c22c28d48ab8\") " pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:35:54.101810 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.101785 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:35:54.183027 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.182978 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t5tr\" (UniqueName: \"kubernetes.io/projected/90e71980-c10f-46b9-9c0c-c22c28d48ab8-kube-api-access-7t5tr\") pod \"must-gather-r2mvs\" (UID: \"90e71980-c10f-46b9-9c0c-c22c28d48ab8\") " pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:35:54.183129 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.183041 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90e71980-c10f-46b9-9c0c-c22c28d48ab8-must-gather-output\") pod \"must-gather-r2mvs\" (UID: \"90e71980-c10f-46b9-9c0c-c22c28d48ab8\") " pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:35:54.183395 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.183376 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90e71980-c10f-46b9-9c0c-c22c28d48ab8-must-gather-output\") pod \"must-gather-r2mvs\" (UID: \"90e71980-c10f-46b9-9c0c-c22c28d48ab8\") " pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:35:54.194101 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.194067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t5tr\" (UniqueName: \"kubernetes.io/projected/90e71980-c10f-46b9-9c0c-c22c28d48ab8-kube-api-access-7t5tr\") pod \"must-gather-r2mvs\" (UID: \"90e71980-c10f-46b9-9c0c-c22c28d48ab8\") " pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:35:54.318224 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.318138 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:35:54.452127 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.451950 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xztgn/must-gather-r2mvs"] Jun 09 11:35:54.454648 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:35:54.454624 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90e71980_c10f_46b9_9c0c_c22c28d48ab8.slice/crio-780084a2b35957e6a469afa8e25411e7f850c448a056e8674b66c5c611b4179a WatchSource:0}: Error finding container 780084a2b35957e6a469afa8e25411e7f850c448a056e8674b66c5c611b4179a: Status 404 returned error can't find the container with id 780084a2b35957e6a469afa8e25411e7f850c448a056e8674b66c5c611b4179a Jun 09 11:35:54.456361 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.456339 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:35:54.620373 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:35:54.620277 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xztgn/must-gather-r2mvs" event={"ID":"90e71980-c10f-46b9-9c0c-c22c28d48ab8","Type":"ContainerStarted","Data":"780084a2b35957e6a469afa8e25411e7f850c448a056e8674b66c5c611b4179a"} Jun 09 11:36:01.650123 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:01.650079 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xztgn/must-gather-r2mvs" event={"ID":"90e71980-c10f-46b9-9c0c-c22c28d48ab8","Type":"ContainerStarted","Data":"7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998"} Jun 09 11:36:01.650567 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:01.650140 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xztgn/must-gather-r2mvs" event={"ID":"90e71980-c10f-46b9-9c0c-c22c28d48ab8","Type":"ContainerStarted","Data":"669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328"} Jun 09 11:36:01.671368 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:01.671296 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xztgn/must-gather-r2mvs" podStartSLOduration=2.491066626 podStartE2EDuration="8.671275633s" totalImagesPullingTime="6.180209007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:36:01.669191278 +0000 UTC m=+1717.577576594" watchObservedRunningTime="2026-06-09 11:36:01.671275633 +0000 UTC m=+1717.579660961" Jun 09 11:36:10.680551 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:10.680467 2558 generic.go:356] "Generic (PLEG): container finished" podID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" containerID="669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328" exitCode=0 Jun 09 11:36:10.680551 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:10.680514 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xztgn/must-gather-r2mvs" event={"ID":"90e71980-c10f-46b9-9c0c-c22c28d48ab8","Type":"ContainerDied","Data":"669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328"} Jun 09 11:36:10.681014 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:10.680810 2558 scope.go:117] "RemoveContainer" containerID="669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328" Jun 09 11:36:11.400300 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:11.400274 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xztgn_must-gather-r2mvs_90e71980-c10f-46b9-9c0c-c22c28d48ab8/gather/0.log" Jun 09 11:36:12.000965 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.000865 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:36:12.170478 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.170442 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vbd8c/must-gather-q58d6"] Jun 09 11:36:12.172561 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.172545 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbd8c/must-gather-q58d6" Jun 09 11:36:12.175216 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.175197 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbd8c\"/\"openshift-service-ca.crt\"" Jun 09 11:36:12.175398 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.175385 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vbd8c\"/\"default-dockercfg-mmc2g\"" Jun 09 11:36:12.175467 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.175431 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbd8c\"/\"kube-root-ca.crt\"" Jun 09 11:36:12.189070 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.189047 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbd8c/must-gather-q58d6"] Jun 09 11:36:12.206340 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.206286 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3056c60-3ff6-4009-a2a5-c8aeac41c07d-must-gather-output\") pod \"must-gather-q58d6\" (UID: \"a3056c60-3ff6-4009-a2a5-c8aeac41c07d\") " pod="openshift-must-gather-vbd8c/must-gather-q58d6" Jun 09 11:36:12.206491 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.206354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfdvr\" (UniqueName: \"kubernetes.io/projected/a3056c60-3ff6-4009-a2a5-c8aeac41c07d-kube-api-access-qfdvr\") pod \"must-gather-q58d6\" (UID: \"a3056c60-3ff6-4009-a2a5-c8aeac41c07d\") " pod="openshift-must-gather-vbd8c/must-gather-q58d6" Jun 09 11:36:12.215594 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.215569 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:36:12.307009 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.306926 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3056c60-3ff6-4009-a2a5-c8aeac41c07d-must-gather-output\") pod \"must-gather-q58d6\" (UID: \"a3056c60-3ff6-4009-a2a5-c8aeac41c07d\") " pod="openshift-must-gather-vbd8c/must-gather-q58d6" Jun 09 11:36:12.307147 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.307065 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfdvr\" (UniqueName: \"kubernetes.io/projected/a3056c60-3ff6-4009-a2a5-c8aeac41c07d-kube-api-access-qfdvr\") pod \"must-gather-q58d6\" (UID: \"a3056c60-3ff6-4009-a2a5-c8aeac41c07d\") " pod="openshift-must-gather-vbd8c/must-gather-q58d6" Jun 09 11:36:12.307245 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.307227 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3056c60-3ff6-4009-a2a5-c8aeac41c07d-must-gather-output\") pod \"must-gather-q58d6\" (UID: \"a3056c60-3ff6-4009-a2a5-c8aeac41c07d\") " pod="openshift-must-gather-vbd8c/must-gather-q58d6" Jun 09 11:36:12.315987 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.315960 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:36:12.319302 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.319276 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfdvr\" (UniqueName: \"kubernetes.io/projected/a3056c60-3ff6-4009-a2a5-c8aeac41c07d-kube-api-access-qfdvr\") pod \"must-gather-q58d6\" (UID: \"a3056c60-3ff6-4009-a2a5-c8aeac41c07d\") " pod="openshift-must-gather-vbd8c/must-gather-q58d6" Jun 09 11:36:12.481303 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.481261 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbd8c/must-gather-q58d6" Jun 09 11:36:12.615004 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.614967 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbd8c/must-gather-q58d6"] Jun 09 11:36:12.619236 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:36:12.619210 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3056c60_3ff6_4009_a2a5_c8aeac41c07d.slice/crio-f012cf3edbdeeecff541633b037444ad644ac91104b89e61835d4d11a02f5463 WatchSource:0}: Error finding container f012cf3edbdeeecff541633b037444ad644ac91104b89e61835d4d11a02f5463: Status 404 returned error can't find the container with id f012cf3edbdeeecff541633b037444ad644ac91104b89e61835d4d11a02f5463 Jun 09 11:36:12.689543 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:12.689510 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbd8c/must-gather-q58d6" event={"ID":"a3056c60-3ff6-4009-a2a5-c8aeac41c07d","Type":"ContainerStarted","Data":"f012cf3edbdeeecff541633b037444ad644ac91104b89e61835d4d11a02f5463"} Jun 09 11:36:13.697385 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:13.697347 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbd8c/must-gather-q58d6" event={"ID":"a3056c60-3ff6-4009-a2a5-c8aeac41c07d","Type":"ContainerStarted","Data":"3eca5d525c8381f34d08446258d3f8cc171606b166ac59946294067efd57af88"} Jun 09 11:36:13.697766 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:13.697400 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbd8c/must-gather-q58d6" event={"ID":"a3056c60-3ff6-4009-a2a5-c8aeac41c07d","Type":"ContainerStarted","Data":"3560e8406cef05fd0d4fa9adc70e9881d261f5fcc446f9c667ad19bbaa979841"} Jun 09 11:36:13.718926 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:13.718563 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vbd8c/must-gather-q58d6" podStartSLOduration=1.016028403 podStartE2EDuration="1.718543141s" totalImagesPullingTime="702.514738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:36:13.716893843 +0000 UTC m=+1729.625279168" watchObservedRunningTime="2026-06-09 11:36:13.718543141 +0000 UTC m=+1729.626928469" Jun 09 11:36:14.697439 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:14.697402 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-565cd_d35dc75d-89f4-405b-8e36-b479b12f9687/global-pull-secret-syncer/0.log" Jun 09 11:36:14.872961 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:14.872932 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" Jun 09 11:36:14.979946 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:14.979833 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-194.ec2.internal_f3ac2bd76351f2f2779b6b727bf860f7/haproxy/0.log" Jun 09 11:36:16.944630 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:16.944593 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xztgn/must-gather-r2mvs"] Jun 09 11:36:16.945406 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:16.945354 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-xztgn/must-gather-r2mvs" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" containerName="copy" containerID="cri-o://7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998" gracePeriod=2 Jun 09 11:36:16.947117 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:16.947088 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xztgn/must-gather-r2mvs"] Jun 09 11:36:16.947224 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:36:16.947083 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r2mvs\" is forbidden: User \"system:node:ip-10-0-131-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xztgn\": no relationship found between node 'ip-10-0-131-194.ec2.internal' and this object" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:36:17.312074 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.310903 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xztgn_must-gather-r2mvs_90e71980-c10f-46b9-9c0c-c22c28d48ab8/copy/0.log" Jun 09 11:36:17.317894 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.313421 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:36:17.317894 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:36:17.316103 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r2mvs\" is forbidden: User \"system:node:ip-10-0-131-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xztgn\": no relationship found between node 'ip-10-0-131-194.ec2.internal' and this object" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:36:17.348968 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.348135 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t5tr\" (UniqueName: \"kubernetes.io/projected/90e71980-c10f-46b9-9c0c-c22c28d48ab8-kube-api-access-7t5tr\") pod \"90e71980-c10f-46b9-9c0c-c22c28d48ab8\" (UID: \"90e71980-c10f-46b9-9c0c-c22c28d48ab8\") " Jun 09 11:36:17.348968 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.348192 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90e71980-c10f-46b9-9c0c-c22c28d48ab8-must-gather-output\") pod \"90e71980-c10f-46b9-9c0c-c22c28d48ab8\" (UID: \"90e71980-c10f-46b9-9c0c-c22c28d48ab8\") " Jun 09 11:36:17.348968 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.348670 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90e71980-c10f-46b9-9c0c-c22c28d48ab8-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "90e71980-c10f-46b9-9c0c-c22c28d48ab8" (UID: "90e71980-c10f-46b9-9c0c-c22c28d48ab8"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:36:17.355197 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.355153 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90e71980-c10f-46b9-9c0c-c22c28d48ab8-kube-api-access-7t5tr" (OuterVolumeSpecName: "kube-api-access-7t5tr") pod "90e71980-c10f-46b9-9c0c-c22c28d48ab8" (UID: "90e71980-c10f-46b9-9c0c-c22c28d48ab8"). InnerVolumeSpecName "kube-api-access-7t5tr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:36:17.448972 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.448909 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t5tr\" (UniqueName: \"kubernetes.io/projected/90e71980-c10f-46b9-9c0c-c22c28d48ab8-kube-api-access-7t5tr\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:36:17.448972 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.448945 2558 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90e71980-c10f-46b9-9c0c-c22c28d48ab8-must-gather-output\") on node \"ip-10-0-131-194.ec2.internal\" DevicePath \"\"" Jun 09 11:36:17.619380 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.619241 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:36:17.679272 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.679169 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l675b_cb3cf9c1-c138-4a7f-a389-7327c645757d/konnectivity-agent/0.log" limit=1024 Jun 09 11:36:17.722220 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.722181 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xztgn_must-gather-r2mvs_90e71980-c10f-46b9-9c0c-c22c28d48ab8/copy/0.log" Jun 09 11:36:17.723571 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.722697 2558 generic.go:356] "Generic (PLEG): container finished" podID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" containerID="7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998" exitCode=143 Jun 09 11:36:17.723571 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.722722 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:36:17.723571 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.722759 2558 scope.go:117] "RemoveContainer" containerID="7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998" Jun 09 11:36:17.725323 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:36:17.725284 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r2mvs\" is forbidden: User \"system:node:ip-10-0-131-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xztgn\": no relationship found between node 'ip-10-0-131-194.ec2.internal' and this object" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:36:17.741772 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.741749 2558 scope.go:117] "RemoveContainer" containerID="669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328" Jun 09 11:36:17.742804 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:36:17.742661 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r2mvs\" is forbidden: User \"system:node:ip-10-0-131-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xztgn\": no relationship found between node 'ip-10-0-131-194.ec2.internal' and this object" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" pod="openshift-must-gather-xztgn/must-gather-r2mvs" Jun 09 11:36:17.773614 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.772665 2558 scope.go:117] "RemoveContainer" containerID="7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998" Jun 09 11:36:17.773614 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:36:17.773135 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998\": container with ID starting with 7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998 not found: ID does not exist" containerID="7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998" Jun 09 11:36:17.773614 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.773183 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998"} err="failed to get container status \"7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998\": rpc error: code = NotFound desc = could not find container \"7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998\": container with ID starting with 7f419b1353270f409503eb6f0a972a96df0b5ab03df5fe2446160acd07f60998 not found: ID does not exist" Jun 09 11:36:17.773614 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.773208 2558 scope.go:117] "RemoveContainer" containerID="669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328" Jun 09 11:36:17.773614 ip-10-0-131-194 kubenswrapper[2558]: E0609 11:36:17.773527 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328\": container with ID starting with 669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328 not found: ID does not exist" containerID="669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328" Jun 09 11:36:17.773614 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:17.773557 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328"} err="failed to get container status \"669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328\": rpc error: code = NotFound desc = could not find container \"669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328\": container with ID starting with 669338a06983b36a2ae91215d845616e17eae39f444eb0b834e1268d599cf328 not found: ID does not exist" Jun 09 11:36:18.494662 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:18.494625 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" path="/var/lib/kubelet/pods/90e71980-c10f-46b9-9c0c-c22c28d48ab8/volumes" Jun 09 11:36:18.995329 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:18.995293 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-67qpd_e04d5d70-0394-4895-81fe-c1e71f84d804/kube-state-metrics/0.log" Jun 09 11:36:19.023418 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:19.023390 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-67qpd_e04d5d70-0394-4895-81fe-c1e71f84d804/kube-rbac-proxy-main/0.log" Jun 09 11:36:19.047118 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:19.047086 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-67qpd_e04d5d70-0394-4895-81fe-c1e71f84d804/kube-rbac-proxy-self/0.log" Jun 09 11:36:19.311942 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:19.311813 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnk7k_ab5c4ed4-b890-4334-b6fd-087944f5eaba/node-exporter/0.log" Jun 09 11:36:19.334530 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:19.334501 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnk7k_ab5c4ed4-b890-4334-b6fd-087944f5eaba/kube-rbac-proxy/0.log" Jun 09 11:36:19.361894 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:19.361851 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnk7k_ab5c4ed4-b890-4334-b6fd-087944f5eaba/init-textfile/0.log" Jun 09 11:36:19.389575 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:19.389548 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zsmcx_4384b8d3-6af8-4da2-bd40-e266e46787e0/kube-rbac-proxy-main/0.log" Jun 09 11:36:19.419716 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:19.419682 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zsmcx_4384b8d3-6af8-4da2-bd40-e266e46787e0/kube-rbac-proxy-self/0.log" Jun 09 11:36:19.449153 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:19.449124 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zsmcx_4384b8d3-6af8-4da2-bd40-e266e46787e0/openshift-state-metrics/0.log" Jun 09 11:36:19.757555 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:19.757521 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-kdvts_8758f314-ec7e-4f86-8187-c81273d2c130/prometheus-operator-admission-webhook/0.log" Jun 09 11:36:22.026845 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.026818 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c8864465d-psjzz_90dcde54-ff55-4d75-b5c3-5789193112e1/console/0.log" Jun 09 11:36:22.250062 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.250028 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf"] Jun 09 11:36:22.250323 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.250309 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" containerName="gather" Jun 09 11:36:22.250376 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.250324 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" containerName="gather" Jun 09 11:36:22.250376 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.250333 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" containerName="copy" Jun 09 11:36:22.250376 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.250338 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" containerName="copy" Jun 09 11:36:22.250478 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.250404 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" containerName="copy" Jun 09 11:36:22.250478 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.250416 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="90e71980-c10f-46b9-9c0c-c22c28d48ab8" containerName="gather" Jun 09 11:36:22.254699 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.254672 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.271588 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.271560 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf"] Jun 09 11:36:22.294734 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.294649 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz284\" (UniqueName: \"kubernetes.io/projected/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-kube-api-access-cz284\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.294734 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.294716 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-podres\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.294947 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.294765 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-lib-modules\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.294947 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.294798 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-sys\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.294947 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.294828 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-proc\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.395721 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.395672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz284\" (UniqueName: \"kubernetes.io/projected/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-kube-api-access-cz284\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.395930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.395756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-podres\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.395930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.395787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-lib-modules\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.395930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.395814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-sys\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.395930 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.395853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-proc\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.396214 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.396090 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-proc\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.396214 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.396112 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-lib-modules\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.396214 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.396175 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-sys\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.396366 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.396224 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-podres\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.406359 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.406328 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz284\" (UniqueName: \"kubernetes.io/projected/b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5-kube-api-access-cz284\") pod \"perf-node-gather-daemonset-9vlkf\" (UID: \"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5\") " pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.567596 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.567508 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:22.722090 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.722055 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf"] Jun 09 11:36:22.725105 ip-10-0-131-194 kubenswrapper[2558]: W0609 11:36:22.725072 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb1ad37aa_f2c7_4d77_8fcd_ea34c66474f5.slice/crio-8c176a217d5cc7c3e86e8f8c9babfd1d561f0700d3129972169694ae9055ffca WatchSource:0}: Error finding container 8c176a217d5cc7c3e86e8f8c9babfd1d561f0700d3129972169694ae9055ffca: Status 404 returned error can't find the container with id 8c176a217d5cc7c3e86e8f8c9babfd1d561f0700d3129972169694ae9055ffca Jun 09 11:36:22.748416 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:22.748390 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" event={"ID":"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5","Type":"ContainerStarted","Data":"8c176a217d5cc7c3e86e8f8c9babfd1d561f0700d3129972169694ae9055ffca"} Jun 09 11:36:23.579843 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:23.579812 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tfxhn_54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3/dns/0.log" Jun 09 11:36:23.633018 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:23.632993 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tfxhn_54e4f2ff-e9f1-49a7-b9fa-7bdc47e5a6c3/kube-rbac-proxy/0.log" Jun 09 11:36:23.677822 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:23.677800 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9xqst_0b30eae0-cd00-4a3f-9406-1c8bae36286a/dns-node-resolver/0.log" Jun 09 11:36:23.753649 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:23.753619 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" event={"ID":"b1ad37aa-f2c7-4d77-8fcd-ea34c66474f5","Type":"ContainerStarted","Data":"f85cef96d0dc3268d07e4da91458c2c6612c7ee17d0f8fd140e171f1e4bd30f4"} Jun 09 11:36:23.753800 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:23.753685 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:23.773445 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:23.773392 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" podStartSLOduration=1.773374398 podStartE2EDuration="1.773374398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:36:23.77213902 +0000 UTC m=+1739.680524348" watchObservedRunningTime="2026-06-09 11:36:23.773374398 +0000 UTC m=+1739.681759726" Jun 09 11:36:24.136774 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:24.136744 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-866bc55cb7-8nfch_af85f2f8-f1f8-4d8e-8911-0569da059f64/registry/0.log" Jun 09 11:36:24.206209 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:24.206179 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wpnv2_04267d35-9ac0-4466-a7db-9740e669c681/node-ca/0.log" Jun 09 11:36:25.296754 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:25.296726 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dprqh_60af79fd-4dda-4e86-8fb5-2f329d0e405d/serve-healthcheck-canary/0.log" Jun 09 11:36:25.787685 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:25.787654 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7rbx9_3855fc3e-327f-4768-b01b-af138bcc65eb/kube-rbac-proxy/0.log" Jun 09 11:36:25.810276 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:25.810250 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7rbx9_3855fc3e-327f-4768-b01b-af138bcc65eb/exporter/0.log" Jun 09 11:36:25.835885 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:25.835840 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7rbx9_3855fc3e-327f-4768-b01b-af138bcc65eb/extractor/0.log" Jun 09 11:36:29.770112 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:29.770069 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vbd8c/perf-node-gather-daemonset-9vlkf" Jun 09 11:36:31.945152 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:31.945129 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fqd6x_ae67b253-e67a-42ee-b1b4-a6c26204ff9f/kube-multus-additional-cni-plugins/0.log" Jun 09 11:36:31.971964 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:31.971938 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fqd6x_ae67b253-e67a-42ee-b1b4-a6c26204ff9f/egress-router-binary-copy/0.log" Jun 09 11:36:32.003154 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:32.003123 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fqd6x_ae67b253-e67a-42ee-b1b4-a6c26204ff9f/cni-plugins/0.log" Jun 09 11:36:32.028096 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:32.028071 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fqd6x_ae67b253-e67a-42ee-b1b4-a6c26204ff9f/bond-cni-plugin/0.log" Jun 09 11:36:32.052504 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:32.052477 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fqd6x_ae67b253-e67a-42ee-b1b4-a6c26204ff9f/routeoverride-cni/0.log" Jun 09 11:36:32.073588 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:32.073555 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fqd6x_ae67b253-e67a-42ee-b1b4-a6c26204ff9f/whereabouts-cni-bincopy/0.log" Jun 09 11:36:32.095162 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:32.095141 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fqd6x_ae67b253-e67a-42ee-b1b4-a6c26204ff9f/whereabouts-cni/0.log" Jun 09 11:36:32.291656 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:32.291577 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dxpxr_b3041b5f-fb01-4263-ac00-feae98ffd75b/kube-multus/0.log" Jun 09 11:36:32.407980 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:32.407951 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kb4nv_1e0a06bb-e1b3-42c5-be16-57d0a40b8990/network-metrics-daemon/0.log" Jun 09 11:36:32.429183 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:32.429157 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kb4nv_1e0a06bb-e1b3-42c5-be16-57d0a40b8990/kube-rbac-proxy/0.log" Jun 09 11:36:33.506169 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:33.506144 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nm45q_45861504-7f9b-4628-bb0f-e54074f31d71/ovn-controller/0.log" Jun 09 11:36:33.526107 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:33.526086 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nm45q_45861504-7f9b-4628-bb0f-e54074f31d71/ovn-acl-logging/0.log" Jun 09 11:36:33.550649 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:33.550621 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nm45q_45861504-7f9b-4628-bb0f-e54074f31d71/kube-rbac-proxy-node/0.log" Jun 09 11:36:33.574908 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:33.574863 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nm45q_45861504-7f9b-4628-bb0f-e54074f31d71/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 11:36:33.595147 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:33.595129 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nm45q_45861504-7f9b-4628-bb0f-e54074f31d71/northd/0.log" Jun 09 11:36:33.615918 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:33.615861 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nm45q_45861504-7f9b-4628-bb0f-e54074f31d71/nbdb/0.log" Jun 09 11:36:33.637529 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:33.637511 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nm45q_45861504-7f9b-4628-bb0f-e54074f31d71/sbdb/0.log" Jun 09 11:36:33.679442 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:33.679414 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nm45q_45861504-7f9b-4628-bb0f-e54074f31d71/ovnkube-controller/0.log" Jun 09 11:36:34.883004 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:34.882976 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tnz62_5fb47958-5ed9-4a06-8ce5-d1962f5aeb65/network-check-target-container/0.log" Jun 09 11:36:35.825633 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:35.825603 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-s6vzx_5d4e7287-8535-4c9f-951e-4fbab9770dcd/iptables-alerter/0.log" Jun 09 11:36:36.443203 ip-10-0-131-194 kubenswrapper[2558]: I0609 11:36:36.443179 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-ln24x_55c63786-c0b0-4457-843a-eb1d16b62564/tuned/0.log"