Jun 09 09:33:12.989044 ip-10-0-131-231 systemd[1]: Starting Kubernetes Kubelet... Jun 09 09:33:13.459105 ip-10-0-131-231 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 09:33:13.459105 ip-10-0-131-231 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 09:33:13.459105 ip-10-0-131-231 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 09:33:13.459105 ip-10-0-131-231 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 09:33:13.459105 ip-10-0-131-231 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 09:33:13.462104 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.462018 2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 09:33:13.470116 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470088 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:33:13.470116 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470107 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:33:13.470116 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470111 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:33:13.470116 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470115 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:33:13.470116 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470118 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:33:13.470116 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470122 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:33:13.470116 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470125 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470129 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470132 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470135 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470138 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470140 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470143 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470146 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470149 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470152 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470154 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470156 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470159 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470161 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470164 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470166 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470169 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470171 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470174 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470176 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:33:13.470366 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470179 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470181 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470187 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470189 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470192 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470194 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470197 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470199 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470202 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470204 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470207 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470210 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470212 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470215 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470218 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470221 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470224 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470228 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470231 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470234 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:33:13.470863 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470237 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470240 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470242 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470245 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470248 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470251 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470254 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470256 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470259 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470261 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470264 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470266 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470271 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470274 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470277 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470280 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470283 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470285 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470289 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:33:13.471353 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470291 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470293 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470297 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470300 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470302 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470305 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470307 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470311 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470313 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470316 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470318 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470321 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470324 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470327 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470329 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470332 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470334 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470336 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470345 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470348 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:33:13.471829 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470350 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470353 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470355 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470358 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470360 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470362 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470366 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470370 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470373 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470376 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470379 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470382 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470384 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.470386 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471112 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471119 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471122 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471125 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471128 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:33:13.472305 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471131 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471134 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471137 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471140 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471142 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471145 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471148 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471150 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471153 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471156 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471158 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471161 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471164 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471167 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471170 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471173 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471176 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471178 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471180 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471183 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:33:13.472783 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471185 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471188 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471190 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471193 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471195 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471198 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471201 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471203 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471205 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471208 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471210 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471213 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471217 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471220 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471222 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471225 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471228 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471231 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471233 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471236 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:33:13.473299 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471238 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471241 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471243 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471246 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471248 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471252 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471254 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471257 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471260 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471262 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471265 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471268 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471271 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471274 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471276 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471279 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471281 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471284 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471287 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:33:13.473810 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471289 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471292 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471295 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471300 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471304 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471308 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471311 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471314 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471318 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471321 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471325 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471328 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471331 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471334 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471336 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471339 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471341 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471344 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471346 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:33:13.474278 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471349 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471352 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471355 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471358 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471360 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471363 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471366 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471368 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471372 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471377 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471380 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471383 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471386 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471389 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471391 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471394 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471821 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471827 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471831 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471837 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:33:13.474792 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471840 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471843 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471847 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471850 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471852 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471855 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471858 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471861 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471864 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471867 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471870 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471873 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471876 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471879 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471882 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471884 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471887 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471889 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471892 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471894 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:33:13.475287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471897 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471900 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471903 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471906 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471910 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471913 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471916 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471919 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471922 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471925 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471928 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471933 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471936 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471940 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471942 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471945 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471950 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471954 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471956 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:33:13.475818 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471959 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471961 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471964 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471967 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471969 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471972 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471978 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471981 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471984 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471986 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471989 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471991 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471994 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471996 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.471999 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472001 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472004 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472006 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472009 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472011 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:33:13.476287 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472014 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472016 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472019 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472022 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472024 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472027 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472029 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472032 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472034 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472039 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472041 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472044 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472046 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472049 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472051 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472054 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472057 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472059 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472061 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:33:13.476787 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472065 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472069 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472072 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472075 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472079 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472082 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472085 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472088 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472090 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472093 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472095 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472098 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472100 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472106 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472109 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472111 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472114 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472189 2571 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472204 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472211 2571 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472216 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 09:33:13.477297 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472220 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472227 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472231 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472236 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472239 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472242 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472246 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472249 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472252 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472255 2571 flags.go:64] FLAG: --cgroup-root="" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472258 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472261 2571 flags.go:64] FLAG: --client-ca-file="" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472270 2571 flags.go:64] FLAG: --cloud-provider="external" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472273 2571 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472279 2571 flags.go:64] FLAG: --cluster-domain="" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472282 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472285 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472288 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472292 2571 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472296 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472299 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472302 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472305 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472309 2571 flags.go:64] FLAG: --contention-profiling="false" Jun 09 09:33:13.477817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472313 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472317 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472320 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472323 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472327 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472330 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472332 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472335 2571 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472338 2571 flags.go:64] FLAG: --enable-server="true" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472342 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472349 2571 flags.go:64] FLAG: --event-burst="100" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472352 2571 flags.go:64] FLAG: --event-qps="50" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472355 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472358 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472361 2571 flags.go:64] FLAG: --eviction-hard="" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472365 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472367 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472370 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472373 2571 flags.go:64] FLAG: --eviction-soft="" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472376 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472379 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472389 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472393 2571 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472395 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472398 2571 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 09:33:13.478387 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472401 2571 flags.go:64] FLAG: --feature-gates="" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472405 2571 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472408 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472411 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472414 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472417 2571 flags.go:64] FLAG: --healthz-port="10248" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472420 2571 flags.go:64] FLAG: --help="false" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472423 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472426 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472429 2571 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472432 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472435 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472439 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472441 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472444 2571 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472447 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472450 2571 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472453 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472456 2571 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472459 2571 flags.go:64] FLAG: --kube-reserved="" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472462 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472465 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472468 2571 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472471 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 09:33:13.479100 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472474 2571 flags.go:64] FLAG: --lock-file="" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472476 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472479 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472482 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472487 2571 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472491 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472493 2571 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472496 2571 flags.go:64] FLAG: --logging-format="text" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472499 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472502 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472505 2571 flags.go:64] FLAG: --manifest-url="" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472508 2571 flags.go:64] FLAG: --manifest-url-header="" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472512 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472515 2571 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472519 2571 flags.go:64] FLAG: --max-pods="110" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472522 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472525 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472528 2571 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472531 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472534 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472537 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472540 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472548 2571 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472551 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472554 2571 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 09:33:13.479691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472557 2571 flags.go:64] FLAG: --pod-cidr="" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472560 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472565 2571 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472568 2571 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472571 2571 flags.go:64] FLAG: --pods-per-core="0" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472574 2571 flags.go:64] FLAG: --port="10250" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472577 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472581 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08539932576c0c897" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472584 2571 flags.go:64] FLAG: --qos-reserved="" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472587 2571 flags.go:64] FLAG: --read-only-port="10255" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472589 2571 flags.go:64] FLAG: --register-node="true" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472592 2571 flags.go:64] FLAG: --register-with-taints="" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472596 2571 flags.go:64] FLAG: --registry-burst="10" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472604 2571 flags.go:64] FLAG: --registry-qps="5" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472607 2571 flags.go:64] FLAG: --reserved-cpus="" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472610 2571 flags.go:64] FLAG: --reserved-memory="" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472617 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472620 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472624 2571 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472626 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472629 2571 flags.go:64] FLAG: --runonce="false" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472632 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472635 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472638 2571 flags.go:64] FLAG: --seccomp-default="false" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472641 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 09:33:13.480338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472643 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472646 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472649 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472652 2571 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472655 2571 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472658 2571 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472661 2571 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472664 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472667 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472669 2571 flags.go:64] FLAG: --system-cgroups="" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472672 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472677 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472680 2571 flags.go:64] FLAG: --tls-cert-file="" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472683 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472689 2571 flags.go:64] FLAG: --tls-min-version="" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472692 2571 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472695 2571 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472697 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472700 2571 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472703 2571 flags.go:64] FLAG: --v="2" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472707 2571 flags.go:64] FLAG: --version="false" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472711 2571 flags.go:64] FLAG: --vmodule="" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472715 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.472718 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472843 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:33:13.481011 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472847 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472850 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472853 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472856 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472859 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472862 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472864 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472867 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472870 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472872 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472875 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472878 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472880 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472884 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472887 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472890 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472892 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472894 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472897 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472900 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:33:13.481633 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472902 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472904 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472907 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472909 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472912 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472914 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472917 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472919 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472922 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472926 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472929 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472932 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472935 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472937 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472940 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472942 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472945 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472950 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472952 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:33:13.482148 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472955 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472957 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472960 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472962 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472965 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472967 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472971 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472974 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472977 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472979 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472981 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472984 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472987 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472989 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472992 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472994 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472997 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.472999 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473002 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473004 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:33:13.482616 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473007 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473009 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473012 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473016 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473018 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473021 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473023 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473026 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473028 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473031 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473034 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473037 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473039 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473042 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473045 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473047 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473050 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473052 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473058 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473061 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:33:13.483119 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473064 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473067 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473069 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473072 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473075 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473077 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473080 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473083 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473085 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473089 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473092 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473095 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473098 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473101 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473104 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473107 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473110 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473112 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:33:13.483609 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.473115 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.474387 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.481022 2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.481039 2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.481066 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.481072 2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481128 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481133 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481136 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481139 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481143 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481146 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481148 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481151 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481154 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:33:13.484057 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481157 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481159 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481162 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481165 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481168 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481170 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481173 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481175 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481178 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481180 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481183 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481185 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481188 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481191 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481194 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481197 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481199 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481202 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481205 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481208 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:33:13.484483 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481212 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481216 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481220 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481223 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481227 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481231 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481234 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481237 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481240 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481243 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481246 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481248 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481251 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481254 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481257 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481259 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481262 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481264 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481268 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:33:13.484973 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481270 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481273 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481275 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481278 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481282 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481293 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481296 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481299 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481302 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481305 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481308 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481311 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481314 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481318 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481321 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481324 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481327 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481329 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481332 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:33:13.485455 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481334 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481337 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481340 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481342 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481345 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481347 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481350 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481352 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481355 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481357 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481360 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481362 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481365 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481368 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481370 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481373 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481375 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481378 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481380 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481383 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:33:13.485919 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481386 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481389 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481392 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481394 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481397 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481399 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481402 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481405 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481408 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481410 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481413 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481416 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.481421 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481529 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481534 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:33:13.486400 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481537 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481540 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481543 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481546 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481548 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481551 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481555 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481559 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481561 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481564 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481567 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481571 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481573 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481576 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481579 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481582 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481585 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481587 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481590 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481592 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:33:13.486785 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481595 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481598 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481600 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481603 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481606 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481608 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481612 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481615 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481617 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481620 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481622 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481625 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481627 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481630 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481632 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481635 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481638 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481640 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481643 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481646 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:33:13.487275 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481648 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481651 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481654 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481656 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481659 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481661 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481664 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481667 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481669 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481674 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481679 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481682 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481685 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481688 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481691 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481693 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481696 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481699 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:33:13.487832 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481702 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481706 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481708 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481711 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481713 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481715 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481718 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481721 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481723 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481725 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481728 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481730 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481733 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481735 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481738 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481740 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481743 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481757 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481760 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:33:13.488277 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481762 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481765 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481768 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481770 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481773 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481776 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481778 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481781 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481783 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481786 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481789 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481791 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481794 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481796 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481799 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481802 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481804 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481807 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481809 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:33:13.488727 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:13.481812 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:33:13.489191 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.481817 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 09:33:13.489191 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.481923 2571 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 09:33:13.489191 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.485251 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 09:33:13.489191 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.486862 2571 server.go:1019] "Starting client certificate rotation" Jun 09 09:33:13.489191 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.486960 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 09:33:13.489191 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.486994 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 09:33:13.489928 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.489915 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 09:33:13.498886 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.498620 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 09:33:13.508185 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.508165 2571 log.go:25] "Validated CRI v1 runtime API" Jun 09 09:33:13.510904 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.510890 2571 log.go:25] "Validated CRI v1 image API" Jun 09 09:33:13.512784 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.512769 2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 09:33:13.515635 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.515605 2571 fs.go:135] Filesystem UUIDs: map[39ff827f-05d9-4df9-b70e-d94191d5846e:/dev/nvme0n1p3 6a288fc4-481e-44e7-b305-73e7cdbad06a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 09 09:33:13.515702 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.515636 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 09:33:13.520147 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.520038 2571 manager.go:216] Machine: {Timestamp:2026-06-09 09:33:13.519509164 +0000 UTC m=+0.395320095 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097455 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26ca03b7f5507576061f7711c5e163 SystemUUID:ec26ca03-b7f5-5075-7606-1f7711c5e163 BootID:5ed07cf4-3e95-4c77-a6b5-bde23dc99341 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:77:37:da:76:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:77:37:da:76:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:e1:8c:23:73:ca Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 09:33:13.520147 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.520140 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 09:33:13.520250 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.520214 2571 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 09:33:13.521372 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.521357 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 09:33:13.524232 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.524210 2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 09:33:13.524380 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.524238 2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-231.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 09:33:13.525209 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.525199 2571 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 09:33:13.525242 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.525211 2571 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 09:33:13.525242 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.525223 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 09:33:13.526680 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.526670 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 09:33:13.527706 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.527696 2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 09:33:13.532343 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.532332 2571 state_mem.go:36] "Initialized new in-memory state store" Jun 09 09:33:13.532470 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.532461 2571 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 09:33:13.532505 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.532492 2571 kubelet.go:486] "Attempting to sync node with API server" Jun 09 09:33:13.532536 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.532506 2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 09:33:13.532536 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.532528 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 09:33:13.532587 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.532542 2571 kubelet.go:398] "Adding apiserver pod source" Jun 09 09:33:13.532587 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.532554 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 09:33:13.533361 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.533210 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 09:33:13.533412 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.533373 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 09:33:13.537776 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.537759 2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 09:33:13.540145 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.540123 2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 09:33:13.540225 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.540154 2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 09:33:13.540993 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.540983 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 09:33:13.541058 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.540997 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 09:33:13.541058 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.541004 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 09:33:13.541058 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.541012 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 09:33:13.541058 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.541026 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 09:33:13.541058 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.541035 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 09:33:13.541058 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.541047 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 09:33:13.541058 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.541056 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 09:33:13.541242 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.541066 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 09:33:13.541242 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.541075 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 09:33:13.541242 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.541087 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 09:33:13.541242 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.541095 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 09:33:13.542166 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.542145 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 09:33:13.542166 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.542145 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 09:33:13.543146 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.543132 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 09:33:13.543186 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.543148 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 09:33:13.546211 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.546198 2571 server.go:1268] "Started kubelet" Jun 09 09:33:13.546330 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.546307 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 09:33:13.546383 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.546352 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 09:33:13.549704 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.549668 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 09:33:13.549997 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.549969 2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 09:33:13.550166 ip-10-0-131-231 systemd[1]: Started Kubernetes Kubelet. Jun 09 09:33:13.554185 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.554171 2571 server.go:310] "Adding debug handlers to kubelet server" Jun 09 09:33:13.555692 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.555674 2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 09:33:13.556147 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.556132 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-231.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 09:33:13.557230 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.556147 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-231.ec2.internal.18b75fe00d251653 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-231.ec2.internal,UID:ip-10-0-131-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-231.ec2.internal,},FirstTimestamp:2026-06-09 09:33:13.546167891 +0000 UTC m=+0.421978823,LastTimestamp:2026-06-09 09:33:13.546167891 +0000 UTC m=+0.421978823,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-231.ec2.internal,}" Jun 09 09:33:13.558828 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.558814 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tlf88" Jun 09 09:33:13.559189 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.559173 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 09:33:13.559657 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.559644 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 09:33:13.559769 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.559730 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:13.560352 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560335 2571 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 09:33:13.560352 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560352 2571 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 09:33:13.560510 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560335 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 09:33:13.560510 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560462 2571 factory.go:55] Registering systemd factory Jun 09 09:33:13.560510 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560495 2571 factory.go:223] Registration of the systemd container factory successfully Jun 09 09:33:13.560633 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560462 2571 reconstruct.go:97] "Volume reconstruction finished" Jun 09 09:33:13.560633 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560529 2571 reconciler.go:29] "Reconciler: start to sync state" Jun 09 09:33:13.560716 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560704 2571 factory.go:153] Registering CRI-O factory Jun 09 09:33:13.560774 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560719 2571 factory.go:223] Registration of the crio container factory successfully Jun 09 09:33:13.560820 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560795 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 09:33:13.560867 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560825 2571 factory.go:103] Registering Raw factory Jun 09 09:33:13.560867 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.560841 2571 manager.go:1196] Started watching for new ooms in manager Jun 09 09:33:13.561905 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.561888 2571 manager.go:349] Starting recovery of all containers Jun 09 09:33:13.566702 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.566679 2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 09:33:13.566821 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.566784 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 09:33:13.567205 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.567176 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tlf88" Jun 09 09:33:13.572168 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.572153 2571 manager.go:354] Recovery completed Jun 09 09:33:13.576212 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.576201 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:33:13.578117 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.578101 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:33:13.578211 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.578132 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:33:13.578211 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.578153 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:33:13.578779 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.578764 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 09:33:13.578779 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.578778 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 09:33:13.578895 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.578781 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:33:13.578895 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.578794 2571 state_mem.go:36] "Initialized new in-memory state store" Jun 09 09:33:13.579787 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.579728 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:33:13.579787 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.579767 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:33:13.579787 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.579790 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:33:13.580072 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.580055 2571 policy_none.go:49] "None policy: Start" Jun 09 09:33:13.580132 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.580017 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-231.ec2.internal.18b75fe00f0c929c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-231.ec2.internal,UID:ip-10-0-131-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-231.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-231.ec2.internal,},FirstTimestamp:2026-06-09 09:33:13.57811574 +0000 UTC m=+0.453926679,LastTimestamp:2026-06-09 09:33:13.57811574 +0000 UTC m=+0.453926679,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-231.ec2.internal,}" Jun 09 09:33:13.580181 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.580077 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 09:33:13.580218 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.580172 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 09:33:13.581961 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.581948 2571 policy_none.go:47] "Start" Jun 09 09:33:13.618332 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.618317 2571 manager.go:337] "Starting Device Plugin manager" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.618347 2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.618356 2571 server.go:87] "Starting device plugin registration server" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.618578 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.618589 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.618687 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.618780 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.618791 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.619597 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.619649 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.625093 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.626375 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.626416 2571 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.626438 2571 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.626473 2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 09:33:13.640314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.628633 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:33:13.719564 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.719489 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:33:13.720763 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.720733 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:33:13.720862 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.720782 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:33:13.720862 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.720798 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:33:13.720862 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.720822 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.726895 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.726876 2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal"] Jun 09 09:33:13.726977 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.726948 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:33:13.729007 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.728983 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:33:13.729105 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.729012 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.729105 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.729034 2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-231.ec2.internal\": node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:13.729105 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.729015 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:33:13.729235 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.729109 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:33:13.730587 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.730574 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:33:13.730705 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.730691 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.730744 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.730720 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:33:13.731271 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.731251 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:33:13.731370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.731259 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:33:13.731370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.731313 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:33:13.731370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.731326 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:33:13.731370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.731284 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:33:13.731370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.731360 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:33:13.733443 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.733427 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.733536 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.733457 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:33:13.734136 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.734120 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:33:13.734208 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.734149 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:33:13.734208 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.734162 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:33:13.746151 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.746133 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:13.760416 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.760392 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-231.ec2.internal\" not found" node="ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.761441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.761415 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5716f55cdce17e3b4b08e17f23bf315-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"c5716f55cdce17e3b4b08e17f23bf315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.761530 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.761454 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5716f55cdce17e3b4b08e17f23bf315-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"c5716f55cdce17e3b4b08e17f23bf315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.761530 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.761480 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f568bfae37cdddb9b7965ef2ed23b8d3-config\") pod \"kube-apiserver-proxy-ip-10-0-131-231.ec2.internal\" (UID: \"f568bfae37cdddb9b7965ef2ed23b8d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.765049 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.765033 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-231.ec2.internal\" not found" node="ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.846812 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.846786 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:13.862073 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.862050 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5716f55cdce17e3b4b08e17f23bf315-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"c5716f55cdce17e3b4b08e17f23bf315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.862199 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.862079 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5716f55cdce17e3b4b08e17f23bf315-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"c5716f55cdce17e3b4b08e17f23bf315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.862199 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.862106 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f568bfae37cdddb9b7965ef2ed23b8d3-config\") pod \"kube-apiserver-proxy-ip-10-0-131-231.ec2.internal\" (UID: \"f568bfae37cdddb9b7965ef2ed23b8d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.862199 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.862152 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f568bfae37cdddb9b7965ef2ed23b8d3-config\") pod \"kube-apiserver-proxy-ip-10-0-131-231.ec2.internal\" (UID: \"f568bfae37cdddb9b7965ef2ed23b8d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.862199 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.862163 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5716f55cdce17e3b4b08e17f23bf315-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"c5716f55cdce17e3b4b08e17f23bf315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.862199 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:13.862168 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5716f55cdce17e3b4b08e17f23bf315-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"c5716f55cdce17e3b4b08e17f23bf315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Jun 09 09:33:13.947232 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:13.947200 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.048009 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:14.047938 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.065450 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.065425 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Jun 09 09:33:14.070778 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.070763 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Jun 09 09:33:14.148505 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:14.148466 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.248979 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:14.248952 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.349540 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:14.349471 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.449975 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:14.449949 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.486430 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.486405 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 09:33:14.487022 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.486535 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 09:33:14.550897 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:14.550866 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.570613 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.570581 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 09:28:13 +0000 UTC" deadline="2027-11-15 16:17:08.110316117 +0000 UTC" Jun 09 09:33:14.570613 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.570610 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12582h43m53.539709437s" Jun 09 09:33:14.623497 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:14.623461 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5716f55cdce17e3b4b08e17f23bf315.slice/crio-3df8d80d7c9de6335cc9a19eb53ea310b8235b1c7397bc9ff1641ccafd3d9985 WatchSource:0}: Error finding container 3df8d80d7c9de6335cc9a19eb53ea310b8235b1c7397bc9ff1641ccafd3d9985: Status 404 returned error can't find the container with id 3df8d80d7c9de6335cc9a19eb53ea310b8235b1c7397bc9ff1641ccafd3d9985 Jun 09 09:33:14.624443 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:14.624415 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf568bfae37cdddb9b7965ef2ed23b8d3.slice/crio-5ed5f35999b2badb9925f15418aa45f65705acaaaac787f32699a8e61b420306 WatchSource:0}: Error finding container 5ed5f35999b2badb9925f15418aa45f65705acaaaac787f32699a8e61b420306: Status 404 returned error can't find the container with id 5ed5f35999b2badb9925f15418aa45f65705acaaaac787f32699a8e61b420306 Jun 09 09:33:14.629302 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.629255 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 09:33:14.629535 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.629486 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" event={"ID":"c5716f55cdce17e3b4b08e17f23bf315","Type":"ContainerStarted","Data":"3df8d80d7c9de6335cc9a19eb53ea310b8235b1c7397bc9ff1641ccafd3d9985"} Jun 09 09:33:14.630689 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.630665 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" event={"ID":"f568bfae37cdddb9b7965ef2ed23b8d3","Type":"ContainerStarted","Data":"5ed5f35999b2badb9925f15418aa45f65705acaaaac787f32699a8e61b420306"} Jun 09 09:33:14.651383 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:14.651365 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.663976 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.663954 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:33:14.752378 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:14.752352 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.852855 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:14.852823 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.953451 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:14.953373 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:14.997701 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:14.997670 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:33:15.053505 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.053471 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Jun 09 09:33:15.138819 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.138792 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:33:15.160253 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.160202 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Jun 09 09:33:15.170876 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.170848 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 09:33:15.172225 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.172199 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Jun 09 09:33:15.183054 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.183026 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 09:33:15.533820 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.533792 2571 apiserver.go:52] "Watching apiserver" Jun 09 09:33:15.543563 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.543530 2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 09:33:15.543984 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.543955 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-grn2p","openshift-multus/multus-nq5mn","openshift-ovn-kubernetes/ovnkube-node-4pllj","kube-system/global-pull-secret-syncer-nmz6l","openshift-cluster-node-tuning-operator/tuned-rx5m9","openshift-dns/node-resolver-842b5","openshift-multus/network-metrics-daemon-w4s2k","openshift-network-diagnostics/network-check-target-rbd4m","openshift-network-operator/iptables-alerter-86dsl","kube-system/konnectivity-agent-dj8s5","kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92","openshift-image-registry/node-ca-vsldw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal"] Jun 09 09:33:15.546017 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.545991 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:15.547404 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.547130 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.548802 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.548576 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z69bv\"" Jun 09 09:33:15.548802 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.548651 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 09:33:15.548942 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.548838 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.549044 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.549024 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 09:33:15.550150 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.549962 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c657h\"" Jun 09 09:33:15.550150 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.550026 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 09:33:15.550150 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.550049 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 09:33:15.550150 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.550093 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 09:33:15.550439 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.550161 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 09:33:15.552175 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.552152 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:15.552265 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.552232 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:15.553515 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.553354 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 09:33:15.553515 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.553354 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 09:33:15.554196 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.553957 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:15.554196 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.554043 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:15.554771 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.554508 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 09:33:15.554771 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.554587 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 09:33:15.554922 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.554787 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 09:33:15.554922 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.554866 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 09:33:15.554922 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.554789 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d6sgl\"" Jun 09 09:33:15.555952 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.555778 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.557245 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.557049 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.558061 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.558037 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 09:33:15.558152 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.558104 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vwkb9\"" Jun 09 09:33:15.558152 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.558118 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 09:33:15.558693 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.558675 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.559418 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.559224 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 09:33:15.559854 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.559831 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hfswg\"" Jun 09 09:33:15.560232 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.560105 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 09:33:15.560232 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.560129 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 09:33:15.560232 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.560136 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 09:33:15.560478 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.560461 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.561237 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.561219 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 09:33:15.561335 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.561242 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 09:33:15.561476 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.561456 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fg5tf\"" Jun 09 09:33:15.561580 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.561514 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 09:33:15.562227 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.561930 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.562877 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.562860 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 09:33:15.563910 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.563893 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 09:33:15.564125 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.564108 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.566022 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.566002 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmgdv\"" Jun 09 09:33:15.566200 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.566180 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ggd4z\"" Jun 09 09:33:15.566321 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.566294 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 09:33:15.566388 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.566228 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 09:33:15.567495 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.567345 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:15.567593 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.567571 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:15.568345 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.568328 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 09:33:15.568666 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.568650 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 09:33:15.568943 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.568924 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 09:33:15.569406 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.569389 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bdrmr\"" Jun 09 09:33:15.569874 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.569833 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-run-multus-certs\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.570018 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.569988 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-run-ovn\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.570272 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570249 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqb4f\" (UniqueName: \"kubernetes.io/projected/06cb33d2-8534-4a74-a85a-33796caba7a4-kube-api-access-bqb4f\") pod \"iptables-alerter-86dsl\" (UID: \"06cb33d2-8534-4a74-a85a-33796caba7a4\") " pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.570358 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570322 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-sys\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.570413 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570382 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqp9x\" (UniqueName: \"kubernetes.io/projected/3a6da177-59ec-4e4e-9e71-aeb42d43ebd2-kube-api-access-pqp9x\") pod \"node-ca-vsldw\" (UID: \"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2\") " pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.570466 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570427 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa08e0e3-2faa-497f-86f8-8418357d0a52-agent-certs\") pod \"konnectivity-agent-dj8s5\" (UID: \"fa08e0e3-2faa-497f-86f8-8418357d0a52\") " pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:15.570466 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570458 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-var-lib-cni-multus\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.570549 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570483 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-run-openvswitch\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.570549 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570534 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-systemd\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.570633 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570582 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-systemd-units\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.570633 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570607 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-run-systemd\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.570700 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570638 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-node-log\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.570700 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570667 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5pqx\" (UniqueName: \"kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx\") pod \"network-check-target-rbd4m\" (UID: \"a3f79f70-407f-4ba1-8284-e6baa6b290b4\") " pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:15.570806 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570698 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06cb33d2-8534-4a74-a85a-33796caba7a4-host-slash\") pod \"iptables-alerter-86dsl\" (UID: \"06cb33d2-8534-4a74-a85a-33796caba7a4\") " pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.570806 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570726 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s54gw\" (UniqueName: \"kubernetes.io/projected/83a1a323-5119-46fd-b21d-4c51f9388560-kube-api-access-s54gw\") pod \"node-resolver-842b5\" (UID: \"83a1a323-5119-46fd-b21d-4c51f9388560\") " pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.570892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570805 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr9z9\" (UniqueName: \"kubernetes.io/projected/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-kube-api-access-qr9z9\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.570892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570845 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-slash\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.570892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570877 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-tuned\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.571030 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570905 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6435bafd-c764-4c92-9d5c-27c61fa62a59-cni-binary-copy\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.571030 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570931 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8dpj\" (UniqueName: \"kubernetes.io/projected/6435bafd-c764-4c92-9d5c-27c61fa62a59-kube-api-access-z8dpj\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.571030 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.570989 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b84c1150-3f68-4d84-981a-71d6670d2146-ovnkube-script-lib\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.571180 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571037 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06cb33d2-8534-4a74-a85a-33796caba7a4-iptables-alerter-script\") pod \"iptables-alerter-86dsl\" (UID: \"06cb33d2-8534-4a74-a85a-33796caba7a4\") " pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.571180 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571071 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-sysctl-conf\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.571446 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571101 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-cnibin\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.571537 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571481 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-log-socket\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.571537 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571511 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83a1a323-5119-46fd-b21d-4c51f9388560-tmp-dir\") pod \"node-resolver-842b5\" (UID: \"83a1a323-5119-46fd-b21d-4c51f9388560\") " pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.571537 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571533 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-run\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.571693 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571556 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-kubelet\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.571693 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571602 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-run-ovn-kubernetes\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.571693 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571637 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b84c1150-3f68-4d84-981a-71d6670d2146-ovnkube-config\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.571693 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571662 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b84c1150-3f68-4d84-981a-71d6670d2146-ovn-node-metrics-cert\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571691 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571700 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f00d1798-2dd5-4032-969f-3ab435d8cfa0-tmp\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571732 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a6da177-59ec-4e4e-9e71-aeb42d43ebd2-serviceca\") pod \"node-ca-vsldw\" (UID: \"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2\") " pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571778 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-sysconfig\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571802 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-os-release\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571826 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-conf-dir\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571846 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-cni-bin\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571871 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-run-netns\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571893 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-daemon-config\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571915 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-var-lib-openvswitch\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571935 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571950 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgtmz\" (UniqueName: \"kubernetes.io/projected/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-kube-api-access-tgtmz\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:15.571967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571963 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-kubernetes\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571978 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-os-release\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.571993 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6435bafd-c764-4c92-9d5c-27c61fa62a59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572030 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6435bafd-c764-4c92-9d5c-27c61fa62a59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572075 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-var-lib-kubelet\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572100 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-etc-kubernetes\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572122 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572161 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-cni-binary-copy\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572193 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-hostroot\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572247 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-system-cni-dir\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572292 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-socket-dir-parent\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572317 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b84c1150-3f68-4d84-981a-71d6670d2146-env-overrides\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572342 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-sysctl-d\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572366 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83a1a323-5119-46fd-b21d-4c51f9388560-hosts-file\") pod \"node-resolver-842b5\" (UID: \"83a1a323-5119-46fd-b21d-4c51f9388560\") " pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572388 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa08e0e3-2faa-497f-86f8-8418357d0a52-konnectivity-ca\") pod \"konnectivity-agent-dj8s5\" (UID: \"fa08e0e3-2faa-497f-86f8-8418357d0a52\") " pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572411 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-cni-dir\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.572547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572445 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjjlj\" (UniqueName: \"kubernetes.io/projected/b84c1150-3f68-4d84-981a-71d6670d2146-kube-api-access-kjjlj\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572466 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-host\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572488 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlx6t\" (UniqueName: \"kubernetes.io/projected/f00d1798-2dd5-4032-969f-3ab435d8cfa0-kube-api-access-qlx6t\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572524 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-cnibin\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572557 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-run-k8s-cni-cncf-io\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572617 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-var-lib-cni-bin\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572683 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572707 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-modprobe-d\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572726 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a6da177-59ec-4e4e-9e71-aeb42d43ebd2-host\") pod \"node-ca-vsldw\" (UID: \"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2\") " pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572801 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-cni-netd\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572822 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-lib-modules\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572843 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-var-lib-kubelet\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572865 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-run-netns\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572903 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-etc-openvswitch\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.573486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.572951 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-system-cni-dir\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.596192 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.596170 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-28cll" Jun 09 09:33:15.605039 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.604982 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-28cll" Jun 09 09:33:15.661285 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.661249 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 09:33:15.673687 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673650 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-systemd-units\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.673853 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673693 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-run-systemd\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.673853 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673718 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-node-log\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.673853 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673761 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pqx\" (UniqueName: \"kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx\") pod \"network-check-target-rbd4m\" (UID: \"a3f79f70-407f-4ba1-8284-e6baa6b290b4\") " pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:15.673853 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673784 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06cb33d2-8534-4a74-a85a-33796caba7a4-host-slash\") pod \"iptables-alerter-86dsl\" (UID: \"06cb33d2-8534-4a74-a85a-33796caba7a4\") " pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.673853 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673788 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-systemd-units\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.673853 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673807 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s54gw\" (UniqueName: \"kubernetes.io/projected/83a1a323-5119-46fd-b21d-4c51f9388560-kube-api-access-s54gw\") pod \"node-resolver-842b5\" (UID: \"83a1a323-5119-46fd-b21d-4c51f9388560\") " pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.673853 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673834 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-dbus\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:15.673853 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673843 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-node-log\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.674102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673859 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr9z9\" (UniqueName: \"kubernetes.io/projected/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-kube-api-access-qr9z9\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.674102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673883 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-slash\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.674102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673906 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-tuned\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.674102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673929 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6435bafd-c764-4c92-9d5c-27c61fa62a59-cni-binary-copy\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.674102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673953 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8dpj\" (UniqueName: \"kubernetes.io/projected/6435bafd-c764-4c92-9d5c-27c61fa62a59-kube-api-access-z8dpj\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.674102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674005 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-slash\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.674102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674051 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:15.674102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674078 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-registration-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.674390 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674106 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b84c1150-3f68-4d84-981a-71d6670d2146-ovnkube-script-lib\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.674390 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674131 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06cb33d2-8534-4a74-a85a-33796caba7a4-iptables-alerter-script\") pod \"iptables-alerter-86dsl\" (UID: \"06cb33d2-8534-4a74-a85a-33796caba7a4\") " pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.674390 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.673883 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-run-systemd\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.674390 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674327 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-sysctl-conf\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.674390 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674351 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06cb33d2-8534-4a74-a85a-33796caba7a4-host-slash\") pod \"iptables-alerter-86dsl\" (UID: \"06cb33d2-8534-4a74-a85a-33796caba7a4\") " pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.674607 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674426 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 09:33:15.674607 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674514 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-cnibin\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.674607 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674550 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-sysctl-conf\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.674726 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674445 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-cnibin\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.674726 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674703 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06cb33d2-8534-4a74-a85a-33796caba7a4-iptables-alerter-script\") pod \"iptables-alerter-86dsl\" (UID: \"06cb33d2-8534-4a74-a85a-33796caba7a4\") " pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.674845 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674701 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6435bafd-c764-4c92-9d5c-27c61fa62a59-cni-binary-copy\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.674845 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674740 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-log-socket\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.674845 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674794 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83a1a323-5119-46fd-b21d-4c51f9388560-tmp-dir\") pod \"node-resolver-842b5\" (UID: \"83a1a323-5119-46fd-b21d-4c51f9388560\") " pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.674845 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674803 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-log-socket\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.674845 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674822 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-run\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.675074 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674847 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-kubelet\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.675074 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674873 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-run-ovn-kubernetes\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.675074 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674900 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b84c1150-3f68-4d84-981a-71d6670d2146-ovnkube-config\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.675074 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674904 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-run\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.675074 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674935 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-kubelet\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.675074 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674927 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b84c1150-3f68-4d84-981a-71d6670d2146-ovn-node-metrics-cert\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.675074 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674990 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f00d1798-2dd5-4032-969f-3ab435d8cfa0-tmp\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.675074 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675030 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a6da177-59ec-4e4e-9e71-aeb42d43ebd2-serviceca\") pod \"node-ca-vsldw\" (UID: \"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2\") " pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.675074 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675056 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-kubelet-config\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675085 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-sysconfig\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675110 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-os-release\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675133 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-conf-dir\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675110 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83a1a323-5119-46fd-b21d-4c51f9388560-tmp-dir\") pod \"node-resolver-842b5\" (UID: \"83a1a323-5119-46fd-b21d-4c51f9388560\") " pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675188 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-cni-bin\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.674958 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-run-ovn-kubernetes\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675218 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-etc-selinux\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675242 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-sys-fs\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675253 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b84c1150-3f68-4d84-981a-71d6670d2146-ovnkube-script-lib\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675269 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-run-netns\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675294 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-daemon-config\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675319 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-var-lib-openvswitch\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675322 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-conf-dir\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675345 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675371 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgtmz\" (UniqueName: \"kubernetes.io/projected/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-kube-api-access-tgtmz\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675374 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-sysconfig\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.675464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675395 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-kubernetes\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675399 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-cni-bin\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675623 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-run-netns\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675419 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-os-release\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675434 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-os-release\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675485 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-os-release\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675438 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b84c1150-3f68-4d84-981a-71d6670d2146-ovnkube-config\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.675522 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675679 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6435bafd-c764-4c92-9d5c-27c61fa62a59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675580 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-var-lib-openvswitch\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675509 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-kubernetes\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675577 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a6da177-59ec-4e4e-9e71-aeb42d43ebd2-serviceca\") pod \"node-ca-vsldw\" (UID: \"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2\") " pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.675785 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs podName:4ef2d0e0-e726-43ea-908e-d9636e26ecc2 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:16.175719353 +0000 UTC m=+3.051530272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs") pod "network-metrics-daemon-w4s2k" (UID: "4ef2d0e0-e726-43ea-908e-d9636e26ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675825 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6435bafd-c764-4c92-9d5c-27c61fa62a59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675857 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-socket-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675903 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-var-lib-kubelet\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675934 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-etc-kubernetes\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675960 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-var-lib-kubelet\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.675961 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676012 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-etc-kubernetes\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676016 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-cni-binary-copy\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676058 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-hostroot\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676074 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-system-cni-dir\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676077 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-daemon-config\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676097 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676116 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676126 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-hostroot\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676130 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-socket-dir-parent\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676139 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-system-cni-dir\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676160 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b84c1150-3f68-4d84-981a-71d6670d2146-env-overrides\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676174 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-socket-dir-parent\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676185 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-sysctl-d\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676207 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83a1a323-5119-46fd-b21d-4c51f9388560-hosts-file\") pod \"node-resolver-842b5\" (UID: \"83a1a323-5119-46fd-b21d-4c51f9388560\") " pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676229 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6435bafd-c764-4c92-9d5c-27c61fa62a59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.676969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676233 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa08e0e3-2faa-497f-86f8-8418357d0a52-konnectivity-ca\") pod \"konnectivity-agent-dj8s5\" (UID: \"fa08e0e3-2faa-497f-86f8-8418357d0a52\") " pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676315 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-cni-dir\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676346 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-sysctl-d\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676385 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6435bafd-c764-4c92-9d5c-27c61fa62a59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676391 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjjlj\" (UniqueName: \"kubernetes.io/projected/b84c1150-3f68-4d84-981a-71d6670d2146-kube-api-access-kjjlj\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676414 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-multus-cni-dir\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676417 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-host\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676457 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlx6t\" (UniqueName: \"kubernetes.io/projected/f00d1798-2dd5-4032-969f-3ab435d8cfa0-kube-api-access-qlx6t\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676440 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83a1a323-5119-46fd-b21d-4c51f9388560-hosts-file\") pod \"node-resolver-842b5\" (UID: \"83a1a323-5119-46fd-b21d-4c51f9388560\") " pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676463 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-host\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676522 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-cnibin\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676554 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-run-k8s-cni-cncf-io\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676586 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-var-lib-cni-bin\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676604 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-cni-binary-copy\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676613 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676661 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-run-k8s-cni-cncf-io\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676672 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-var-lib-cni-bin\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.677627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676720 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-modprobe-d\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676723 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676727 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6435bafd-c764-4c92-9d5c-27c61fa62a59-cnibin\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676764 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a6da177-59ec-4e4e-9e71-aeb42d43ebd2-host\") pod \"node-ca-vsldw\" (UID: \"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2\") " pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676770 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b84c1150-3f68-4d84-981a-71d6670d2146-env-overrides\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676800 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a6da177-59ec-4e4e-9e71-aeb42d43ebd2-host\") pod \"node-ca-vsldw\" (UID: \"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2\") " pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676814 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-cni-netd\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676839 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-modprobe-d\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676856 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-lib-modules\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676864 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-cni-netd\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676880 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa08e0e3-2faa-497f-86f8-8418357d0a52-konnectivity-ca\") pod \"konnectivity-agent-dj8s5\" (UID: \"fa08e0e3-2faa-497f-86f8-8418357d0a52\") " pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676883 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-var-lib-kubelet\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676917 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-run-netns\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676941 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-lib-modules\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676940 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-etc-openvswitch\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676965 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-var-lib-kubelet\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676992 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-etc-openvswitch\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.676988 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-system-cni-dir\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.678565 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677005 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-host-run-netns\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677034 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-run-multus-certs\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677062 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-run-ovn\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677072 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-system-cni-dir\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677119 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqb4f\" (UniqueName: \"kubernetes.io/projected/06cb33d2-8534-4a74-a85a-33796caba7a4-kube-api-access-bqb4f\") pod \"iptables-alerter-86dsl\" (UID: \"06cb33d2-8534-4a74-a85a-33796caba7a4\") " pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677132 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-run-multus-certs\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677148 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-sys\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677171 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-run-ovn\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677181 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqp9x\" (UniqueName: \"kubernetes.io/projected/3a6da177-59ec-4e4e-9e71-aeb42d43ebd2-kube-api-access-pqp9x\") pod \"node-ca-vsldw\" (UID: \"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2\") " pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677238 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-sys\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677249 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa08e0e3-2faa-497f-86f8-8418357d0a52-agent-certs\") pod \"konnectivity-agent-dj8s5\" (UID: \"fa08e0e3-2faa-497f-86f8-8418357d0a52\") " pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677312 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-device-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677339 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpvpq\" (UniqueName: \"kubernetes.io/projected/da1dcdcf-4b71-46c3-8992-15163b621b64-kube-api-access-vpvpq\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677405 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-var-lib-cni-multus\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677441 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-run-openvswitch\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677453 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-host-var-lib-cni-multus\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677465 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-systemd\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.679441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677519 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b84c1150-3f68-4d84-981a-71d6670d2146-run-openvswitch\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.680288 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.677574 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-systemd\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.680288 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.678807 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f00d1798-2dd5-4032-969f-3ab435d8cfa0-etc-tuned\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.680288 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.679396 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b84c1150-3f68-4d84-981a-71d6670d2146-ovn-node-metrics-cert\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.680288 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.679904 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f00d1798-2dd5-4032-969f-3ab435d8cfa0-tmp\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.680661 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.680636 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa08e0e3-2faa-497f-86f8-8418357d0a52-agent-certs\") pod \"konnectivity-agent-dj8s5\" (UID: \"fa08e0e3-2faa-497f-86f8-8418357d0a52\") " pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:15.691212 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.691190 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:33:15.691212 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.691217 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:33:15.691212 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.691231 2571 projected.go:196] Error preparing data for projected volume kube-api-access-k5pqx for pod openshift-network-diagnostics/network-check-target-rbd4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:15.691448 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.691293 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx podName:a3f79f70-407f-4ba1-8284-e6baa6b290b4 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:16.191275366 +0000 UTC m=+3.067086305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pqx" (UniqueName: "kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx") pod "network-check-target-rbd4m" (UID: "a3f79f70-407f-4ba1-8284-e6baa6b290b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:15.695441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.694501 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjjlj\" (UniqueName: \"kubernetes.io/projected/b84c1150-3f68-4d84-981a-71d6670d2146-kube-api-access-kjjlj\") pod \"ovnkube-node-4pllj\" (UID: \"b84c1150-3f68-4d84-981a-71d6670d2146\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.695441 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.695010 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlx6t\" (UniqueName: \"kubernetes.io/projected/f00d1798-2dd5-4032-969f-3ab435d8cfa0-kube-api-access-qlx6t\") pod \"tuned-rx5m9\" (UID: \"f00d1798-2dd5-4032-969f-3ab435d8cfa0\") " pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.697908 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.696397 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqb4f\" (UniqueName: \"kubernetes.io/projected/06cb33d2-8534-4a74-a85a-33796caba7a4-kube-api-access-bqb4f\") pod \"iptables-alerter-86dsl\" (UID: \"06cb33d2-8534-4a74-a85a-33796caba7a4\") " pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.697908 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.697034 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr9z9\" (UniqueName: \"kubernetes.io/projected/dd51b416-8c70-4dde-b6a1-4e0e013e7c16-kube-api-access-qr9z9\") pod \"multus-nq5mn\" (UID: \"dd51b416-8c70-4dde-b6a1-4e0e013e7c16\") " pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.698846 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.698505 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqp9x\" (UniqueName: \"kubernetes.io/projected/3a6da177-59ec-4e4e-9e71-aeb42d43ebd2-kube-api-access-pqp9x\") pod \"node-ca-vsldw\" (UID: \"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2\") " pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.698941 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.698859 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8dpj\" (UniqueName: \"kubernetes.io/projected/6435bafd-c764-4c92-9d5c-27c61fa62a59-kube-api-access-z8dpj\") pod \"multus-additional-cni-plugins-grn2p\" (UID: \"6435bafd-c764-4c92-9d5c-27c61fa62a59\") " pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.700952 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.700823 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgtmz\" (UniqueName: \"kubernetes.io/projected/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-kube-api-access-tgtmz\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:15.700952 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.700885 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s54gw\" (UniqueName: \"kubernetes.io/projected/83a1a323-5119-46fd-b21d-4c51f9388560-kube-api-access-s54gw\") pod \"node-resolver-842b5\" (UID: \"83a1a323-5119-46fd-b21d-4c51f9388560\") " pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.778455 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778432 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778562 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778479 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-device-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778562 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778503 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpvpq\" (UniqueName: \"kubernetes.io/projected/da1dcdcf-4b71-46c3-8992-15163b621b64-kube-api-access-vpvpq\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778680 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778562 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-device-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778680 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778564 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778680 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778619 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-dbus\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:15.778680 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778659 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:15.778680 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778681 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-registration-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778703 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-kubelet-config\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:15.778892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778721 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-etc-selinux\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778735 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-sys-fs\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778741 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-dbus\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:15.778892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778806 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-etc-selinux\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778807 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-registration-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778815 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-kubelet-config\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:15.778892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778814 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-sys-fs\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778811 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-socket-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.778892 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.778855 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:15.779205 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:15.778905 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret podName:b1dc76fe-cb2a-41aa-b119-ae18f1d752b9 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:16.278892398 +0000 UTC m=+3.154703316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret") pod "global-pull-secret-syncer-nmz6l" (UID: "b1dc76fe-cb2a-41aa-b119-ae18f1d752b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:15.779205 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.778911 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da1dcdcf-4b71-46c3-8992-15163b621b64-socket-dir\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.787628 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.787552 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpvpq\" (UniqueName: \"kubernetes.io/projected/da1dcdcf-4b71-46c3-8992-15163b621b64-kube-api-access-vpvpq\") pod \"aws-ebs-csi-driver-node-6fv92\" (UID: \"da1dcdcf-4b71-46c3-8992-15163b621b64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.860475 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.860445 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:15.868882 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.868859 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nq5mn" Jun 09 09:33:15.879778 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.879728 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:15.886722 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.886705 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grn2p" Jun 09 09:33:15.894430 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.894410 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-86dsl" Jun 09 09:33:15.902003 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.901985 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vsldw" Jun 09 09:33:15.909272 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.909252 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" Jun 09 09:33:15.915961 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.915942 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-842b5" Jun 09 09:33:15.922725 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.922707 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" Jun 09 09:33:15.992432 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:15.992403 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:33:16.181318 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.181292 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:16.181452 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:16.181410 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:16.181497 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:16.181465 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs podName:4ef2d0e0-e726-43ea-908e-d9636e26ecc2 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:17.181451626 +0000 UTC m=+4.057262548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs") pod "network-metrics-daemon-w4s2k" (UID: "4ef2d0e0-e726-43ea-908e-d9636e26ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:16.281803 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.281772 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pqx\" (UniqueName: \"kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx\") pod \"network-check-target-rbd4m\" (UID: \"a3f79f70-407f-4ba1-8284-e6baa6b290b4\") " pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:16.281803 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.281817 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:16.282028 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:16.281947 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:33:16.282028 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:16.281975 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:33:16.282028 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:16.281987 2571 projected.go:196] Error preparing data for projected volume kube-api-access-k5pqx for pod openshift-network-diagnostics/network-check-target-rbd4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:16.282140 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:16.282031 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx podName:a3f79f70-407f-4ba1-8284-e6baa6b290b4 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:17.282015451 +0000 UTC m=+4.157826368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pqx" (UniqueName: "kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx") pod "network-check-target-rbd4m" (UID: "a3f79f70-407f-4ba1-8284-e6baa6b290b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:16.282140 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:16.281945 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:16.282140 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:16.282092 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret podName:b1dc76fe-cb2a-41aa-b119-ae18f1d752b9 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:17.28208094 +0000 UTC m=+4.157891872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret") pod "global-pull-secret-syncer-nmz6l" (UID: "b1dc76fe-cb2a-41aa-b119-ae18f1d752b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:16.567009 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:16.566968 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1dcdcf_4b71_46c3_8992_15163b621b64.slice/crio-e3b38a568e5255ad94eea84a2402de4dc1f2102f2ce847497f9a669bd38d2214 WatchSource:0}: Error finding container e3b38a568e5255ad94eea84a2402de4dc1f2102f2ce847497f9a669bd38d2214: Status 404 returned error can't find the container with id e3b38a568e5255ad94eea84a2402de4dc1f2102f2ce847497f9a669bd38d2214 Jun 09 09:33:16.568711 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:16.568691 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06cb33d2_8534_4a74_a85a_33796caba7a4.slice/crio-38cc5a0f43a3ac2d93a6744fa3f6157feb2794c0c5de025afedbf685b5dd8d22 WatchSource:0}: Error finding container 38cc5a0f43a3ac2d93a6744fa3f6157feb2794c0c5de025afedbf685b5dd8d22: Status 404 returned error can't find the container with id 38cc5a0f43a3ac2d93a6744fa3f6157feb2794c0c5de025afedbf685b5dd8d22 Jun 09 09:33:16.569522 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:16.569407 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd51b416_8c70_4dde_b6a1_4e0e013e7c16.slice/crio-f25174f0a5539786d80307efbb17c9ded84bcb127dd053d30f384e8ab611b5c6 WatchSource:0}: Error finding container f25174f0a5539786d80307efbb17c9ded84bcb127dd053d30f384e8ab611b5c6: Status 404 returned error can't find the container with id f25174f0a5539786d80307efbb17c9ded84bcb127dd053d30f384e8ab611b5c6 Jun 09 09:33:16.570142 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:16.570122 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a1a323_5119_46fd_b21d_4c51f9388560.slice/crio-4a5cca3d4fd6b3410474a596e0cdec59121dbf98aa79d56cda6b5945764318d1 WatchSource:0}: Error finding container 4a5cca3d4fd6b3410474a596e0cdec59121dbf98aa79d56cda6b5945764318d1: Status 404 returned error can't find the container with id 4a5cca3d4fd6b3410474a596e0cdec59121dbf98aa79d56cda6b5945764318d1 Jun 09 09:33:16.571252 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:16.571145 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6da177_59ec_4e4e_9e71_aeb42d43ebd2.slice/crio-76e8d894c52dc9fff7256e6a06fabda980538ceb6001f01844a84a897ddc0ee1 WatchSource:0}: Error finding container 76e8d894c52dc9fff7256e6a06fabda980538ceb6001f01844a84a897ddc0ee1: Status 404 returned error can't find the container with id 76e8d894c52dc9fff7256e6a06fabda980538ceb6001f01844a84a897ddc0ee1 Jun 09 09:33:16.572849 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:16.572826 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00d1798_2dd5_4032_969f_3ab435d8cfa0.slice/crio-220bc179ef6da29bf4012ea1f05cf6da429a6475ab81db81b9d22470e58631f4 WatchSource:0}: Error finding container 220bc179ef6da29bf4012ea1f05cf6da429a6475ab81db81b9d22470e58631f4: Status 404 returned error can't find the container with id 220bc179ef6da29bf4012ea1f05cf6da429a6475ab81db81b9d22470e58631f4 Jun 09 09:33:16.574744 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:16.574242 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb84c1150_3f68_4d84_981a_71d6670d2146.slice/crio-4aabd0d5d32d1f684bd08c22e375d79aed6fff242cbcab3394cece72d4511ec3 WatchSource:0}: Error finding container 4aabd0d5d32d1f684bd08c22e375d79aed6fff242cbcab3394cece72d4511ec3: Status 404 returned error can't find the container with id 4aabd0d5d32d1f684bd08c22e375d79aed6fff242cbcab3394cece72d4511ec3 Jun 09 09:33:16.575533 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:16.575081 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6435bafd_c764_4c92_9d5c_27c61fa62a59.slice/crio-11e0f53b2be8502d919db2e94b0fd5470fb17e8ef05417a36ef0237d4acf736c WatchSource:0}: Error finding container 11e0f53b2be8502d919db2e94b0fd5470fb17e8ef05417a36ef0237d4acf736c: Status 404 returned error can't find the container with id 11e0f53b2be8502d919db2e94b0fd5470fb17e8ef05417a36ef0237d4acf736c Jun 09 09:33:16.575951 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:16.575926 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa08e0e3_2faa_497f_86f8_8418357d0a52.slice/crio-98db9e86625ef218f9af3a14c123944327850444e9c9cdc7af71d50cf33777dc WatchSource:0}: Error finding container 98db9e86625ef218f9af3a14c123944327850444e9c9cdc7af71d50cf33777dc: Status 404 returned error can't find the container with id 98db9e86625ef218f9af3a14c123944327850444e9c9cdc7af71d50cf33777dc Jun 09 09:33:16.607338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.607306 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 09:28:15 +0000 UTC" deadline="2028-01-06 20:51:53.795696572 +0000 UTC" Jun 09 09:33:16.607338 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.607337 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13835h18m37.188364044s" Jun 09 09:33:16.635069 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.635040 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" event={"ID":"b84c1150-3f68-4d84-981a-71d6670d2146","Type":"ContainerStarted","Data":"4aabd0d5d32d1f684bd08c22e375d79aed6fff242cbcab3394cece72d4511ec3"} Jun 09 09:33:16.636034 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.636014 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" event={"ID":"f00d1798-2dd5-4032-969f-3ab435d8cfa0","Type":"ContainerStarted","Data":"220bc179ef6da29bf4012ea1f05cf6da429a6475ab81db81b9d22470e58631f4"} Jun 09 09:33:16.637020 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.637000 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vsldw" event={"ID":"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2","Type":"ContainerStarted","Data":"76e8d894c52dc9fff7256e6a06fabda980538ceb6001f01844a84a897ddc0ee1"} Jun 09 09:33:16.637947 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.637928 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-842b5" event={"ID":"83a1a323-5119-46fd-b21d-4c51f9388560","Type":"ContainerStarted","Data":"4a5cca3d4fd6b3410474a596e0cdec59121dbf98aa79d56cda6b5945764318d1"} Jun 09 09:33:16.638854 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.638837 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nq5mn" event={"ID":"dd51b416-8c70-4dde-b6a1-4e0e013e7c16","Type":"ContainerStarted","Data":"f25174f0a5539786d80307efbb17c9ded84bcb127dd053d30f384e8ab611b5c6"} Jun 09 09:33:16.640687 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.640664 2571 generic.go:356] "Generic (PLEG): container finished" podID="c5716f55cdce17e3b4b08e17f23bf315" containerID="abb4960f116a39c396200b23cea2655e3738a171b719cad96f31294d3271f50d" exitCode=0 Jun 09 09:33:16.640786 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.640741 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" event={"ID":"c5716f55cdce17e3b4b08e17f23bf315","Type":"ContainerDied","Data":"abb4960f116a39c396200b23cea2655e3738a171b719cad96f31294d3271f50d"} Jun 09 09:33:16.641677 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.641659 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dj8s5" event={"ID":"fa08e0e3-2faa-497f-86f8-8418357d0a52","Type":"ContainerStarted","Data":"98db9e86625ef218f9af3a14c123944327850444e9c9cdc7af71d50cf33777dc"} Jun 09 09:33:16.642689 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.642669 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn2p" event={"ID":"6435bafd-c764-4c92-9d5c-27c61fa62a59","Type":"ContainerStarted","Data":"11e0f53b2be8502d919db2e94b0fd5470fb17e8ef05417a36ef0237d4acf736c"} Jun 09 09:33:16.643890 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.643868 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-86dsl" event={"ID":"06cb33d2-8534-4a74-a85a-33796caba7a4","Type":"ContainerStarted","Data":"38cc5a0f43a3ac2d93a6744fa3f6157feb2794c0c5de025afedbf685b5dd8d22"} Jun 09 09:33:16.648074 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.648047 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" event={"ID":"da1dcdcf-4b71-46c3-8992-15163b621b64","Type":"ContainerStarted","Data":"e3b38a568e5255ad94eea84a2402de4dc1f2102f2ce847497f9a669bd38d2214"} Jun 09 09:33:16.649404 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:16.649383 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" event={"ID":"f568bfae37cdddb9b7965ef2ed23b8d3","Type":"ContainerStarted","Data":"763a2f183574515ebf91e8c7a9485272ec3c090b72aef568814d77a75713c901"} Jun 09 09:33:17.188944 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:17.188884 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:17.189153 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.189032 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:17.189153 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.189096 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs podName:4ef2d0e0-e726-43ea-908e-d9636e26ecc2 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:19.189078353 +0000 UTC m=+6.064889274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs") pod "network-metrics-daemon-w4s2k" (UID: "4ef2d0e0-e726-43ea-908e-d9636e26ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:17.291667 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:17.291615 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:17.291922 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:17.291729 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pqx\" (UniqueName: \"kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx\") pod \"network-check-target-rbd4m\" (UID: \"a3f79f70-407f-4ba1-8284-e6baa6b290b4\") " pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:17.291922 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.291888 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:33:17.291922 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.291906 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:33:17.291922 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.291919 2571 projected.go:196] Error preparing data for projected volume kube-api-access-k5pqx for pod openshift-network-diagnostics/network-check-target-rbd4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:17.292134 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.291981 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx podName:a3f79f70-407f-4ba1-8284-e6baa6b290b4 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:19.291962475 +0000 UTC m=+6.167773397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pqx" (UniqueName: "kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx") pod "network-check-target-rbd4m" (UID: "a3f79f70-407f-4ba1-8284-e6baa6b290b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:17.292373 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.292355 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:17.292432 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.292411 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret podName:b1dc76fe-cb2a-41aa-b119-ae18f1d752b9 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:19.292396899 +0000 UTC m=+6.168207819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret") pod "global-pull-secret-syncer-nmz6l" (UID: "b1dc76fe-cb2a-41aa-b119-ae18f1d752b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:17.607843 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:17.607673 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 09:28:15 +0000 UTC" deadline="2027-12-09 09:32:38.491691681 +0000 UTC" Jun 09 09:33:17.607843 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:17.607738 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13151h59m20.883958426s" Jun 09 09:33:17.629519 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:17.629492 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:17.629677 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.629627 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:17.630032 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:17.630012 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:17.630166 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.630105 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:17.630363 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:17.630167 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:17.630363 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:17.630233 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:17.668541 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:17.668429 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" event={"ID":"c5716f55cdce17e3b4b08e17f23bf315","Type":"ContainerStarted","Data":"4ede86adf8d5d35368a6eed3ecc929cc347ca91c79a6a31b173d085108b88e9c"} Jun 09 09:33:17.684130 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:17.684060 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" podStartSLOduration=2.684039653 podStartE2EDuration="2.684039653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:16.669658877 +0000 UTC m=+3.545469831" watchObservedRunningTime="2026-06-09 09:33:17.684039653 +0000 UTC m=+4.559850594" Jun 09 09:33:19.214126 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:19.213448 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:19.214126 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.213659 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:19.214126 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.213735 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs podName:4ef2d0e0-e726-43ea-908e-d9636e26ecc2 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:23.213715127 +0000 UTC m=+10.089526069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs") pod "network-metrics-daemon-w4s2k" (UID: "4ef2d0e0-e726-43ea-908e-d9636e26ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:19.315334 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:19.314517 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pqx\" (UniqueName: \"kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx\") pod \"network-check-target-rbd4m\" (UID: \"a3f79f70-407f-4ba1-8284-e6baa6b290b4\") " pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:19.315334 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:19.314571 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:19.315334 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.314730 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:19.315334 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.314808 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret podName:b1dc76fe-cb2a-41aa-b119-ae18f1d752b9 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:23.314789866 +0000 UTC m=+10.190600813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret") pod "global-pull-secret-syncer-nmz6l" (UID: "b1dc76fe-cb2a-41aa-b119-ae18f1d752b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:19.315334 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.315216 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:33:19.315334 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.315235 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:33:19.315334 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.315249 2571 projected.go:196] Error preparing data for projected volume kube-api-access-k5pqx for pod openshift-network-diagnostics/network-check-target-rbd4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:19.315334 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.315293 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx podName:a3f79f70-407f-4ba1-8284-e6baa6b290b4 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:23.315279019 +0000 UTC m=+10.191089939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pqx" (UniqueName: "kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx") pod "network-check-target-rbd4m" (UID: "a3f79f70-407f-4ba1-8284-e6baa6b290b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:19.627276 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:19.627196 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:19.627420 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.627329 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:19.627783 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:19.627740 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:19.627891 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.627867 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:19.627957 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:19.627918 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:19.628010 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:19.627993 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:21.627305 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:21.627265 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:21.627740 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:21.627413 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:21.627740 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:21.627527 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:21.627740 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:21.627619 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:21.627740 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:21.627742 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:21.628005 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:21.627859 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:23.245076 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:23.245040 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:23.245533 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.245212 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:23.245533 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.245300 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs podName:4ef2d0e0-e726-43ea-908e-d9636e26ecc2 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:31.245271352 +0000 UTC m=+18.121082271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs") pod "network-metrics-daemon-w4s2k" (UID: "4ef2d0e0-e726-43ea-908e-d9636e26ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:23.346534 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:23.346437 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pqx\" (UniqueName: \"kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx\") pod \"network-check-target-rbd4m\" (UID: \"a3f79f70-407f-4ba1-8284-e6baa6b290b4\") " pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:23.346534 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:23.346489 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:23.346805 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.346628 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:33:23.346805 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.346647 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:23.346805 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.346653 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:33:23.346805 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.346671 2571 projected.go:196] Error preparing data for projected volume kube-api-access-k5pqx for pod openshift-network-diagnostics/network-check-target-rbd4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:23.346805 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.346707 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret podName:b1dc76fe-cb2a-41aa-b119-ae18f1d752b9 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:31.346688209 +0000 UTC m=+18.222499126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret") pod "global-pull-secret-syncer-nmz6l" (UID: "b1dc76fe-cb2a-41aa-b119-ae18f1d752b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:23.346805 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.346726 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx podName:a3f79f70-407f-4ba1-8284-e6baa6b290b4 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:31.346717929 +0000 UTC m=+18.222528847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pqx" (UniqueName: "kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx") pod "network-check-target-rbd4m" (UID: "a3f79f70-407f-4ba1-8284-e6baa6b290b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:23.627832 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:23.627740 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:23.627977 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.627851 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:23.627977 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:23.627917 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:23.628092 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.628017 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:23.628092 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:23.628046 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:23.628289 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:23.628184 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:25.626780 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:25.626728 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:25.627222 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:25.626879 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:25.627608 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:25.627308 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:25.627608 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:25.627414 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:25.627608 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:25.627504 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:25.627608 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:25.627578 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:27.627051 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:27.627009 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:27.627504 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:27.627154 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:27.627504 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:27.627012 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:27.627504 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:27.627262 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:27.627504 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:27.627013 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:27.627504 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:27.627334 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:29.627966 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:29.627693 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:29.628503 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:29.627729 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:29.628503 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:29.627795 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:29.628503 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:29.628051 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:29.628503 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:29.628164 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:29.628503 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:29.628244 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:31.302763 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:31.302719 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:31.303194 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.302886 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:31.303194 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.302953 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs podName:4ef2d0e0-e726-43ea-908e-d9636e26ecc2 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:47.302936593 +0000 UTC m=+34.178747512 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs") pod "network-metrics-daemon-w4s2k" (UID: "4ef2d0e0-e726-43ea-908e-d9636e26ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:31.403459 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:31.403423 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pqx\" (UniqueName: \"kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx\") pod \"network-check-target-rbd4m\" (UID: \"a3f79f70-407f-4ba1-8284-e6baa6b290b4\") " pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:31.403646 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:31.403465 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:31.403646 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.403591 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:31.403646 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.403623 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:33:31.403839 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.403650 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:33:31.403839 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.403654 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret podName:b1dc76fe-cb2a-41aa-b119-ae18f1d752b9 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:47.403634901 +0000 UTC m=+34.279445823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret") pod "global-pull-secret-syncer-nmz6l" (UID: "b1dc76fe-cb2a-41aa-b119-ae18f1d752b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:31.403839 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.403665 2571 projected.go:196] Error preparing data for projected volume kube-api-access-k5pqx for pod openshift-network-diagnostics/network-check-target-rbd4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:31.403839 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.403715 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx podName:a3f79f70-407f-4ba1-8284-e6baa6b290b4 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:47.403699849 +0000 UTC m=+34.279510773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pqx" (UniqueName: "kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx") pod "network-check-target-rbd4m" (UID: "a3f79f70-407f-4ba1-8284-e6baa6b290b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:31.626908 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:31.626823 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:31.627079 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:31.626836 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:31.627079 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.626966 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:31.627079 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:31.626836 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:31.627079 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.627059 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:31.627276 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:31.627132 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:33.628306 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:33.628167 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:33.628306 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:33.628281 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:33.628306 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:33.628292 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:33.628882 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:33.628389 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:33.628882 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:33.628396 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:33.628882 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:33.628526 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:35.627054 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.627022 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:35.627890 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:35.627160 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:35.627890 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.627023 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:35.627890 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:35.627285 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:35.627890 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.627346 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:35.627890 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:35.627416 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:35.709482 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.709314 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:33:35.709853 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.709826 2571 generic.go:356] "Generic (PLEG): container finished" podID="b84c1150-3f68-4d84-981a-71d6670d2146" containerID="924309d342773324ec2812aa664a136644ef676df395cf1983e10fa68743d0a8" exitCode=1 Jun 09 09:33:35.709955 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.709898 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" event={"ID":"b84c1150-3f68-4d84-981a-71d6670d2146","Type":"ContainerStarted","Data":"770d999e62f97daa32dc0065001080f5d3349cbacb6a13f14599f362c72ef890"} Jun 09 09:33:35.710007 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.709991 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" event={"ID":"b84c1150-3f68-4d84-981a-71d6670d2146","Type":"ContainerStarted","Data":"b4e39f3886b1aac8c25ec6d3bbaaa1aaa81410c9759604c05aa598f15d2c47b7"} Jun 09 09:33:35.710065 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.710046 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" event={"ID":"b84c1150-3f68-4d84-981a-71d6670d2146","Type":"ContainerStarted","Data":"b431c8fdb016b9dd624c6284730c06d73ac9f477439009e5f8e0739078e2e485"} Jun 09 09:33:35.710144 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.710130 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" event={"ID":"b84c1150-3f68-4d84-981a-71d6670d2146","Type":"ContainerStarted","Data":"971830b40d508643f5be7e7d09bf46370a8e99f692e163ff6d7b41fc53b46e0b"} Jun 09 09:33:35.710214 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.710201 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" event={"ID":"b84c1150-3f68-4d84-981a-71d6670d2146","Type":"ContainerDied","Data":"924309d342773324ec2812aa664a136644ef676df395cf1983e10fa68743d0a8"} Jun 09 09:33:35.710271 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.710258 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" event={"ID":"b84c1150-3f68-4d84-981a-71d6670d2146","Type":"ContainerStarted","Data":"a21bb173982889d518d4a5b200073d7c3f6e28d9980334047f73a9a3f668cb4d"} Jun 09 09:33:35.711953 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.711739 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" event={"ID":"f00d1798-2dd5-4032-969f-3ab435d8cfa0","Type":"ContainerStarted","Data":"cc49c3f242fb24325e9bb4f15bc75b86edff45be8e8426cc6c095dd4b14756f0"} Jun 09 09:33:35.713609 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.713531 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vsldw" event={"ID":"3a6da177-59ec-4e4e-9e71-aeb42d43ebd2","Type":"ContainerStarted","Data":"15b805a513e7dcde77fb86dc8f374745d7244f52b07107b8dc9abda122f7c1e6"} Jun 09 09:33:35.715204 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.715165 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-842b5" event={"ID":"83a1a323-5119-46fd-b21d-4c51f9388560","Type":"ContainerStarted","Data":"a0a0aaada4c11d99b0ebdc8201555cb6154dd1c98908970b541a058f74a6f260"} Jun 09 09:33:35.716997 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.716948 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nq5mn" event={"ID":"dd51b416-8c70-4dde-b6a1-4e0e013e7c16","Type":"ContainerStarted","Data":"61a33e54dee5dee4e339444d3ef30287efc60abdf5f3343c6138ebbc6dfce647"} Jun 09 09:33:35.718460 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.718432 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dj8s5" event={"ID":"fa08e0e3-2faa-497f-86f8-8418357d0a52","Type":"ContainerStarted","Data":"4f7ea45fd8aae1a3e02f48b32ba72d0b4c4becd788bdc1fff60bf880d922eeb4"} Jun 09 09:33:35.720165 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.720141 2571 generic.go:356] "Generic (PLEG): container finished" podID="6435bafd-c764-4c92-9d5c-27c61fa62a59" containerID="84c0f72b9bdf8f85b733f0d7358351c13e49182546103f69913d9c1ba7462f6a" exitCode=0 Jun 09 09:33:35.720251 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.720221 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn2p" event={"ID":"6435bafd-c764-4c92-9d5c-27c61fa62a59","Type":"ContainerDied","Data":"84c0f72b9bdf8f85b733f0d7358351c13e49182546103f69913d9c1ba7462f6a"} Jun 09 09:33:35.722430 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.722402 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" event={"ID":"da1dcdcf-4b71-46c3-8992-15163b621b64","Type":"ContainerStarted","Data":"a88f1d56815ed4f807fd61416250379887fb594155c95708d987cf6f3645ae58"} Jun 09 09:33:35.732784 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.732725 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" podStartSLOduration=20.732713782 podStartE2EDuration="20.732713782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:17.685043137 +0000 UTC m=+4.560854093" watchObservedRunningTime="2026-06-09 09:33:35.732713782 +0000 UTC m=+22.608524722" Jun 09 09:33:35.733267 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.733225 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rx5m9" podStartSLOduration=3.283680477 podStartE2EDuration="21.733211668s" totalImagesPullingTime="18.449531191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:35.73243991 +0000 UTC m=+22.608250852" watchObservedRunningTime="2026-06-09 09:33:35.733211668 +0000 UTC m=+22.609022610" Jun 09 09:33:35.776045 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.775971 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nq5mn" podStartSLOduration=4.279211916 podStartE2EDuration="22.77595613s" totalImagesPullingTime="18.496744214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:35.751574766 +0000 UTC m=+22.627385706" watchObservedRunningTime="2026-06-09 09:33:35.77595613 +0000 UTC m=+22.651767069" Jun 09 09:33:35.807322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.807282 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-842b5" podStartSLOduration=7.680096062 podStartE2EDuration="21.807269072s" totalImagesPullingTime="14.12717301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:35.807202034 +0000 UTC m=+22.683012974" watchObservedRunningTime="2026-06-09 09:33:35.807269072 +0000 UTC m=+22.683080011" Jun 09 09:33:35.807532 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:35.807515 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vsldw" podStartSLOduration=4.750701318 podStartE2EDuration="22.807508167s" totalImagesPullingTime="18.056806849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:35.790128936 +0000 UTC m=+22.665939875" watchObservedRunningTime="2026-06-09 09:33:35.807508167 +0000 UTC m=+22.683319106" Jun 09 09:33:36.615331 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:36.615137 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 09:33:36.629337 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:36.629261 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T09:33:36.615301545Z","UUID":"dbe8b72c-4858-41fe-ace9-d2c379f80c19","Handler":null,"Name":"","Endpoint":""} Jun 09 09:33:36.630597 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:36.630577 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 09:33:36.630692 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:36.630617 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 09:33:36.726378 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:36.726337 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-86dsl" event={"ID":"06cb33d2-8534-4a74-a85a-33796caba7a4","Type":"ContainerStarted","Data":"5397afb8b5806cb665b04f4657f8d3e8be469b766b7639621e91a71d767c5e1c"} Jun 09 09:33:36.728176 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:36.728152 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" event={"ID":"da1dcdcf-4b71-46c3-8992-15163b621b64","Type":"ContainerStarted","Data":"9ef5bd652e2bb9d1c931b8be2d76bf6bb714084b5cc5179fe09ca439f9f3e562"} Jun 09 09:33:36.745076 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:36.745032 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dj8s5" podStartSLOduration=13.923022829 podStartE2EDuration="23.745020197s" totalImagesPullingTime="9.821997368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:35.826422347 +0000 UTC m=+22.702233287" watchObservedRunningTime="2026-06-09 09:33:36.745020197 +0000 UTC m=+23.620831137" Jun 09 09:33:37.627079 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:37.627051 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:37.627207 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:37.627185 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:37.627581 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:37.627549 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:37.627673 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:37.627649 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:37.627781 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:37.627765 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:37.627873 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:37.627858 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:37.732335 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:37.732303 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" event={"ID":"da1dcdcf-4b71-46c3-8992-15163b621b64","Type":"ContainerStarted","Data":"d197a2defbeba272c68891c87a01d3235c5c8d05138945dd833d9d28fe6313a8"} Jun 09 09:33:37.753503 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:37.753462 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-86dsl" podStartSLOduration=6.342064471 podStartE2EDuration="24.753447383s" totalImagesPullingTime="18.411382912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:36.745167004 +0000 UTC m=+23.620977954" watchObservedRunningTime="2026-06-09 09:33:37.753447383 +0000 UTC m=+24.629258392" Jun 09 09:33:37.753634 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:37.753578 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fv92" podStartSLOduration=3.129696192 podStartE2EDuration="23.753572587s" totalImagesPullingTime="20.623876395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:37.753115205 +0000 UTC m=+24.628926150" watchObservedRunningTime="2026-06-09 09:33:37.753572587 +0000 UTC m=+24.629383524" Jun 09 09:33:38.737616 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:38.737579 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:33:38.738159 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:38.738021 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" event={"ID":"b84c1150-3f68-4d84-981a-71d6670d2146","Type":"ContainerStarted","Data":"2a1f3a60d0e8eabf60f9b4fda27a10e1ae5b23f62ead27dd959d13896920cddc"} Jun 09 09:33:39.092863 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:39.092783 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:39.093691 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:39.093672 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:39.627316 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:39.627277 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:39.627496 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:39.627279 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:39.627496 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:39.627404 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:39.627496 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:39.627404 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:39.627632 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:39.627500 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:39.627632 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:39.627586 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:41.627397 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.627177 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:41.627933 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.627184 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:41.627933 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:41.627418 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:41.627933 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:41.627526 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:41.627933 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.627196 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:41.627933 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:41.627619 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:41.747040 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.746996 2571 generic.go:356] "Generic (PLEG): container finished" podID="6435bafd-c764-4c92-9d5c-27c61fa62a59" containerID="8623748522c50c9001570b43aba8f9d2f1593747192c04a2e11be6ea662703bf" exitCode=0 Jun 09 09:33:41.747203 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.747130 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn2p" event={"ID":"6435bafd-c764-4c92-9d5c-27c61fa62a59","Type":"ContainerDied","Data":"8623748522c50c9001570b43aba8f9d2f1593747192c04a2e11be6ea662703bf"} Jun 09 09:33:41.752423 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.752405 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:33:41.752791 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.752770 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" event={"ID":"b84c1150-3f68-4d84-981a-71d6670d2146","Type":"ContainerStarted","Data":"4860d093151f364dbe310cf5cab9fd154455929c66e590f735406b9df4cc0549"} Jun 09 09:33:41.753038 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.753021 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:41.753119 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.753073 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:41.753196 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.753178 2571 scope.go:117] "RemoveContainer" containerID="924309d342773324ec2812aa664a136644ef676df395cf1983e10fa68743d0a8" Jun 09 09:33:41.770016 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:41.769996 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:42.761255 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:42.761227 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:33:42.761681 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:42.761657 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" event={"ID":"b84c1150-3f68-4d84-981a-71d6670d2146","Type":"ContainerStarted","Data":"1419a551895229a64a2dc0d75a2ee9cf499701173bd34708214ae409ec01edf4"} Jun 09 09:33:42.762062 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:42.762039 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:42.781016 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:42.780992 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:33:42.793929 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:42.793886 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" podStartSLOduration=11.307146959 podStartE2EDuration="29.793867835s" totalImagesPullingTime="18.486720876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:42.793512914 +0000 UTC m=+29.669323854" watchObservedRunningTime="2026-06-09 09:33:42.793867835 +0000 UTC m=+29.669678780" Jun 09 09:33:43.033047 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.032802 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w4s2k"] Jun 09 09:33:43.033229 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.033111 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:43.033335 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:43.033233 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:43.036088 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.033438 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nmz6l"] Jun 09 09:33:43.036088 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.033562 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:43.036088 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:43.033643 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:43.036088 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.034016 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbd4m"] Jun 09 09:33:43.036088 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.034105 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:43.036088 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:43.034192 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:43.219680 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.219644 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:43.219851 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.219809 2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 09:33:43.220349 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.220329 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dj8s5" Jun 09 09:33:43.765465 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.765430 2571 generic.go:356] "Generic (PLEG): container finished" podID="6435bafd-c764-4c92-9d5c-27c61fa62a59" containerID="6fab235c295e1903c68d6c8bd29ff216d9c194d21aee04012d36b20909e9bb73" exitCode=0 Jun 09 09:33:43.765912 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:43.765522 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn2p" event={"ID":"6435bafd-c764-4c92-9d5c-27c61fa62a59","Type":"ContainerDied","Data":"6fab235c295e1903c68d6c8bd29ff216d9c194d21aee04012d36b20909e9bb73"} Jun 09 09:33:44.627289 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:44.627253 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:44.627421 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:44.627359 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:44.627421 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:44.627371 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:44.627421 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:44.627386 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:44.627571 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:44.627462 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:44.627571 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:44.627541 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:44.770213 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:44.770131 2571 generic.go:356] "Generic (PLEG): container finished" podID="6435bafd-c764-4c92-9d5c-27c61fa62a59" containerID="b33b51fd08a01e9670f4d5f3d582e3816a4105d5f83c13d19f8ecb158459b36f" exitCode=0 Jun 09 09:33:44.770833 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:44.770217 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn2p" event={"ID":"6435bafd-c764-4c92-9d5c-27c61fa62a59","Type":"ContainerDied","Data":"b33b51fd08a01e9670f4d5f3d582e3816a4105d5f83c13d19f8ecb158459b36f"} Jun 09 09:33:46.627406 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.627373 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:46.627890 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.627493 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:46.627890 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:46.627506 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmz6l" podUID="b1dc76fe-cb2a-41aa-b119-ae18f1d752b9" Jun 09 09:33:46.627890 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:46.627588 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbd4m" podUID="a3f79f70-407f-4ba1-8284-e6baa6b290b4" Jun 09 09:33:46.627890 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.627628 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:46.627890 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:46.627686 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:33:46.881184 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.881115 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeReady" Jun 09 09:33:46.881339 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.881256 2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 09:33:46.929788 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.929760 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g9ppj"] Jun 09 09:33:46.950763 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.950721 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-spslk"] Jun 09 09:33:46.950931 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.950908 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:46.953897 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.953871 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wjbxj\"" Jun 09 09:33:46.954022 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.953871 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 09:33:46.954022 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.953873 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 09:33:46.972757 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.972730 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g9ppj"] Jun 09 09:33:46.972885 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.972786 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-spslk"] Jun 09 09:33:46.972885 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.972828 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-spslk" Jun 09 09:33:46.975824 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.975796 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kgzwn\"" Jun 09 09:33:46.975824 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.975819 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 09:33:46.976009 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.975819 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 09:33:46.976009 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:46.975802 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 09:33:47.130372 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.130335 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b3dc75d-cdfa-46de-8d82-76127095dd8f-cert\") pod \"ingress-canary-spslk\" (UID: \"0b3dc75d-cdfa-46de-8d82-76127095dd8f\") " pod="openshift-ingress-canary/ingress-canary-spslk" Jun 09 09:33:47.130544 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.130383 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jkwt\" (UniqueName: \"kubernetes.io/projected/c0742eb2-819f-4aac-8d8a-42243e17defa-kube-api-access-5jkwt\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.130544 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.130499 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75ct6\" (UniqueName: \"kubernetes.io/projected/0b3dc75d-cdfa-46de-8d82-76127095dd8f-kube-api-access-75ct6\") pod \"ingress-canary-spslk\" (UID: \"0b3dc75d-cdfa-46de-8d82-76127095dd8f\") " pod="openshift-ingress-canary/ingress-canary-spslk" Jun 09 09:33:47.130638 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.130576 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0742eb2-819f-4aac-8d8a-42243e17defa-tmp-dir\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.130638 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.130608 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0742eb2-819f-4aac-8d8a-42243e17defa-config-volume\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.130711 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.130650 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.231657 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.231626 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0742eb2-819f-4aac-8d8a-42243e17defa-tmp-dir\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.231657 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.231666 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0742eb2-819f-4aac-8d8a-42243e17defa-config-volume\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.231934 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.231702 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.231934 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.231731 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b3dc75d-cdfa-46de-8d82-76127095dd8f-cert\") pod \"ingress-canary-spslk\" (UID: \"0b3dc75d-cdfa-46de-8d82-76127095dd8f\") " pod="openshift-ingress-canary/ingress-canary-spslk" Jun 09 09:33:47.231934 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.231772 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jkwt\" (UniqueName: \"kubernetes.io/projected/c0742eb2-819f-4aac-8d8a-42243e17defa-kube-api-access-5jkwt\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.231934 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.231823 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75ct6\" (UniqueName: \"kubernetes.io/projected/0b3dc75d-cdfa-46de-8d82-76127095dd8f-kube-api-access-75ct6\") pod \"ingress-canary-spslk\" (UID: \"0b3dc75d-cdfa-46de-8d82-76127095dd8f\") " pod="openshift-ingress-canary/ingress-canary-spslk" Jun 09 09:33:47.231934 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.231856 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:47.231934 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.231934 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls podName:c0742eb2-819f-4aac-8d8a-42243e17defa nodeName:}" failed. No retries permitted until 2026-06-09 09:33:47.731913395 +0000 UTC m=+34.607724329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls") pod "dns-default-g9ppj" (UID: "c0742eb2-819f-4aac-8d8a-42243e17defa") : secret "dns-default-metrics-tls" not found Jun 09 09:33:47.232314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.232047 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0742eb2-819f-4aac-8d8a-42243e17defa-tmp-dir\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.232452 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.232274 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0742eb2-819f-4aac-8d8a-42243e17defa-config-volume\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.235847 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.235827 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b3dc75d-cdfa-46de-8d82-76127095dd8f-cert\") pod \"ingress-canary-spslk\" (UID: \"0b3dc75d-cdfa-46de-8d82-76127095dd8f\") " pod="openshift-ingress-canary/ingress-canary-spslk" Jun 09 09:33:47.241005 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.240978 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jkwt\" (UniqueName: \"kubernetes.io/projected/c0742eb2-819f-4aac-8d8a-42243e17defa-kube-api-access-5jkwt\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.241393 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.241370 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75ct6\" (UniqueName: \"kubernetes.io/projected/0b3dc75d-cdfa-46de-8d82-76127095dd8f-kube-api-access-75ct6\") pod \"ingress-canary-spslk\" (UID: \"0b3dc75d-cdfa-46de-8d82-76127095dd8f\") " pod="openshift-ingress-canary/ingress-canary-spslk" Jun 09 09:33:47.283215 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.283198 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-spslk" Jun 09 09:33:47.332645 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.332613 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:47.332811 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.332787 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:47.332884 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.332870 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs podName:4ef2d0e0-e726-43ea-908e-d9636e26ecc2 nodeName:}" failed. No retries permitted until 2026-06-09 09:34:19.332845606 +0000 UTC m=+66.208656540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs") pod "network-metrics-daemon-w4s2k" (UID: "4ef2d0e0-e726-43ea-908e-d9636e26ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:47.433969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.433931 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pqx\" (UniqueName: \"kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx\") pod \"network-check-target-rbd4m\" (UID: \"a3f79f70-407f-4ba1-8284-e6baa6b290b4\") " pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:47.433969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.433974 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:47.434283 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.434078 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:47.434283 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.434154 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret podName:b1dc76fe-cb2a-41aa-b119-ae18f1d752b9 nodeName:}" failed. No retries permitted until 2026-06-09 09:34:19.434140865 +0000 UTC m=+66.309951783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret") pod "global-pull-secret-syncer-nmz6l" (UID: "b1dc76fe-cb2a-41aa-b119-ae18f1d752b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:47.434283 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.434081 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:33:47.434283 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.434219 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:33:47.434283 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.434237 2571 projected.go:196] Error preparing data for projected volume kube-api-access-k5pqx for pod openshift-network-diagnostics/network-check-target-rbd4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:47.434551 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.434295 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx podName:a3f79f70-407f-4ba1-8284-e6baa6b290b4 nodeName:}" failed. No retries permitted until 2026-06-09 09:34:19.434280515 +0000 UTC m=+66.310091434 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pqx" (UniqueName: "kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx") pod "network-check-target-rbd4m" (UID: "a3f79f70-407f-4ba1-8284-e6baa6b290b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:47.736343 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:47.736305 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:47.736843 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.736422 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:47.736843 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:47.736476 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls podName:c0742eb2-819f-4aac-8d8a-42243e17defa nodeName:}" failed. No retries permitted until 2026-06-09 09:33:48.736463079 +0000 UTC m=+35.612274010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls") pod "dns-default-g9ppj" (UID: "c0742eb2-819f-4aac-8d8a-42243e17defa") : secret "dns-default-metrics-tls" not found Jun 09 09:33:48.627054 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:48.627021 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:33:48.627054 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:48.627058 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:33:48.627370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:48.627058 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:33:48.630373 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:48.630352 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 09:33:48.630520 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:48.630395 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 09:33:48.630520 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:48.630435 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 09:33:48.631893 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:48.631843 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79nq8\"" Jun 09 09:33:48.631893 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:48.631873 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbl4j\"" Jun 09 09:33:48.632031 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:48.631961 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 09:33:48.744832 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:48.744793 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:48.745357 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:48.744932 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:48.745357 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:48.745017 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls podName:c0742eb2-819f-4aac-8d8a-42243e17defa nodeName:}" failed. No retries permitted until 2026-06-09 09:33:50.74499606 +0000 UTC m=+37.620807001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls") pod "dns-default-g9ppj" (UID: "c0742eb2-819f-4aac-8d8a-42243e17defa") : secret "dns-default-metrics-tls" not found Jun 09 09:33:49.015257 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:49.015226 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-spslk"] Jun 09 09:33:49.086606 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:49.086578 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3dc75d_cdfa_46de_8d82_76127095dd8f.slice/crio-32b80866c3788e0cccfe2f647feafc2342e5de6e9e55a1279027700e2c79993a WatchSource:0}: Error finding container 32b80866c3788e0cccfe2f647feafc2342e5de6e9e55a1279027700e2c79993a: Status 404 returned error can't find the container with id 32b80866c3788e0cccfe2f647feafc2342e5de6e9e55a1279027700e2c79993a Jun 09 09:33:49.783834 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:49.783797 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-spslk" event={"ID":"0b3dc75d-cdfa-46de-8d82-76127095dd8f","Type":"ContainerStarted","Data":"32b80866c3788e0cccfe2f647feafc2342e5de6e9e55a1279027700e2c79993a"} Jun 09 09:33:49.786952 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:49.786923 2571 generic.go:356] "Generic (PLEG): container finished" podID="6435bafd-c764-4c92-9d5c-27c61fa62a59" containerID="a18cfed909cf88cdf11710ea69445982a82f82fe2e90c75a4abaa9a2f57e4cff" exitCode=0 Jun 09 09:33:49.787083 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:49.786975 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn2p" event={"ID":"6435bafd-c764-4c92-9d5c-27c61fa62a59","Type":"ContainerDied","Data":"a18cfed909cf88cdf11710ea69445982a82f82fe2e90c75a4abaa9a2f57e4cff"} Jun 09 09:33:50.761877 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:50.761845 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:50.762054 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:50.762005 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:50.762124 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:50.762097 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls podName:c0742eb2-819f-4aac-8d8a-42243e17defa nodeName:}" failed. No retries permitted until 2026-06-09 09:33:54.762075666 +0000 UTC m=+41.637886584 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls") pod "dns-default-g9ppj" (UID: "c0742eb2-819f-4aac-8d8a-42243e17defa") : secret "dns-default-metrics-tls" not found Jun 09 09:33:50.792833 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:50.792804 2571 generic.go:356] "Generic (PLEG): container finished" podID="6435bafd-c764-4c92-9d5c-27c61fa62a59" containerID="4ebb403ddfa01fe150f97e25f140e6b0e1f4d7d9779b848d885411797f17818e" exitCode=0 Jun 09 09:33:50.793271 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:50.792838 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn2p" event={"ID":"6435bafd-c764-4c92-9d5c-27c61fa62a59","Type":"ContainerDied","Data":"4ebb403ddfa01fe150f97e25f140e6b0e1f4d7d9779b848d885411797f17818e"} Jun 09 09:33:51.798657 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:51.798620 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn2p" event={"ID":"6435bafd-c764-4c92-9d5c-27c61fa62a59","Type":"ContainerStarted","Data":"ff93e5b86b94f2bae7e7716101cb5ae464e2d41207ec8b7a45ead46467a0f568"} Jun 09 09:33:51.799930 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:51.799910 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-spslk" event={"ID":"0b3dc75d-cdfa-46de-8d82-76127095dd8f","Type":"ContainerStarted","Data":"a2234fe0ee6786c03b40196a896abfb3e445dae6be5d460dae4d77bedeaee15f"} Jun 09 09:33:51.827304 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:51.827258 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-grn2p" podStartSLOduration=8.874593862 podStartE2EDuration="38.827246317s" totalImagesPullingTime="29.952652455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:51.82566539 +0000 UTC m=+38.701476330" watchObservedRunningTime="2026-06-09 09:33:51.827246317 +0000 UTC m=+38.703057257" Jun 09 09:33:51.842377 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:51.841967 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-spslk" podStartSLOduration=3.675960422 podStartE2EDuration="5.841952213s" totalImagesPullingTime="2.165991791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:51.841714586 +0000 UTC m=+38.717525527" watchObservedRunningTime="2026-06-09 09:33:51.841952213 +0000 UTC m=+38.717763154" Jun 09 09:33:54.663319 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.663282 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln"] Jun 09 09:33:54.703136 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.703108 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w"] Jun 09 09:33:54.703274 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.703231 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:54.706031 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.706008 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 09:33:54.706152 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.706079 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 09:33:54.706220 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.706148 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 09:33:54.706220 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.706008 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 09:33:54.716674 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.716656 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln"] Jun 09 09:33:54.716776 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.716687 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w"] Jun 09 09:33:54.716820 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.716777 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.719662 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.719642 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 09:33:54.719967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.719952 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 09:33:54.720049 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.720009 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 09:33:54.720049 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.719950 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 09:33:54.789553 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.789525 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2b31fd1-82de-4ded-b392-f821e7ad3c82-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bddbb8b7-djfln\" (UID: \"c2b31fd1-82de-4ded-b392-f821e7ad3c82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:54.789553 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.789555 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-ca\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.789700 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.789572 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-hub\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.789700 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.789616 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6cxh\" (UniqueName: \"kubernetes.io/projected/6c698aea-dee9-48a4-9c7f-cb748ae868e9-kube-api-access-n6cxh\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.789700 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.789649 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c698aea-dee9-48a4-9c7f-cb748ae868e9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.789700 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.789677 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b31fd1-82de-4ded-b392-f821e7ad3c82-tmp\") pod \"klusterlet-addon-workmgr-7bddbb8b7-djfln\" (UID: \"c2b31fd1-82de-4ded-b392-f821e7ad3c82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:54.789847 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.789725 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:33:54.789847 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.789742 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.789847 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.789794 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6lf6\" (UniqueName: \"kubernetes.io/projected/c2b31fd1-82de-4ded-b392-f821e7ad3c82-kube-api-access-h6lf6\") pod \"klusterlet-addon-workmgr-7bddbb8b7-djfln\" (UID: \"c2b31fd1-82de-4ded-b392-f821e7ad3c82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:54.789847 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.789818 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.789847 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:54.789834 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:54.789990 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:33:54.789914 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls podName:c0742eb2-819f-4aac-8d8a-42243e17defa nodeName:}" failed. No retries permitted until 2026-06-09 09:34:02.78990136 +0000 UTC m=+49.665712278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls") pod "dns-default-g9ppj" (UID: "c0742eb2-819f-4aac-8d8a-42243e17defa") : secret "dns-default-metrics-tls" not found Jun 09 09:33:54.890321 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.890290 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c698aea-dee9-48a4-9c7f-cb748ae868e9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.890321 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.890323 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b31fd1-82de-4ded-b392-f821e7ad3c82-tmp\") pod \"klusterlet-addon-workmgr-7bddbb8b7-djfln\" (UID: \"c2b31fd1-82de-4ded-b392-f821e7ad3c82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:54.890499 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.890368 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.890499 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.890402 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6lf6\" (UniqueName: \"kubernetes.io/projected/c2b31fd1-82de-4ded-b392-f821e7ad3c82-kube-api-access-h6lf6\") pod \"klusterlet-addon-workmgr-7bddbb8b7-djfln\" (UID: \"c2b31fd1-82de-4ded-b392-f821e7ad3c82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:54.890499 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.890425 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.890499 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.890476 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2b31fd1-82de-4ded-b392-f821e7ad3c82-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bddbb8b7-djfln\" (UID: \"c2b31fd1-82de-4ded-b392-f821e7ad3c82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:54.890807 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.890499 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-ca\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.890807 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.890522 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-hub\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.890807 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.890558 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6cxh\" (UniqueName: \"kubernetes.io/projected/6c698aea-dee9-48a4-9c7f-cb748ae868e9-kube-api-access-n6cxh\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.890937 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.890847 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b31fd1-82de-4ded-b392-f821e7ad3c82-tmp\") pod \"klusterlet-addon-workmgr-7bddbb8b7-djfln\" (UID: \"c2b31fd1-82de-4ded-b392-f821e7ad3c82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:54.891102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.891080 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c698aea-dee9-48a4-9c7f-cb748ae868e9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.894352 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.894323 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-ca\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.894440 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.894388 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.894480 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.894445 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-hub\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.894480 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.894459 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2b31fd1-82de-4ded-b392-f821e7ad3c82-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bddbb8b7-djfln\" (UID: \"c2b31fd1-82de-4ded-b392-f821e7ad3c82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:54.894790 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.894770 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c698aea-dee9-48a4-9c7f-cb748ae868e9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.898146 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.898128 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6cxh\" (UniqueName: \"kubernetes.io/projected/6c698aea-dee9-48a4-9c7f-cb748ae868e9-kube-api-access-n6cxh\") pod \"cluster-proxy-proxy-agent-7644889586-d4z5w\" (UID: \"6c698aea-dee9-48a4-9c7f-cb748ae868e9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:54.898406 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:54.898386 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6lf6\" (UniqueName: \"kubernetes.io/projected/c2b31fd1-82de-4ded-b392-f821e7ad3c82-kube-api-access-h6lf6\") pod \"klusterlet-addon-workmgr-7bddbb8b7-djfln\" (UID: \"c2b31fd1-82de-4ded-b392-f821e7ad3c82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:55.012295 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:55.012267 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:33:55.034375 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:55.034349 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:33:55.142570 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:55.142542 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln"] Jun 09 09:33:55.146259 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:55.146220 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b31fd1_82de_4ded_b392_f821e7ad3c82.slice/crio-95950835f91db068f2b14a022c25315894047c12183c852d56c5808740b8ccd1 WatchSource:0}: Error finding container 95950835f91db068f2b14a022c25315894047c12183c852d56c5808740b8ccd1: Status 404 returned error can't find the container with id 95950835f91db068f2b14a022c25315894047c12183c852d56c5808740b8ccd1 Jun 09 09:33:55.164798 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:55.164774 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w"] Jun 09 09:33:55.167429 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:33:55.167401 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c698aea_dee9_48a4_9c7f_cb748ae868e9.slice/crio-2a548afd0243cd5946d1e4eed60c5711e38675b9a44f45e87b23227135ffa0e7 WatchSource:0}: Error finding container 2a548afd0243cd5946d1e4eed60c5711e38675b9a44f45e87b23227135ffa0e7: Status 404 returned error can't find the container with id 2a548afd0243cd5946d1e4eed60c5711e38675b9a44f45e87b23227135ffa0e7 Jun 09 09:33:55.811640 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:55.811600 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" event={"ID":"6c698aea-dee9-48a4-9c7f-cb748ae868e9","Type":"ContainerStarted","Data":"2a548afd0243cd5946d1e4eed60c5711e38675b9a44f45e87b23227135ffa0e7"} Jun 09 09:33:55.812893 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:33:55.812837 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" event={"ID":"c2b31fd1-82de-4ded-b392-f821e7ad3c82","Type":"ContainerStarted","Data":"95950835f91db068f2b14a022c25315894047c12183c852d56c5808740b8ccd1"} Jun 09 09:34:01.833139 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:01.833108 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" event={"ID":"c2b31fd1-82de-4ded-b392-f821e7ad3c82","Type":"ContainerStarted","Data":"d1a0db0cfb60a5512093a1f18bcf55e0c5316a7c022bf7e26c49a855dcb11c55"} Jun 09 09:34:01.833605 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:01.833295 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:34:01.835129 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:01.835102 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:34:01.835363 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:01.835336 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" event={"ID":"6c698aea-dee9-48a4-9c7f-cb748ae868e9","Type":"ContainerStarted","Data":"2d83037e0e1c0db52df672594c607bf911d6da3f2d24c08bba180b8af40ee815"} Jun 09 09:34:01.835446 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:01.835378 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" event={"ID":"6c698aea-dee9-48a4-9c7f-cb748ae868e9","Type":"ContainerStarted","Data":"da97e765cd1239e37386da2471bf44bfa707dceada984e98577300718a8c9349"} Jun 09 09:34:01.835446 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:01.835395 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" event={"ID":"6c698aea-dee9-48a4-9c7f-cb748ae868e9","Type":"ContainerStarted","Data":"d6bfea6271ff4fcfcb3437cedc529594c2f6458f5184bd1c4e74bfbdc6c2fa36"} Jun 09 09:34:01.852929 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:01.852879 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" podStartSLOduration=2.186710754 podStartE2EDuration="7.852865974s" totalImagesPullingTime="5.66615522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:34:01.85235838 +0000 UTC m=+48.728169323" watchObservedRunningTime="2026-06-09 09:34:01.852865974 +0000 UTC m=+48.728676911" Jun 09 09:34:01.889543 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:01.889489 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" podStartSLOduration=2.258126229 podStartE2EDuration="7.889472194s" totalImagesPullingTime="5.631345965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:34:01.889281922 +0000 UTC m=+48.765092862" watchObservedRunningTime="2026-06-09 09:34:01.889472194 +0000 UTC m=+48.765283136" Jun 09 09:34:02.850263 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:02.850235 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:34:02.850647 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:34:02.850376 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:34:02.850647 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:34:02.850446 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls podName:c0742eb2-819f-4aac-8d8a-42243e17defa nodeName:}" failed. No retries permitted until 2026-06-09 09:34:18.850431635 +0000 UTC m=+65.726242575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls") pod "dns-default-g9ppj" (UID: "c0742eb2-819f-4aac-8d8a-42243e17defa") : secret "dns-default-metrics-tls" not found Jun 09 09:34:14.781067 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:14.781041 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pllj" Jun 09 09:34:18.861686 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:18.861650 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:34:18.862067 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:34:18.861838 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:34:18.862067 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:34:18.861905 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls podName:c0742eb2-819f-4aac-8d8a-42243e17defa nodeName:}" failed. No retries permitted until 2026-06-09 09:34:50.861890261 +0000 UTC m=+97.737701178 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls") pod "dns-default-g9ppj" (UID: "c0742eb2-819f-4aac-8d8a-42243e17defa") : secret "dns-default-metrics-tls" not found Jun 09 09:34:19.365862 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.365815 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:34:19.371918 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.371896 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 09:34:19.376415 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:34:19.376397 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 09:34:19.376468 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:34:19.376457 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs podName:4ef2d0e0-e726-43ea-908e-d9636e26ecc2 nodeName:}" failed. No retries permitted until 2026-06-09 09:35:23.376441547 +0000 UTC m=+130.252252465 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs") pod "network-metrics-daemon-w4s2k" (UID: "4ef2d0e0-e726-43ea-908e-d9636e26ecc2") : secret "metrics-daemon-secret" not found Jun 09 09:34:19.466512 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.466479 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pqx\" (UniqueName: \"kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx\") pod \"network-check-target-rbd4m\" (UID: \"a3f79f70-407f-4ba1-8284-e6baa6b290b4\") " pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:34:19.466598 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.466521 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:34:19.469623 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.469602 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 09:34:19.469700 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.469663 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 09:34:19.478975 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.478953 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1dc76fe-cb2a-41aa-b119-ae18f1d752b9-original-pull-secret\") pod \"global-pull-secret-syncer-nmz6l\" (UID: \"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9\") " pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:34:19.479673 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.479658 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 09:34:19.489013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.488994 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5pqx\" (UniqueName: \"kubernetes.io/projected/a3f79f70-407f-4ba1-8284-e6baa6b290b4-kube-api-access-k5pqx\") pod \"network-check-target-rbd4m\" (UID: \"a3f79f70-407f-4ba1-8284-e6baa6b290b4\") " pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:34:19.539121 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.539081 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmz6l" Jun 09 09:34:19.554177 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.554154 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbl4j\"" Jun 09 09:34:19.561477 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.561453 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:34:19.676476 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.676446 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nmz6l"] Jun 09 09:34:19.679543 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:34:19.679519 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1dc76fe_cb2a_41aa_b119_ae18f1d752b9.slice/crio-435d8989a2c988b22b8548e12a45eff5b4cc8ed20b1298fbc1572edf6c566715 WatchSource:0}: Error finding container 435d8989a2c988b22b8548e12a45eff5b4cc8ed20b1298fbc1572edf6c566715: Status 404 returned error can't find the container with id 435d8989a2c988b22b8548e12a45eff5b4cc8ed20b1298fbc1572edf6c566715 Jun 09 09:34:19.688816 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.688798 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbd4m"] Jun 09 09:34:19.691889 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:34:19.691869 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f79f70_407f_4ba1_8284_e6baa6b290b4.slice/crio-35e666f7b723f23f1bc852a282eae770f4facd7686864cec7b5f2e382bbe2db0 WatchSource:0}: Error finding container 35e666f7b723f23f1bc852a282eae770f4facd7686864cec7b5f2e382bbe2db0: Status 404 returned error can't find the container with id 35e666f7b723f23f1bc852a282eae770f4facd7686864cec7b5f2e382bbe2db0 Jun 09 09:34:19.880726 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.880640 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nmz6l" event={"ID":"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9","Type":"ContainerStarted","Data":"435d8989a2c988b22b8548e12a45eff5b4cc8ed20b1298fbc1572edf6c566715"} Jun 09 09:34:19.881734 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:19.881714 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbd4m" event={"ID":"a3f79f70-407f-4ba1-8284-e6baa6b290b4","Type":"ContainerStarted","Data":"35e666f7b723f23f1bc852a282eae770f4facd7686864cec7b5f2e382bbe2db0"} Jun 09 09:34:26.900514 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:26.900472 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbd4m" event={"ID":"a3f79f70-407f-4ba1-8284-e6baa6b290b4","Type":"ContainerStarted","Data":"d1a4e6ab748e7cc29605c24175070b3e5b3cbbfd2255e4c83823aaea471eb44f"} Jun 09 09:34:26.900900 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:26.900542 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:34:26.923245 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:26.923200 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rbd4m" podStartSLOduration=67.579398843 podStartE2EDuration="1m13.923186801s" totalImagesPullingTime="6.343787958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:34:26.923075912 +0000 UTC m=+73.798886851" watchObservedRunningTime="2026-06-09 09:34:26.923186801 +0000 UTC m=+73.798997741" Jun 09 09:34:29.912547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:29.912514 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nmz6l" event={"ID":"b1dc76fe-cb2a-41aa-b119-ae18f1d752b9","Type":"ContainerStarted","Data":"a5275ea15af42761a68cd67f6eb920be04fe87eee887ebc52ac7f8bebcb6efcf"} Jun 09 09:34:29.929933 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:29.929887 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nmz6l" podStartSLOduration=65.873137454 podStartE2EDuration="1m15.929872389s" totalImagesPullingTime="10.056734935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:34:29.92920885 +0000 UTC m=+76.805019791" watchObservedRunningTime="2026-06-09 09:34:29.929872389 +0000 UTC m=+76.805683328" Jun 09 09:34:50.895702 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:50.895667 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:34:50.896181 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:34:50.895794 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:34:50.896181 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:34:50.895861 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls podName:c0742eb2-819f-4aac-8d8a-42243e17defa nodeName:}" failed. No retries permitted until 2026-06-09 09:35:54.895845233 +0000 UTC m=+161.771656151 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls") pod "dns-default-g9ppj" (UID: "c0742eb2-819f-4aac-8d8a-42243e17defa") : secret "dns-default-metrics-tls" not found Jun 09 09:34:57.907884 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:34:57.907851 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rbd4m" Jun 09 09:35:23.413363 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:35:23.413310 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:35:23.413784 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:35:23.413459 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 09:35:23.413784 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:35:23.413554 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs podName:4ef2d0e0-e726-43ea-908e-d9636e26ecc2 nodeName:}" failed. No retries permitted until 2026-06-09 09:37:25.413536995 +0000 UTC m=+252.289347917 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs") pod "network-metrics-daemon-w4s2k" (UID: "4ef2d0e0-e726-43ea-908e-d9636e26ecc2") : secret "metrics-daemon-secret" not found Jun 09 09:35:49.962149 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:35:49.962102 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g9ppj" podUID="c0742eb2-819f-4aac-8d8a-42243e17defa" Jun 09 09:35:50.136685 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:35:50.136649 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g9ppj" Jun 09 09:35:51.645765 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:35:51.645711 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w4s2k" podUID="4ef2d0e0-e726-43ea-908e-d9636e26ecc2" Jun 09 09:35:54.931044 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:35:54.931002 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:35:54.931471 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:35:54.931163 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:35:54.931471 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:35:54.931236 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls podName:c0742eb2-819f-4aac-8d8a-42243e17defa nodeName:}" failed. No retries permitted until 2026-06-09 09:37:56.931220273 +0000 UTC m=+283.807031191 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls") pod "dns-default-g9ppj" (UID: "c0742eb2-819f-4aac-8d8a-42243e17defa") : secret "dns-default-metrics-tls" not found Jun 09 09:36:01.169854 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:01.169818 2571 generic.go:356] "Generic (PLEG): container finished" podID="c2b31fd1-82de-4ded-b392-f821e7ad3c82" containerID="d1a0db0cfb60a5512093a1f18bcf55e0c5316a7c022bf7e26c49a855dcb11c55" exitCode=1 Jun 09 09:36:01.170222 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:01.169894 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" event={"ID":"c2b31fd1-82de-4ded-b392-f821e7ad3c82","Type":"ContainerDied","Data":"d1a0db0cfb60a5512093a1f18bcf55e0c5316a7c022bf7e26c49a855dcb11c55"} Jun 09 09:36:01.170222 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:01.170196 2571 scope.go:117] "RemoveContainer" containerID="d1a0db0cfb60a5512093a1f18bcf55e0c5316a7c022bf7e26c49a855dcb11c55" Jun 09 09:36:01.834072 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:01.834030 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:36:02.174689 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:02.174607 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" event={"ID":"c2b31fd1-82de-4ded-b392-f821e7ad3c82","Type":"ContainerStarted","Data":"684bd63207633c81df47bab1dde219c9b7279bde9459d974b54f9bec6458fffd"} Jun 09 09:36:02.175039 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:02.174815 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:36:02.175424 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:02.175407 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bddbb8b7-djfln" Jun 09 09:36:06.627020 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:06.626970 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:36:23.100260 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:23.100232 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-842b5_83a1a323-5119-46fd-b21d-4c51f9388560/dns-node-resolver/0.log" Jun 09 09:36:24.503007 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:24.502977 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vsldw_3a6da177-59ec-4e4e-9e71-aeb42d43ebd2/node-ca/0.log" Jun 09 09:36:25.036084 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:25.036039 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" podUID="6c698aea-dee9-48a4-9c7f-cb748ae868e9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 09:36:25.101827 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:25.101807 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-spslk_0b3dc75d-cdfa-46de-8d82-76127095dd8f/serve-healthcheck-canary/0.log" Jun 09 09:36:35.036024 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:35.035982 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" podUID="6c698aea-dee9-48a4-9c7f-cb748ae868e9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 09:36:42.863727 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.863698 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x5nlz"] Jun 09 09:36:42.865704 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.865686 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:42.868531 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.868499 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 09:36:42.868654 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.868551 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jd4jm\"" Jun 09 09:36:42.869477 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.869449 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 09:36:42.869596 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.869480 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 09:36:42.869596 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.869543 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 09:36:42.883456 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.883433 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x5nlz"] Jun 09 09:36:42.967250 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.967219 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05a57b53-0a29-4c48-9f92-edb5d8dc919c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:42.967425 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.967261 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05a57b53-0a29-4c48-9f92-edb5d8dc919c-data-volume\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:42.967425 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.967293 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05a57b53-0a29-4c48-9f92-edb5d8dc919c-crio-socket\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:42.967425 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.967316 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxq27\" (UniqueName: \"kubernetes.io/projected/05a57b53-0a29-4c48-9f92-edb5d8dc919c-kube-api-access-rxq27\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:42.967425 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:42.967352 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05a57b53-0a29-4c48-9f92-edb5d8dc919c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.067849 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.067816 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05a57b53-0a29-4c48-9f92-edb5d8dc919c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.068016 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.067882 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05a57b53-0a29-4c48-9f92-edb5d8dc919c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.068016 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.067905 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05a57b53-0a29-4c48-9f92-edb5d8dc919c-data-volume\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.068016 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.067924 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05a57b53-0a29-4c48-9f92-edb5d8dc919c-crio-socket\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.068016 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.067938 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxq27\" (UniqueName: \"kubernetes.io/projected/05a57b53-0a29-4c48-9f92-edb5d8dc919c-kube-api-access-rxq27\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.068016 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.068018 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05a57b53-0a29-4c48-9f92-edb5d8dc919c-crio-socket\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.068343 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.068319 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05a57b53-0a29-4c48-9f92-edb5d8dc919c-data-volume\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.068520 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.068500 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05a57b53-0a29-4c48-9f92-edb5d8dc919c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.070206 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.070188 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05a57b53-0a29-4c48-9f92-edb5d8dc919c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.075743 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.075721 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxq27\" (UniqueName: \"kubernetes.io/projected/05a57b53-0a29-4c48-9f92-edb5d8dc919c-kube-api-access-rxq27\") pod \"insights-runtime-extractor-x5nlz\" (UID: \"05a57b53-0a29-4c48-9f92-edb5d8dc919c\") " pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.174024 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.173948 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x5nlz" Jun 09 09:36:43.289712 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:43.289685 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x5nlz"] Jun 09 09:36:43.292830 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:36:43.292802 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a57b53_0a29_4c48_9f92_edb5d8dc919c.slice/crio-d67f4e9278d90eb0df1f576b357fe77ae280f14d0b6c712d3be517171eb6b94b WatchSource:0}: Error finding container d67f4e9278d90eb0df1f576b357fe77ae280f14d0b6c712d3be517171eb6b94b: Status 404 returned error can't find the container with id d67f4e9278d90eb0df1f576b357fe77ae280f14d0b6c712d3be517171eb6b94b Jun 09 09:36:44.294296 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:44.294208 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5nlz" event={"ID":"05a57b53-0a29-4c48-9f92-edb5d8dc919c","Type":"ContainerStarted","Data":"c4266833e93f6b0dd9a9431efeb5aa56b7842abb40fbbce21923c34b2a5b5459"} Jun 09 09:36:44.294296 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:44.294290 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5nlz" event={"ID":"05a57b53-0a29-4c48-9f92-edb5d8dc919c","Type":"ContainerStarted","Data":"8b53f6a2e6b707eb93276474a78fc7eb4963c1cde50a436d8ecdb4fedbfff856"} Jun 09 09:36:44.294667 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:44.294310 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5nlz" event={"ID":"05a57b53-0a29-4c48-9f92-edb5d8dc919c","Type":"ContainerStarted","Data":"d67f4e9278d90eb0df1f576b357fe77ae280f14d0b6c712d3be517171eb6b94b"} Jun 09 09:36:45.036486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:45.036439 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" podUID="6c698aea-dee9-48a4-9c7f-cb748ae868e9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 09:36:45.036646 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:45.036535 2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" Jun 09 09:36:45.037171 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:45.037129 2571 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"2d83037e0e1c0db52df672594c607bf911d6da3f2d24c08bba180b8af40ee815"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 09:36:45.037298 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:45.037191 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" podUID="6c698aea-dee9-48a4-9c7f-cb748ae868e9" containerName="service-proxy" containerID="cri-o://2d83037e0e1c0db52df672594c607bf911d6da3f2d24c08bba180b8af40ee815" gracePeriod=30 Jun 09 09:36:46.302189 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:46.302155 2571 generic.go:356] "Generic (PLEG): container finished" podID="6c698aea-dee9-48a4-9c7f-cb748ae868e9" containerID="2d83037e0e1c0db52df672594c607bf911d6da3f2d24c08bba180b8af40ee815" exitCode=2 Jun 09 09:36:46.302597 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:46.302229 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" event={"ID":"6c698aea-dee9-48a4-9c7f-cb748ae868e9","Type":"ContainerDied","Data":"2d83037e0e1c0db52df672594c607bf911d6da3f2d24c08bba180b8af40ee815"} Jun 09 09:36:46.302597 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:46.302269 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7644889586-d4z5w" event={"ID":"6c698aea-dee9-48a4-9c7f-cb748ae868e9","Type":"ContainerStarted","Data":"2d8414f0aa9956acf5daa0863d0161afbed143dd312fbd7c5e32864a3177335b"} Jun 09 09:36:46.304180 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:46.304149 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5nlz" event={"ID":"05a57b53-0a29-4c48-9f92-edb5d8dc919c","Type":"ContainerStarted","Data":"94324a826ce1aa9b099341f70b22e5766cd2fdf3c1f93258dff603796195fa9f"} Jun 09 09:36:46.337201 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:46.337154 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x5nlz" podStartSLOduration=2.170724504 podStartE2EDuration="4.337141201s" totalImagesPullingTime="2.166416697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:36:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:46.336593147 +0000 UTC m=+213.212404087" watchObservedRunningTime="2026-06-09 09:36:46.337141201 +0000 UTC m=+213.212952141" Jun 09 09:36:48.399600 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.399570 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-764f7cd6b6-cx4cg"] Jun 09 09:36:48.401700 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.401684 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.404246 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.404222 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 09:36:48.405292 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.405261 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 09:36:48.405413 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.405262 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 09:36:48.405413 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.405267 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 09:36:48.405413 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.405295 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 09:36:48.405576 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.405505 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 09:36:48.405576 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.405523 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vw84x\"" Jun 09 09:36:48.405680 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.405615 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 09:36:48.413590 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.413570 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764f7cd6b6-cx4cg"] Jun 09 09:36:48.510644 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.510611 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpwsl\" (UniqueName: \"kubernetes.io/projected/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-kube-api-access-hpwsl\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.510818 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.510653 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-serving-cert\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.510818 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.510671 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-oauth-serving-cert\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.510818 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.510781 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-config\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.510931 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.510821 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-oauth-config\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.510931 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.510853 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-service-ca\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.612113 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.612075 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpwsl\" (UniqueName: \"kubernetes.io/projected/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-kube-api-access-hpwsl\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.612285 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.612127 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-serving-cert\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.612285 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.612148 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-oauth-serving-cert\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.612285 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.612196 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-config\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.612285 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.612220 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-oauth-config\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.612490 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.612370 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-service-ca\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.612956 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.612934 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-service-ca\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.613092 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.612980 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-config\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.613092 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.612980 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-oauth-serving-cert\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.614545 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.614519 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-serving-cert\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.614545 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.614530 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-oauth-config\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.619550 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.619522 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpwsl\" (UniqueName: \"kubernetes.io/projected/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-kube-api-access-hpwsl\") pod \"console-764f7cd6b6-cx4cg\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.710367 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.710335 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:48.829850 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:48.829821 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764f7cd6b6-cx4cg"] Jun 09 09:36:48.832619 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:36:48.832586 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6ce39f_801a_4b9f_aba5_6a7f6f3502cd.slice/crio-a05666779e228fc805dab14affe042a140223c07f2673100241322d214c9963a WatchSource:0}: Error finding container a05666779e228fc805dab14affe042a140223c07f2673100241322d214c9963a: Status 404 returned error can't find the container with id a05666779e228fc805dab14affe042a140223c07f2673100241322d214c9963a Jun 09 09:36:49.313173 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:49.313134 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764f7cd6b6-cx4cg" event={"ID":"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd","Type":"ContainerStarted","Data":"a05666779e228fc805dab14affe042a140223c07f2673100241322d214c9963a"} Jun 09 09:36:50.297612 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.297576 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x9665"] Jun 09 09:36:50.299799 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.299778 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.302219 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.302197 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 09:36:50.302395 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.302378 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 09:36:50.303421 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.303350 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 09:36:50.303421 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.303386 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 09:36:50.303421 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.303398 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 09:36:50.303631 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.303387 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q78cq\"" Jun 09 09:36:50.303631 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.303470 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 09:36:50.425856 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.425826 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.426031 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.425898 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-sys\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.426031 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.425963 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-root\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.426031 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.426014 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-accelerators-collector-config\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.426204 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.426051 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m6h7\" (UniqueName: \"kubernetes.io/projected/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-kube-api-access-5m6h7\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.426204 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.426087 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-wtmp\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.426204 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.426113 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-textfile\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.426204 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.426139 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-metrics-client-ca\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.426386 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.426190 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-tls\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527040 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527009 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527201 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527067 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-sys\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527201 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527084 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-root\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527201 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527110 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-accelerators-collector-config\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527201 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527134 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6h7\" (UniqueName: \"kubernetes.io/projected/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-kube-api-access-5m6h7\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527201 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527151 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-wtmp\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527201 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527166 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-textfile\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527201 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527187 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-metrics-client-ca\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527538 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527201 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-sys\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527538 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527201 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-root\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527538 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527264 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-tls\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527538 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527332 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-wtmp\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527677 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527578 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-textfile\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527885 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527865 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-metrics-client-ca\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.527936 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.527880 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-accelerators-collector-config\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.529404 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.529380 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.529508 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.529413 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-node-exporter-tls\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.536033 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.536012 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m6h7\" (UniqueName: \"kubernetes.io/projected/0d668cc5-78aa-4784-bd35-88d3a9d9cd25-kube-api-access-5m6h7\") pod \"node-exporter-x9665\" (UID: \"0d668cc5-78aa-4784-bd35-88d3a9d9cd25\") " pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.609118 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:50.609047 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x9665" Jun 09 09:36:50.621134 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:36:50.621098 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d668cc5_78aa_4784_bd35_88d3a9d9cd25.slice/crio-ba59c78e3c49400c090ca5c9c71e7f4292812411f388a07d38475cbb39da46d7 WatchSource:0}: Error finding container ba59c78e3c49400c090ca5c9c71e7f4292812411f388a07d38475cbb39da46d7: Status 404 returned error can't find the container with id ba59c78e3c49400c090ca5c9c71e7f4292812411f388a07d38475cbb39da46d7 Jun 09 09:36:51.320510 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:51.320474 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9665" event={"ID":"0d668cc5-78aa-4784-bd35-88d3a9d9cd25","Type":"ContainerStarted","Data":"ba59c78e3c49400c090ca5c9c71e7f4292812411f388a07d38475cbb39da46d7"} Jun 09 09:36:52.326406 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:52.326369 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764f7cd6b6-cx4cg" event={"ID":"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd","Type":"ContainerStarted","Data":"8b5cc19d6eddfdf4b6434f5358a7c81cdbfd5f4691b930346e8290f17492a4f1"} Jun 09 09:36:52.343313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:52.343270 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-764f7cd6b6-cx4cg" podStartSLOduration=1.081785434 podStartE2EDuration="4.343255983s" totalImagesPullingTime="3.261470549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:52.342839316 +0000 UTC m=+219.218650258" watchObservedRunningTime="2026-06-09 09:36:52.343255983 +0000 UTC m=+219.219066923" Jun 09 09:36:53.331674 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:53.331642 2571 generic.go:356] "Generic (PLEG): container finished" podID="0d668cc5-78aa-4784-bd35-88d3a9d9cd25" containerID="4aec28b8f8daf60852be1063b782a81f1b6f18c3f7ff695d18eb547473c2c72f" exitCode=0 Jun 09 09:36:53.332004 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:53.331727 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9665" event={"ID":"0d668cc5-78aa-4784-bd35-88d3a9d9cd25","Type":"ContainerDied","Data":"4aec28b8f8daf60852be1063b782a81f1b6f18c3f7ff695d18eb547473c2c72f"} Jun 09 09:36:54.336536 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:54.336499 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9665" event={"ID":"0d668cc5-78aa-4784-bd35-88d3a9d9cd25","Type":"ContainerStarted","Data":"75a8c155e3bf4a689246dc11cf8318b8358e858f56fac04dd5aac9ae96b34b2b"} Jun 09 09:36:54.337123 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:54.336548 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9665" event={"ID":"0d668cc5-78aa-4784-bd35-88d3a9d9cd25","Type":"ContainerStarted","Data":"7d0bbcc1760fbdbd73c6a25f776ec6e3f142048925afa2b6a3825194f9417f7e"} Jun 09 09:36:54.357305 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:54.357255 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x9665" podStartSLOduration=1.762678088 podStartE2EDuration="4.357241648s" totalImagesPullingTime="2.530730754s" totalInitContainerRuntime="63.832806ms" isStatefulPod=true podCreationTimestamp="2026-06-09 09:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:54.355552276 +0000 UTC m=+221.231363238" watchObservedRunningTime="2026-06-09 09:36:54.357241648 +0000 UTC m=+221.233052587" Jun 09 09:36:56.008639 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.008609 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7955945454-b6lq2"] Jun 09 09:36:56.010662 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.010643 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.019805 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.019771 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 09:36:56.022885 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.022863 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7955945454-b6lq2"] Jun 09 09:36:56.171313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.171275 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9mxh\" (UniqueName: \"kubernetes.io/projected/75749c4c-a753-4aac-a8f5-91b34a91c6f5-kube-api-access-k9mxh\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.171487 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.171328 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-trusted-ca-bundle\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.171487 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.171385 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-serving-cert\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.171487 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.171441 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-oauth-config\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.171487 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.171476 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-service-ca\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.171648 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.171508 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-config\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.171648 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.171522 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-oauth-serving-cert\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.272120 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.272038 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-oauth-config\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.272120 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.272075 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-service-ca\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.272120 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.272103 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-config\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.272370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.272139 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-oauth-serving-cert\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.272370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.272160 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9mxh\" (UniqueName: \"kubernetes.io/projected/75749c4c-a753-4aac-a8f5-91b34a91c6f5-kube-api-access-k9mxh\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.272370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.272197 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-trusted-ca-bundle\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.272370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.272226 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-serving-cert\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.272974 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.272945 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-config\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.273103 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.273024 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-oauth-serving-cert\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.273103 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.273029 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-service-ca\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.273198 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.273173 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-trusted-ca-bundle\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.274658 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.274632 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-oauth-config\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.278735 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.275022 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-serving-cert\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.281304 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.281286 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9mxh\" (UniqueName: \"kubernetes.io/projected/75749c4c-a753-4aac-a8f5-91b34a91c6f5-kube-api-access-k9mxh\") pod \"console-7955945454-b6lq2\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.319108 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.319084 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:36:56.440858 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:56.440824 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7955945454-b6lq2"] Jun 09 09:36:56.443729 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:36:56.443701 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75749c4c_a753_4aac_a8f5_91b34a91c6f5.slice/crio-a33f783cada51baf5c7ee2a36a6afc43b11a87cb6542a67707b5263d7a00765b WatchSource:0}: Error finding container a33f783cada51baf5c7ee2a36a6afc43b11a87cb6542a67707b5263d7a00765b: Status 404 returned error can't find the container with id a33f783cada51baf5c7ee2a36a6afc43b11a87cb6542a67707b5263d7a00765b Jun 09 09:36:57.347038 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:57.347005 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7955945454-b6lq2" event={"ID":"75749c4c-a753-4aac-a8f5-91b34a91c6f5","Type":"ContainerStarted","Data":"8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2"} Jun 09 09:36:57.347413 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:57.347054 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7955945454-b6lq2" event={"ID":"75749c4c-a753-4aac-a8f5-91b34a91c6f5","Type":"ContainerStarted","Data":"a33f783cada51baf5c7ee2a36a6afc43b11a87cb6542a67707b5263d7a00765b"} Jun 09 09:36:57.364520 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:57.364461 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7955945454-b6lq2" podStartSLOduration=2.3644446869999998 podStartE2EDuration="2.364444687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:57.363963901 +0000 UTC m=+224.239774842" watchObservedRunningTime="2026-06-09 09:36:57.364444687 +0000 UTC m=+224.240255630" Jun 09 09:36:58.711329 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:58.711295 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:58.711707 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:58.711351 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:36:58.712665 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:58.712645 2571 patch_prober.go:28] interesting pod/console-764f7cd6b6-cx4cg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jun 09 09:36:58.712712 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:36:58.712698 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-764f7cd6b6-cx4cg" podUID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" Jun 09 09:37:06.319857 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:06.319813 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:37:06.320238 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:06.319880 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:37:06.321184 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:06.321155 2571 patch_prober.go:28] interesting pod/console-7955945454-b6lq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 09 09:37:06.321238 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:06.321197 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7955945454-b6lq2" podUID="75749c4c-a753-4aac-a8f5-91b34a91c6f5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 09 09:37:08.711379 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:08.711333 2571 patch_prober.go:28] interesting pod/console-764f7cd6b6-cx4cg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jun 09 09:37:08.711866 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:08.711393 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-764f7cd6b6-cx4cg" podUID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" Jun 09 09:37:16.320231 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:16.320192 2571 patch_prober.go:28] interesting pod/console-7955945454-b6lq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 09 09:37:16.320622 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:16.320283 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7955945454-b6lq2" podUID="75749c4c-a753-4aac-a8f5-91b34a91c6f5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 09 09:37:18.710741 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:18.710708 2571 patch_prober.go:28] interesting pod/console-764f7cd6b6-cx4cg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jun 09 09:37:18.711207 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:18.710788 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-764f7cd6b6-cx4cg" podUID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" Jun 09 09:37:25.491437 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:25.491397 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:37:25.493715 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:25.493691 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ef2d0e0-e726-43ea-908e-d9636e26ecc2-metrics-certs\") pod \"network-metrics-daemon-w4s2k\" (UID: \"4ef2d0e0-e726-43ea-908e-d9636e26ecc2\") " pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:37:25.530532 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:25.530505 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79nq8\"" Jun 09 09:37:25.537770 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:25.537736 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4s2k" Jun 09 09:37:25.707415 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:25.707390 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w4s2k"] Jun 09 09:37:25.710093 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:37:25.710060 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef2d0e0_e726_43ea_908e_d9636e26ecc2.slice/crio-5b21b188dd38c09f8144c8529403cb9122bf3b9dfc7ac3a9ae9b8937773dfeaf WatchSource:0}: Error finding container 5b21b188dd38c09f8144c8529403cb9122bf3b9dfc7ac3a9ae9b8937773dfeaf: Status 404 returned error can't find the container with id 5b21b188dd38c09f8144c8529403cb9122bf3b9dfc7ac3a9ae9b8937773dfeaf Jun 09 09:37:26.319894 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:26.319862 2571 patch_prober.go:28] interesting pod/console-7955945454-b6lq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 09 09:37:26.320159 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:26.319922 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7955945454-b6lq2" podUID="75749c4c-a753-4aac-a8f5-91b34a91c6f5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 09 09:37:26.439295 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:26.439257 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4s2k" event={"ID":"4ef2d0e0-e726-43ea-908e-d9636e26ecc2","Type":"ContainerStarted","Data":"5b21b188dd38c09f8144c8529403cb9122bf3b9dfc7ac3a9ae9b8937773dfeaf"} Jun 09 09:37:27.444169 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:27.444137 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4s2k" event={"ID":"4ef2d0e0-e726-43ea-908e-d9636e26ecc2","Type":"ContainerStarted","Data":"7c53ba9ba3a3aeb7a8ff02bc51b7ecb28acf675aac752674e83f486e9161fa3c"} Jun 09 09:37:27.444532 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:27.444188 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4s2k" event={"ID":"4ef2d0e0-e726-43ea-908e-d9636e26ecc2","Type":"ContainerStarted","Data":"236e2ddc6bece078b9c92c83d3d16f56011e29939f9a1f3ac20ec57995b70387"} Jun 09 09:37:27.460233 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:27.460180 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w4s2k" podStartSLOduration=253.652027353 podStartE2EDuration="4m14.46016591s" totalImagesPullingTime="808.138557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:37:27.459395384 +0000 UTC m=+254.335206323" watchObservedRunningTime="2026-06-09 09:37:27.46016591 +0000 UTC m=+254.335976850" Jun 09 09:37:28.711331 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:28.711242 2571 patch_prober.go:28] interesting pod/console-764f7cd6b6-cx4cg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jun 09 09:37:28.711331 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:28.711294 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-764f7cd6b6-cx4cg" podUID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" Jun 09 09:37:36.319629 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:36.319586 2571 patch_prober.go:28] interesting pod/console-7955945454-b6lq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 09 09:37:36.320036 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:36.319638 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7955945454-b6lq2" podUID="75749c4c-a753-4aac-a8f5-91b34a91c6f5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 09 09:37:38.711185 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:38.711146 2571 patch_prober.go:28] interesting pod/console-764f7cd6b6-cx4cg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jun 09 09:37:38.711566 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:38.711200 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-764f7cd6b6-cx4cg" podUID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" Jun 09 09:37:43.127636 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:43.127607 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9665_0d668cc5-78aa-4784-bd35-88d3a9d9cd25/init-textfile/0.log" Jun 09 09:37:43.328281 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:43.328248 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9665_0d668cc5-78aa-4784-bd35-88d3a9d9cd25/node-exporter/0.log" Jun 09 09:37:43.527307 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:43.527280 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9665_0d668cc5-78aa-4784-bd35-88d3a9d9cd25/kube-rbac-proxy/0.log" Jun 09 09:37:46.324271 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:46.324244 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:37:46.328275 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:46.328256 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:37:46.386019 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:46.385985 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764f7cd6b6-cx4cg"] Jun 09 09:37:48.128770 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:48.128727 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-764f7cd6b6-cx4cg_aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd/console/0.log" Jun 09 09:37:48.328372 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:48.328342 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7955945454-b6lq2_75749c4c-a753-4aac-a8f5-91b34a91c6f5/console/0.log" Jun 09 09:37:49.928182 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:49.928155 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-842b5_83a1a323-5119-46fd-b21d-4c51f9388560/dns-node-resolver/0.log" Jun 09 09:37:51.328602 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:51.328578 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vsldw_3a6da177-59ec-4e4e-9e71-aeb42d43ebd2/node-ca/0.log" Jun 09 09:37:51.928899 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:51.928875 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-spslk_0b3dc75d-cdfa-46de-8d82-76127095dd8f/serve-healthcheck-canary/0.log" Jun 09 09:37:53.137417 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:37:53.137380 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g9ppj" podUID="c0742eb2-819f-4aac-8d8a-42243e17defa" Jun 09 09:37:53.530098 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:53.530061 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g9ppj" Jun 09 09:37:56.932763 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:56.932704 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:37:56.935085 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:56.935061 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0742eb2-819f-4aac-8d8a-42243e17defa-metrics-tls\") pod \"dns-default-g9ppj\" (UID: \"c0742eb2-819f-4aac-8d8a-42243e17defa\") " pod="openshift-dns/dns-default-g9ppj" Jun 09 09:37:57.133661 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:57.133627 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wjbxj\"" Jun 09 09:37:57.141662 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:57.141642 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g9ppj" Jun 09 09:37:57.266649 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:57.266626 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g9ppj"] Jun 09 09:37:57.268698 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:37:57.268670 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0742eb2_819f_4aac_8d8a_42243e17defa.slice/crio-178b0a84e4c42c71bc19814361e9c172f17e1c1d62dd61349b0d73ac808b4e2c WatchSource:0}: Error finding container 178b0a84e4c42c71bc19814361e9c172f17e1c1d62dd61349b0d73ac808b4e2c: Status 404 returned error can't find the container with id 178b0a84e4c42c71bc19814361e9c172f17e1c1d62dd61349b0d73ac808b4e2c Jun 09 09:37:57.543481 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:57.543447 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g9ppj" event={"ID":"c0742eb2-819f-4aac-8d8a-42243e17defa","Type":"ContainerStarted","Data":"178b0a84e4c42c71bc19814361e9c172f17e1c1d62dd61349b0d73ac808b4e2c"} Jun 09 09:37:59.551626 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:59.551594 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g9ppj" event={"ID":"c0742eb2-819f-4aac-8d8a-42243e17defa","Type":"ContainerStarted","Data":"9516988c9040cc6dc990d5f4f11f23f825248718662e936137a55b47cc3a03b4"} Jun 09 09:37:59.552024 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:59.551645 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g9ppj" event={"ID":"c0742eb2-819f-4aac-8d8a-42243e17defa","Type":"ContainerStarted","Data":"93567a0e10c9788f23f976e9a696b9b275cb73f806acb8410148348739b249ce"} Jun 09 09:37:59.552024 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:59.551721 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g9ppj" Jun 09 09:37:59.569468 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:37:59.569418 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g9ppj" podStartSLOduration=251.996230051 podStartE2EDuration="4m13.569401911s" totalImagesPullingTime="1.57317186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:37:59.567305646 +0000 UTC m=+286.443116610" watchObservedRunningTime="2026-06-09 09:37:59.569401911 +0000 UTC m=+286.445212851" Jun 09 09:38:09.557018 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:09.556984 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g9ppj" Jun 09 09:38:11.404964 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.404930 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-764f7cd6b6-cx4cg" podUID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" containerName="console" containerID="cri-o://8b5cc19d6eddfdf4b6434f5358a7c81cdbfd5f4691b930346e8290f17492a4f1" gracePeriod=15 Jun 09 09:38:11.591703 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.591668 2571 generic.go:356] "Generic (PLEG): container finished" podID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" containerID="8b5cc19d6eddfdf4b6434f5358a7c81cdbfd5f4691b930346e8290f17492a4f1" exitCode=0 Jun 09 09:38:11.591884 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.591738 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764f7cd6b6-cx4cg" event={"ID":"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd","Type":"ContainerDied","Data":"8b5cc19d6eddfdf4b6434f5358a7c81cdbfd5f4691b930346e8290f17492a4f1"} Jun 09 09:38:11.639327 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.639304 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:38:11.727165 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.727136 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-oauth-config\") pod \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " Jun 09 09:38:11.727306 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.727169 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-config\") pod \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " Jun 09 09:38:11.727306 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.727204 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-oauth-serving-cert\") pod \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " Jun 09 09:38:11.727306 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.727301 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-service-ca\") pod \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " Jun 09 09:38:11.727449 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.727358 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpwsl\" (UniqueName: \"kubernetes.io/projected/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-kube-api-access-hpwsl\") pod \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " Jun 09 09:38:11.727449 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.727387 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-serving-cert\") pod \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\" (UID: \"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd\") " Jun 09 09:38:11.727638 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.727606 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-config" (OuterVolumeSpecName: "console-config") pod "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" (UID: "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:11.727782 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.727610 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" (UID: "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:11.727782 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.727700 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-service-ca" (OuterVolumeSpecName: "service-ca") pod "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" (UID: "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:11.729433 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.729407 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-kube-api-access-hpwsl" (OuterVolumeSpecName: "kube-api-access-hpwsl") pod "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" (UID: "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd"). InnerVolumeSpecName "kube-api-access-hpwsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:38:11.729520 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.729453 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" (UID: "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:11.729520 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.729488 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" (UID: "aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:11.827969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.827938 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpwsl\" (UniqueName: \"kubernetes.io/projected/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-kube-api-access-hpwsl\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:11.827969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.827966 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:11.827969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.827975 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-oauth-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:11.827969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.827984 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-console-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:11.828214 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.827992 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-oauth-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:11.828214 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:11.828001 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd-service-ca\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:12.596796 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:12.596767 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764f7cd6b6-cx4cg" Jun 09 09:38:12.596796 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:12.596782 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764f7cd6b6-cx4cg" event={"ID":"aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd","Type":"ContainerDied","Data":"a05666779e228fc805dab14affe042a140223c07f2673100241322d214c9963a"} Jun 09 09:38:12.597262 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:12.596834 2571 scope.go:117] "RemoveContainer" containerID="8b5cc19d6eddfdf4b6434f5358a7c81cdbfd5f4691b930346e8290f17492a4f1" Jun 09 09:38:12.616622 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:12.616598 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764f7cd6b6-cx4cg"] Jun 09 09:38:12.626560 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:12.626540 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-764f7cd6b6-cx4cg"] Jun 09 09:38:13.579329 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:13.579306 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:38:13.580832 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:13.580809 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:38:13.584569 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:13.584554 2571 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 09:38:13.632511 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:13.632410 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" path="/var/lib/kubelet/pods/aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd/volumes" Jun 09 09:38:18.523573 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.523537 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dd8bc6dc-gj8pb"] Jun 09 09:38:18.524062 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.523775 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" containerName="console" Jun 09 09:38:18.524062 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.523786 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" containerName="console" Jun 09 09:38:18.524062 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.523834 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6ce39f-801a-4b9f-aba5-6a7f6f3502cd" containerName="console" Jun 09 09:38:18.526451 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.526435 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.536206 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.536184 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd8bc6dc-gj8pb"] Jun 09 09:38:18.569193 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.569171 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-trusted-ca-bundle\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.569313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.569203 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-service-ca\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.569313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.569224 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-oauth-config\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.569313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.569284 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-oauth-serving-cert\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.569313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.569304 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cfvs\" (UniqueName: \"kubernetes.io/projected/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-kube-api-access-8cfvs\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.569516 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.569412 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-serving-cert\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.569516 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.569446 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-config\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.670235 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.670203 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-serving-cert\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.670235 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.670239 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-config\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.670514 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.670266 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-trusted-ca-bundle\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.670514 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.670294 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-service-ca\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.670514 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.670314 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-oauth-config\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.670514 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.670336 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-oauth-serving-cert\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.670514 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.670362 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cfvs\" (UniqueName: \"kubernetes.io/projected/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-kube-api-access-8cfvs\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.671053 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.671031 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-service-ca\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.671127 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.671104 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-config\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.671127 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.671112 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-oauth-serving-cert\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.671484 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.671461 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-trusted-ca-bundle\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.672828 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.672803 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-oauth-config\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.673076 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.673054 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-serving-cert\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.677918 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.677899 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cfvs\" (UniqueName: \"kubernetes.io/projected/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-kube-api-access-8cfvs\") pod \"console-dd8bc6dc-gj8pb\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.835022 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.834933 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:18.955894 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:18.955872 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd8bc6dc-gj8pb"] Jun 09 09:38:18.958477 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:38:18.958450 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfe8713_26fc_4d7f_8780_b8e6159d1b27.slice/crio-37941b840daabf3b6b496f16cb169fdc490485752ca040b9163ecead621d31ee WatchSource:0}: Error finding container 37941b840daabf3b6b496f16cb169fdc490485752ca040b9163ecead621d31ee: Status 404 returned error can't find the container with id 37941b840daabf3b6b496f16cb169fdc490485752ca040b9163ecead621d31ee Jun 09 09:38:19.620054 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:19.620015 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd8bc6dc-gj8pb" event={"ID":"9bfe8713-26fc-4d7f-8780-b8e6159d1b27","Type":"ContainerStarted","Data":"46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3"} Jun 09 09:38:19.620413 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:19.620073 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd8bc6dc-gj8pb" event={"ID":"9bfe8713-26fc-4d7f-8780-b8e6159d1b27","Type":"ContainerStarted","Data":"37941b840daabf3b6b496f16cb169fdc490485752ca040b9163ecead621d31ee"} Jun 09 09:38:19.638243 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:19.638203 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dd8bc6dc-gj8pb" podStartSLOduration=1.6381890239999999 podStartE2EDuration="1.638189024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:38:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:38:19.637217481 +0000 UTC m=+306.513028420" watchObservedRunningTime="2026-06-09 09:38:19.638189024 +0000 UTC m=+306.513999963" Jun 09 09:38:28.835861 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:28.835812 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:28.836273 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:28.835879 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:28.840370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:28.840349 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:29.658431 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:29.658400 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:38:29.706650 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:29.706613 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7955945454-b6lq2"] Jun 09 09:38:54.725588 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:54.725548 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7955945454-b6lq2" podUID="75749c4c-a753-4aac-a8f5-91b34a91c6f5" containerName="console" containerID="cri-o://8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2" gracePeriod=15 Jun 09 09:38:54.955590 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:54.955567 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:38:55.011743 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.011666 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9mxh\" (UniqueName: \"kubernetes.io/projected/75749c4c-a753-4aac-a8f5-91b34a91c6f5-kube-api-access-k9mxh\") pod \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " Jun 09 09:38:55.011743 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.011708 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-trusted-ca-bundle\") pod \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " Jun 09 09:38:55.011960 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.011767 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-serving-cert\") pod \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " Jun 09 09:38:55.011960 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.011784 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-service-ca\") pod \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " Jun 09 09:38:55.011960 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.011803 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-config\") pod \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " Jun 09 09:38:55.011960 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.011829 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-oauth-config\") pod \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " Jun 09 09:38:55.011960 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.011858 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-oauth-serving-cert\") pod \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\" (UID: \"75749c4c-a753-4aac-a8f5-91b34a91c6f5\") " Jun 09 09:38:55.012344 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.012317 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "75749c4c-a753-4aac-a8f5-91b34a91c6f5" (UID: "75749c4c-a753-4aac-a8f5-91b34a91c6f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:55.012344 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.012332 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "75749c4c-a753-4aac-a8f5-91b34a91c6f5" (UID: "75749c4c-a753-4aac-a8f5-91b34a91c6f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:55.012481 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.012342 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-config" (OuterVolumeSpecName: "console-config") pod "75749c4c-a753-4aac-a8f5-91b34a91c6f5" (UID: "75749c4c-a753-4aac-a8f5-91b34a91c6f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:55.012481 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.012358 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "75749c4c-a753-4aac-a8f5-91b34a91c6f5" (UID: "75749c4c-a753-4aac-a8f5-91b34a91c6f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:55.013898 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.013874 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "75749c4c-a753-4aac-a8f5-91b34a91c6f5" (UID: "75749c4c-a753-4aac-a8f5-91b34a91c6f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:55.013898 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.013886 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75749c4c-a753-4aac-a8f5-91b34a91c6f5-kube-api-access-k9mxh" (OuterVolumeSpecName: "kube-api-access-k9mxh") pod "75749c4c-a753-4aac-a8f5-91b34a91c6f5" (UID: "75749c4c-a753-4aac-a8f5-91b34a91c6f5"). InnerVolumeSpecName "kube-api-access-k9mxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:38:55.014023 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.013997 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "75749c4c-a753-4aac-a8f5-91b34a91c6f5" (UID: "75749c4c-a753-4aac-a8f5-91b34a91c6f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:55.113064 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.113020 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:55.113064 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.113058 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-service-ca\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:55.113064 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.113067 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:55.113064 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.113075 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75749c4c-a753-4aac-a8f5-91b34a91c6f5-console-oauth-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:55.113064 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.113083 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-oauth-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:55.113349 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.113093 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9mxh\" (UniqueName: \"kubernetes.io/projected/75749c4c-a753-4aac-a8f5-91b34a91c6f5-kube-api-access-k9mxh\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:55.113349 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.113101 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75749c4c-a753-4aac-a8f5-91b34a91c6f5-trusted-ca-bundle\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:38:55.738274 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.738238 2571 generic.go:356] "Generic (PLEG): container finished" podID="75749c4c-a753-4aac-a8f5-91b34a91c6f5" containerID="8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2" exitCode=0 Jun 09 09:38:55.738654 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.738282 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7955945454-b6lq2" Jun 09 09:38:55.738654 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.738332 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7955945454-b6lq2" event={"ID":"75749c4c-a753-4aac-a8f5-91b34a91c6f5","Type":"ContainerDied","Data":"8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2"} Jun 09 09:38:55.738654 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.738374 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7955945454-b6lq2" event={"ID":"75749c4c-a753-4aac-a8f5-91b34a91c6f5","Type":"ContainerDied","Data":"a33f783cada51baf5c7ee2a36a6afc43b11a87cb6542a67707b5263d7a00765b"} Jun 09 09:38:55.738654 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.738392 2571 scope.go:117] "RemoveContainer" containerID="8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2" Jun 09 09:38:55.746194 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.746179 2571 scope.go:117] "RemoveContainer" containerID="8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2" Jun 09 09:38:55.746412 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:38:55.746394 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2\": container with ID starting with 8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2 not found: ID does not exist" containerID="8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2" Jun 09 09:38:55.746461 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.746419 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2"} err="failed to get container status \"8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2\": rpc error: code = NotFound desc = could not find container \"8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2\": container with ID starting with 8be618f0a1cb8facf8e39c51dbbff5c7e402c767a9cc1dd00fd4866fa00dfbb2 not found: ID does not exist" Jun 09 09:38:55.754366 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.754342 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7955945454-b6lq2"] Jun 09 09:38:55.757811 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:55.757792 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7955945454-b6lq2"] Jun 09 09:38:57.631697 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:38:57.631654 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75749c4c-a753-4aac-a8f5-91b34a91c6f5" path="/var/lib/kubelet/pods/75749c4c-a753-4aac-a8f5-91b34a91c6f5/volumes" Jun 09 09:39:39.505268 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.505234 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54df495765-8npzp"] Jun 09 09:39:39.505720 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.505595 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75749c4c-a753-4aac-a8f5-91b34a91c6f5" containerName="console" Jun 09 09:39:39.505720 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.505609 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="75749c4c-a753-4aac-a8f5-91b34a91c6f5" containerName="console" Jun 09 09:39:39.505720 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.505665 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="75749c4c-a753-4aac-a8f5-91b34a91c6f5" containerName="console" Jun 09 09:39:39.508361 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.508345 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.517453 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.517431 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54df495765-8npzp"] Jun 09 09:39:39.619916 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.619886 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-oauth-serving-cert\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.619916 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.619925 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-oauth-config\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.620129 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.620012 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-service-ca\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.620129 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.620070 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-serving-cert\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.620129 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.620098 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-console-config\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.620129 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.620113 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-trusted-ca-bundle\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.620274 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.620132 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkdcm\" (UniqueName: \"kubernetes.io/projected/9cb1da2e-f6b5-4407-8cdb-104419159258-kube-api-access-qkdcm\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.721049 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.721016 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-serving-cert\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.721049 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.721050 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-console-config\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.721282 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.721069 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-trusted-ca-bundle\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.721282 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.721096 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkdcm\" (UniqueName: \"kubernetes.io/projected/9cb1da2e-f6b5-4407-8cdb-104419159258-kube-api-access-qkdcm\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.721282 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.721140 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-oauth-serving-cert\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.721282 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.721170 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-oauth-config\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.721282 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.721247 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-service-ca\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.721906 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.721878 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-console-config\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.722023 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.721958 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-oauth-serving-cert\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.722023 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.721960 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-service-ca\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.722105 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.722020 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-trusted-ca-bundle\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.723704 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.723681 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-oauth-config\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.723764 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.723689 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-serving-cert\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.730084 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.730063 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkdcm\" (UniqueName: \"kubernetes.io/projected/9cb1da2e-f6b5-4407-8cdb-104419159258-kube-api-access-qkdcm\") pod \"console-54df495765-8npzp\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.817197 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.817119 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:39.939970 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:39.939818 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54df495765-8npzp"] Jun 09 09:39:39.942355 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:39:39.942326 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb1da2e_f6b5_4407_8cdb_104419159258.slice/crio-de13fd59db4406191383e9aa6b1d3bb6d9b08ad5725555388af162064bcc44d4 WatchSource:0}: Error finding container de13fd59db4406191383e9aa6b1d3bb6d9b08ad5725555388af162064bcc44d4: Status 404 returned error can't find the container with id de13fd59db4406191383e9aa6b1d3bb6d9b08ad5725555388af162064bcc44d4 Jun 09 09:39:40.882971 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:40.882939 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54df495765-8npzp" event={"ID":"9cb1da2e-f6b5-4407-8cdb-104419159258","Type":"ContainerStarted","Data":"1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7"} Jun 09 09:39:40.883326 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:40.882984 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54df495765-8npzp" event={"ID":"9cb1da2e-f6b5-4407-8cdb-104419159258","Type":"ContainerStarted","Data":"de13fd59db4406191383e9aa6b1d3bb6d9b08ad5725555388af162064bcc44d4"} Jun 09 09:39:40.901349 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:40.901302 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54df495765-8npzp" podStartSLOduration=1.9012879740000002 podStartE2EDuration="1.901287974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:39:40.900247036 +0000 UTC m=+387.776057977" watchObservedRunningTime="2026-06-09 09:39:40.901287974 +0000 UTC m=+387.777098914" Jun 09 09:39:49.817600 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:49.817565 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:49.818013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:49.817626 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:49.822060 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:49.822040 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:49.915720 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:49.915697 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54df495765-8npzp" Jun 09 09:39:49.961076 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:39:49.961052 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd8bc6dc-gj8pb"] Jun 09 09:40:14.985600 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:14.985551 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-dd8bc6dc-gj8pb" podUID="9bfe8713-26fc-4d7f-8780-b8e6159d1b27" containerName="console" containerID="cri-o://46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3" gracePeriod=15 Jun 09 09:40:15.225400 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.225377 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:40:15.266744 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.266684 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-trusted-ca-bundle\") pod \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " Jun 09 09:40:15.266744 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.266723 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-oauth-serving-cert\") pod \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " Jun 09 09:40:15.266949 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.266777 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cfvs\" (UniqueName: \"kubernetes.io/projected/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-kube-api-access-8cfvs\") pod \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " Jun 09 09:40:15.266949 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.266797 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-oauth-config\") pod \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " Jun 09 09:40:15.266949 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.266818 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-service-ca\") pod \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " Jun 09 09:40:15.266949 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.266836 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-config\") pod \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " Jun 09 09:40:15.267142 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.267015 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-serving-cert\") pod \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\" (UID: \"9bfe8713-26fc-4d7f-8780-b8e6159d1b27\") " Jun 09 09:40:15.267254 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.267157 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9bfe8713-26fc-4d7f-8780-b8e6159d1b27" (UID: "9bfe8713-26fc-4d7f-8780-b8e6159d1b27"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:40:15.267254 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.267206 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9bfe8713-26fc-4d7f-8780-b8e6159d1b27" (UID: "9bfe8713-26fc-4d7f-8780-b8e6159d1b27"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:40:15.267254 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.267219 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-trusted-ca-bundle\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:40:15.267254 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.267231 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-service-ca" (OuterVolumeSpecName: "service-ca") pod "9bfe8713-26fc-4d7f-8780-b8e6159d1b27" (UID: "9bfe8713-26fc-4d7f-8780-b8e6159d1b27"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:40:15.267254 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.267227 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-config" (OuterVolumeSpecName: "console-config") pod "9bfe8713-26fc-4d7f-8780-b8e6159d1b27" (UID: "9bfe8713-26fc-4d7f-8780-b8e6159d1b27"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:40:15.268934 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.268910 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9bfe8713-26fc-4d7f-8780-b8e6159d1b27" (UID: "9bfe8713-26fc-4d7f-8780-b8e6159d1b27"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:40:15.268934 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.268918 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-kube-api-access-8cfvs" (OuterVolumeSpecName: "kube-api-access-8cfvs") pod "9bfe8713-26fc-4d7f-8780-b8e6159d1b27" (UID: "9bfe8713-26fc-4d7f-8780-b8e6159d1b27"). InnerVolumeSpecName "kube-api-access-8cfvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:40:15.269096 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.268998 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9bfe8713-26fc-4d7f-8780-b8e6159d1b27" (UID: "9bfe8713-26fc-4d7f-8780-b8e6159d1b27"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:40:15.368180 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.368145 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-oauth-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:40:15.368180 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.368171 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cfvs\" (UniqueName: \"kubernetes.io/projected/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-kube-api-access-8cfvs\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:40:15.368180 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.368181 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-oauth-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:40:15.368180 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.368189 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-service-ca\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:40:15.368410 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.368199 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:40:15.368410 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.368208 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfe8713-26fc-4d7f-8780-b8e6159d1b27-console-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:40:15.998883 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.998848 2571 generic.go:356] "Generic (PLEG): container finished" podID="9bfe8713-26fc-4d7f-8780-b8e6159d1b27" containerID="46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3" exitCode=0 Jun 09 09:40:15.999292 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.998889 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd8bc6dc-gj8pb" Jun 09 09:40:15.999292 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.998933 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd8bc6dc-gj8pb" event={"ID":"9bfe8713-26fc-4d7f-8780-b8e6159d1b27","Type":"ContainerDied","Data":"46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3"} Jun 09 09:40:15.999292 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.998975 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd8bc6dc-gj8pb" event={"ID":"9bfe8713-26fc-4d7f-8780-b8e6159d1b27","Type":"ContainerDied","Data":"37941b840daabf3b6b496f16cb169fdc490485752ca040b9163ecead621d31ee"} Jun 09 09:40:15.999292 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:15.998994 2571 scope.go:117] "RemoveContainer" containerID="46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3" Jun 09 09:40:16.006923 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:16.006902 2571 scope.go:117] "RemoveContainer" containerID="46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3" Jun 09 09:40:16.007176 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:40:16.007160 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3\": container with ID starting with 46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3 not found: ID does not exist" containerID="46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3" Jun 09 09:40:16.007222 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:16.007184 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3"} err="failed to get container status \"46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3\": rpc error: code = NotFound desc = could not find container \"46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3\": container with ID starting with 46e5e68f161d60d427a1d3dc8abd7140dffb4c8696c8b653684807e29c6063a3 not found: ID does not exist" Jun 09 09:40:16.017885 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:16.017862 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd8bc6dc-gj8pb"] Jun 09 09:40:16.021194 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:16.021170 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dd8bc6dc-gj8pb"] Jun 09 09:40:17.634287 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:40:17.631917 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bfe8713-26fc-4d7f-8780-b8e6159d1b27" path="/var/lib/kubelet/pods/9bfe8713-26fc-4d7f-8780-b8e6159d1b27/volumes" Jun 09 09:43:13.599718 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:13.599690 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:43:13.600211 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:13.599690 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:43:27.369090 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.369055 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57c9b7d7d4-wh6fg"] Jun 09 09:43:27.371456 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.369340 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfe8713-26fc-4d7f-8780-b8e6159d1b27" containerName="console" Jun 09 09:43:27.371456 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.369358 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfe8713-26fc-4d7f-8780-b8e6159d1b27" containerName="console" Jun 09 09:43:27.371456 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.369438 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bfe8713-26fc-4d7f-8780-b8e6159d1b27" containerName="console" Jun 09 09:43:27.372306 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.372292 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.392123 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.392095 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c9b7d7d4-wh6fg"] Jun 09 09:43:27.475732 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.475701 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flzp7\" (UniqueName: \"kubernetes.io/projected/84b51541-60b8-4f92-b4c5-47fafe20714a-kube-api-access-flzp7\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.475905 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.475769 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84b51541-60b8-4f92-b4c5-47fafe20714a-console-serving-cert\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.475905 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.475837 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-console-config\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.475905 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.475868 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-service-ca\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.475905 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.475895 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84b51541-60b8-4f92-b4c5-47fafe20714a-console-oauth-config\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.475905 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.475909 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-trusted-ca-bundle\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.476075 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.475930 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-oauth-serving-cert\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.576492 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.576459 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84b51541-60b8-4f92-b4c5-47fafe20714a-console-serving-cert\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.576620 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.576498 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-console-config\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.576620 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.576515 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-service-ca\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.576620 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.576544 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84b51541-60b8-4f92-b4c5-47fafe20714a-console-oauth-config\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.576620 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.576566 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-trusted-ca-bundle\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.576620 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.576595 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-oauth-serving-cert\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.576867 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.576637 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flzp7\" (UniqueName: \"kubernetes.io/projected/84b51541-60b8-4f92-b4c5-47fafe20714a-kube-api-access-flzp7\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.577370 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.577343 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-service-ca\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.577478 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.577343 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-oauth-serving-cert\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.577478 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.577417 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-console-config\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.577599 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.577578 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84b51541-60b8-4f92-b4c5-47fafe20714a-trusted-ca-bundle\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.579050 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.579030 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84b51541-60b8-4f92-b4c5-47fafe20714a-console-serving-cert\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.579156 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.579100 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84b51541-60b8-4f92-b4c5-47fafe20714a-console-oauth-config\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.584486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.584466 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flzp7\" (UniqueName: \"kubernetes.io/projected/84b51541-60b8-4f92-b4c5-47fafe20714a-kube-api-access-flzp7\") pod \"console-57c9b7d7d4-wh6fg\" (UID: \"84b51541-60b8-4f92-b4c5-47fafe20714a\") " pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.681393 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.681296 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:27.803656 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:27.803624 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c9b7d7d4-wh6fg"] Jun 09 09:43:27.806648 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:43:27.806624 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b51541_60b8_4f92_b4c5_47fafe20714a.slice/crio-10ccfb2a4c409b800d14fd06cd87f6bb5ad04c4d948f9c6f8ee5aa0bf68b05ce WatchSource:0}: Error finding container 10ccfb2a4c409b800d14fd06cd87f6bb5ad04c4d948f9c6f8ee5aa0bf68b05ce: Status 404 returned error can't find the container with id 10ccfb2a4c409b800d14fd06cd87f6bb5ad04c4d948f9c6f8ee5aa0bf68b05ce Jun 09 09:43:28.619410 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:28.619377 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c9b7d7d4-wh6fg" event={"ID":"84b51541-60b8-4f92-b4c5-47fafe20714a","Type":"ContainerStarted","Data":"a4ffed6c1c53fcf756b6404ad5846f53c1e29bc6da0127afbe8bce6997408643"} Jun 09 09:43:28.619787 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:28.619426 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c9b7d7d4-wh6fg" event={"ID":"84b51541-60b8-4f92-b4c5-47fafe20714a","Type":"ContainerStarted","Data":"10ccfb2a4c409b800d14fd06cd87f6bb5ad04c4d948f9c6f8ee5aa0bf68b05ce"} Jun 09 09:43:28.637109 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:28.637058 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57c9b7d7d4-wh6fg" podStartSLOduration=1.637044331 podStartE2EDuration="1.637044331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:43:28.636534886 +0000 UTC m=+615.512345840" watchObservedRunningTime="2026-06-09 09:43:28.637044331 +0000 UTC m=+615.512855271" Jun 09 09:43:37.681513 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:37.681471 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:37.682034 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:37.681547 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:37.686267 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:37.686248 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:38.654590 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:38.654565 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57c9b7d7d4-wh6fg" Jun 09 09:43:38.701701 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:43:38.701668 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54df495765-8npzp"] Jun 09 09:44:03.720905 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:03.720846 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54df495765-8npzp" podUID="9cb1da2e-f6b5-4407-8cdb-104419159258" containerName="console" containerID="cri-o://1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7" gracePeriod=15 Jun 09 09:44:03.955947 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:03.955918 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54df495765-8npzp" Jun 09 09:44:04.022028 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.021962 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-service-ca\") pod \"9cb1da2e-f6b5-4407-8cdb-104419159258\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " Jun 09 09:44:04.022028 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.021999 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-oauth-config\") pod \"9cb1da2e-f6b5-4407-8cdb-104419159258\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " Jun 09 09:44:04.022189 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.022042 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-console-config\") pod \"9cb1da2e-f6b5-4407-8cdb-104419159258\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " Jun 09 09:44:04.022189 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.022070 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkdcm\" (UniqueName: \"kubernetes.io/projected/9cb1da2e-f6b5-4407-8cdb-104419159258-kube-api-access-qkdcm\") pod \"9cb1da2e-f6b5-4407-8cdb-104419159258\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " Jun 09 09:44:04.022189 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.022116 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-oauth-serving-cert\") pod \"9cb1da2e-f6b5-4407-8cdb-104419159258\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " Jun 09 09:44:04.022189 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.022147 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-trusted-ca-bundle\") pod \"9cb1da2e-f6b5-4407-8cdb-104419159258\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " Jun 09 09:44:04.022189 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.022172 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-serving-cert\") pod \"9cb1da2e-f6b5-4407-8cdb-104419159258\" (UID: \"9cb1da2e-f6b5-4407-8cdb-104419159258\") " Jun 09 09:44:04.022520 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.022485 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-service-ca" (OuterVolumeSpecName: "service-ca") pod "9cb1da2e-f6b5-4407-8cdb-104419159258" (UID: "9cb1da2e-f6b5-4407-8cdb-104419159258"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:44:04.022636 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.022550 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9cb1da2e-f6b5-4407-8cdb-104419159258" (UID: "9cb1da2e-f6b5-4407-8cdb-104419159258"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:44:04.022636 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.022572 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-console-config" (OuterVolumeSpecName: "console-config") pod "9cb1da2e-f6b5-4407-8cdb-104419159258" (UID: "9cb1da2e-f6b5-4407-8cdb-104419159258"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:44:04.022716 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.022647 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9cb1da2e-f6b5-4407-8cdb-104419159258" (UID: "9cb1da2e-f6b5-4407-8cdb-104419159258"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:44:04.024191 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.024169 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9cb1da2e-f6b5-4407-8cdb-104419159258" (UID: "9cb1da2e-f6b5-4407-8cdb-104419159258"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:44:04.024270 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.024201 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb1da2e-f6b5-4407-8cdb-104419159258-kube-api-access-qkdcm" (OuterVolumeSpecName: "kube-api-access-qkdcm") pod "9cb1da2e-f6b5-4407-8cdb-104419159258" (UID: "9cb1da2e-f6b5-4407-8cdb-104419159258"). InnerVolumeSpecName "kube-api-access-qkdcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:44:04.024308 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.024283 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9cb1da2e-f6b5-4407-8cdb-104419159258" (UID: "9cb1da2e-f6b5-4407-8cdb-104419159258"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:44:04.122625 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.122580 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-oauth-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:44:04.122625 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.122620 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-trusted-ca-bundle\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:44:04.122625 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.122629 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:44:04.122625 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.122639 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-service-ca\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:44:04.122625 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.122648 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cb1da2e-f6b5-4407-8cdb-104419159258-console-oauth-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:44:04.122939 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.122656 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cb1da2e-f6b5-4407-8cdb-104419159258-console-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:44:04.122939 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.122664 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkdcm\" (UniqueName: \"kubernetes.io/projected/9cb1da2e-f6b5-4407-8cdb-104419159258-kube-api-access-qkdcm\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:44:04.730947 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.730911 2571 generic.go:356] "Generic (PLEG): container finished" podID="9cb1da2e-f6b5-4407-8cdb-104419159258" containerID="1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7" exitCode=0 Jun 09 09:44:04.731313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.730954 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54df495765-8npzp" Jun 09 09:44:04.731313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.730990 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54df495765-8npzp" event={"ID":"9cb1da2e-f6b5-4407-8cdb-104419159258","Type":"ContainerDied","Data":"1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7"} Jun 09 09:44:04.731313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.731035 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54df495765-8npzp" event={"ID":"9cb1da2e-f6b5-4407-8cdb-104419159258","Type":"ContainerDied","Data":"de13fd59db4406191383e9aa6b1d3bb6d9b08ad5725555388af162064bcc44d4"} Jun 09 09:44:04.731313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.731056 2571 scope.go:117] "RemoveContainer" containerID="1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7" Jun 09 09:44:04.739081 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.739068 2571 scope.go:117] "RemoveContainer" containerID="1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7" Jun 09 09:44:04.739321 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:44:04.739303 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7\": container with ID starting with 1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7 not found: ID does not exist" containerID="1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7" Jun 09 09:44:04.739359 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.739330 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7"} err="failed to get container status \"1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7\": rpc error: code = NotFound desc = could not find container \"1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7\": container with ID starting with 1186df5c54a3ae4e413a9ad68f6e7273193b9b844eb2ad036c28fe072d3e77f7 not found: ID does not exist" Jun 09 09:44:04.750398 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.750374 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54df495765-8npzp"] Jun 09 09:44:04.753817 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:04.753798 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54df495765-8npzp"] Jun 09 09:44:05.631166 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:44:05.631135 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cb1da2e-f6b5-4407-8cdb-104419159258" path="/var/lib/kubelet/pods/9cb1da2e-f6b5-4407-8cdb-104419159258/volumes" Jun 09 09:48:13.617237 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:13.617155 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:48:13.618325 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:13.618300 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:48:28.560942 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.560911 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8"] Jun 09 09:48:28.563163 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.561144 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb1da2e-f6b5-4407-8cdb-104419159258" containerName="console" Jun 09 09:48:28.563163 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.561155 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb1da2e-f6b5-4407-8cdb-104419159258" containerName="console" Jun 09 09:48:28.563163 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.561207 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb1da2e-f6b5-4407-8cdb-104419159258" containerName="console" Jun 09 09:48:28.564136 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.564121 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.566722 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.566702 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jun 09 09:48:28.566861 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.566702 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jun 09 09:48:28.566861 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.566718 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jun 09 09:48:28.566979 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.566731 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jun 09 09:48:28.566979 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.566790 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Jun 09 09:48:28.566979 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.566796 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jun 09 09:48:28.567947 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.567930 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jun 09 09:48:28.568044 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.567933 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8ccqr\"" Jun 09 09:48:28.576219 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.576198 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8"] Jun 09 09:48:28.627584 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.627557 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7l8w\" (UniqueName: \"kubernetes.io/projected/f9b14883-da30-43ff-988b-0cc833b19733-kube-api-access-n7l8w\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.627692 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.627596 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9b14883-da30-43ff-988b-0cc833b19733-feast-data\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.627692 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.627617 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-registry-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.627692 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.627671 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.627828 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.627690 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-online-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.627828 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.627764 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-offline-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.728663 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.728625 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-offline-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.728859 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.728671 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7l8w\" (UniqueName: \"kubernetes.io/projected/f9b14883-da30-43ff-988b-0cc833b19733-kube-api-access-n7l8w\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.728859 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.728717 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9b14883-da30-43ff-988b-0cc833b19733-feast-data\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.728859 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.728767 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-registry-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.728859 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.728809 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.728859 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.728833 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-online-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.729161 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:48:28.728935 2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jun 09 09:48:28.729161 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:48:28.728945 2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jun 09 09:48:28.729161 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:48:28.729006 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-registry-tls podName:f9b14883-da30-43ff-988b-0cc833b19733 nodeName:}" failed. No retries permitted until 2026-06-09 09:48:29.228985587 +0000 UTC m=+916.104796523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-registry-tls") pod "feast-simple-feast-setup-7d84d5c4dd-xh5m8" (UID: "f9b14883-da30-43ff-988b-0cc833b19733") : secret "feast-simple-feast-setup-registry-tls" not found Jun 09 09:48:28.729161 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:48:28.729079 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls podName:f9b14883-da30-43ff-988b-0cc833b19733 nodeName:}" failed. No retries permitted until 2026-06-09 09:48:29.229053294 +0000 UTC m=+916.104864224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls") pod "feast-simple-feast-setup-7d84d5c4dd-xh5m8" (UID: "f9b14883-da30-43ff-988b-0cc833b19733") : secret "feast-simple-feast-setup-ui-tls" not found Jun 09 09:48:28.729161 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.729149 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9b14883-da30-43ff-988b-0cc833b19733-feast-data\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.731140 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.731116 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-offline-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.731242 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.731197 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-online-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:28.739120 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:28.739092 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7l8w\" (UniqueName: \"kubernetes.io/projected/f9b14883-da30-43ff-988b-0cc833b19733-kube-api-access-n7l8w\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:29.233033 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:29.232999 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-registry-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:29.233213 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:29.233044 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:29.233213 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:48:29.233139 2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jun 09 09:48:29.233213 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:48:29.233197 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls podName:f9b14883-da30-43ff-988b-0cc833b19733 nodeName:}" failed. No retries permitted until 2026-06-09 09:48:30.233184021 +0000 UTC m=+917.108994939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls") pod "feast-simple-feast-setup-7d84d5c4dd-xh5m8" (UID: "f9b14883-da30-43ff-988b-0cc833b19733") : secret "feast-simple-feast-setup-ui-tls" not found Jun 09 09:48:29.235433 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:29.235409 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-registry-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:30.240057 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:30.240024 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:30.242423 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:30.242401 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-xh5m8\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:30.373560 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:30.373515 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:48:30.501161 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:30.501136 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8"] Jun 09 09:48:30.502285 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:48:30.502257 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9b14883_da30_43ff_988b_0cc833b19733.slice/crio-e28d736bd789dcfb11a4b7793d948dce8de0e06056d21d1bbbd9a70e9c8b5332 WatchSource:0}: Error finding container e28d736bd789dcfb11a4b7793d948dce8de0e06056d21d1bbbd9a70e9c8b5332: Status 404 returned error can't find the container with id e28d736bd789dcfb11a4b7793d948dce8de0e06056d21d1bbbd9a70e9c8b5332 Jun 09 09:48:30.504215 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:30.504197 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 09:48:30.565470 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:48:30.565439 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerStarted","Data":"e28d736bd789dcfb11a4b7793d948dce8de0e06056d21d1bbbd9a70e9c8b5332"} Jun 09 09:49:01.673678 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:01.673643 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerStarted","Data":"3aa753282fc25273036632878195ddfaff9084d87dcda4cf98e5006bb44e6658"} Jun 09 09:49:05.688322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:05.688236 2571 generic.go:356] "Generic (PLEG): container finished" podID="f9b14883-da30-43ff-988b-0cc833b19733" containerID="3aa753282fc25273036632878195ddfaff9084d87dcda4cf98e5006bb44e6658" exitCode=0 Jun 09 09:49:05.688322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:05.688295 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerDied","Data":"3aa753282fc25273036632878195ddfaff9084d87dcda4cf98e5006bb44e6658"} Jun 09 09:49:06.696465 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:06.696424 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerStarted","Data":"1f8d7488a82abb7b0db8044377e77416759f64981096d9a6532023521d4f1728"} Jun 09 09:49:06.696961 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:06.696488 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerStarted","Data":"a043dcaff0b0237de0ce011048f6691a806d523cfde234dfda31b068a8dd38fb"} Jun 09 09:49:06.696961 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:06.696508 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerStarted","Data":"e7850d1dbcf3ff046e8709778e728ba4aa66779a7faf22cd24b70205fb6b8747"} Jun 09 09:49:06.696961 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:06.696527 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerStarted","Data":"8ef7237bbef748fb1b7f96b979e18eb4e0dd01502be2841e7f000a7739e95b23"} Jun 09 09:49:06.721450 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:06.721309 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podStartSLOduration=3.977240826 podStartE2EDuration="38.721287548s" totalImagesPullingTime="30.32840777s" totalInitContainerRuntime="4.415638952s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:49:06.720206748 +0000 UTC m=+953.596017691" watchObservedRunningTime="2026-06-09 09:49:06.721287548 +0000 UTC m=+953.597098488" Jun 09 09:49:09.373945 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:09.373902 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:09.374519 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:09.374485 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:09.374519 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:09.374523 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:09.374695 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:09.374541 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:09.376328 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:09.376294 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jun 09 09:49:09.376529 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:09.376302 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jun 09 09:49:09.376697 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:09.376306 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.16:8816: connect: connection refused" Jun 09 09:49:09.376835 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:09.376340 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.16:6571: connect: connection refused" Jun 09 09:49:10.374018 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:10.373971 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:10.374495 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:10.374052 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:10.374495 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:10.374096 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:10.374495 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:10.374116 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:12.374923 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:12.374889 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:12.375363 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:12.374994 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:12.375363 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:12.375240 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:12.379341 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:12.379320 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:12.721637 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:12.721611 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:12.721835 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:12.721671 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:12.721835 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:12.721706 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:49:12.724075 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:49:12.724052 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:50:13.869440 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:13.869395 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8"] Jun 09 09:50:13.870061 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:13.869638 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="registry" containerID="cri-o://8ef7237bbef748fb1b7f96b979e18eb4e0dd01502be2841e7f000a7739e95b23" gracePeriod=30 Jun 09 09:50:13.870061 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:13.869682 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="ui" containerID="cri-o://1f8d7488a82abb7b0db8044377e77416759f64981096d9a6532023521d4f1728" gracePeriod=30 Jun 09 09:50:13.870061 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:13.869707 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="online" containerID="cri-o://e7850d1dbcf3ff046e8709778e728ba4aa66779a7faf22cd24b70205fb6b8747" gracePeriod=30 Jun 09 09:50:13.870061 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:13.869853 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="offline" containerID="cri-o://a043dcaff0b0237de0ce011048f6691a806d523cfde234dfda31b068a8dd38fb" gracePeriod=30 Jun 09 09:50:14.118285 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.118249 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74"] Jun 09 09:50:14.120690 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.120645 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.123172 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.123151 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-vbct4\"" Jun 09 09:50:14.133851 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.133831 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74"] Jun 09 09:50:14.197014 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.196967 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae26019-b82e-4074-945d-334500079b9e-feast-data\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.197240 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.197081 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnqr\" (UniqueName: \"kubernetes.io/projected/4ae26019-b82e-4074-945d-334500079b9e-kube-api-access-9cnqr\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.197240 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.197114 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-registry-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.197240 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.197143 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-online-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.197240 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.197166 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-ui-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.197240 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.197233 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-offline-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.297837 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.297796 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-ui-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.298045 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.297869 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-offline-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.298045 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.297918 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae26019-b82e-4074-945d-334500079b9e-feast-data\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.298045 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:50:14.297960 2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jun 09 09:50:14.298045 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.297967 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnqr\" (UniqueName: \"kubernetes.io/projected/4ae26019-b82e-4074-945d-334500079b9e-kube-api-access-9cnqr\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.298045 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:50:14.298039 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-ui-tls podName:4ae26019-b82e-4074-945d-334500079b9e nodeName:}" failed. No retries permitted until 2026-06-09 09:50:14.79801744 +0000 UTC m=+1021.673828358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-ui-tls") pod "feast-simple-feast-setup-7d84d5c4dd-clf74" (UID: "4ae26019-b82e-4074-945d-334500079b9e") : secret "feast-simple-feast-setup-ui-tls" not found Jun 09 09:50:14.298313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.298099 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-registry-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.298313 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.298137 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-online-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.298313 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:50:14.298237 2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jun 09 09:50:14.298313 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:50:14.298296 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-online-tls podName:4ae26019-b82e-4074-945d-334500079b9e nodeName:}" failed. No retries permitted until 2026-06-09 09:50:14.79827871 +0000 UTC m=+1021.674089641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-online-tls") pod "feast-simple-feast-setup-7d84d5c4dd-clf74" (UID: "4ae26019-b82e-4074-945d-334500079b9e") : secret "feast-simple-feast-setup-online-tls" not found Jun 09 09:50:14.298479 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.298444 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae26019-b82e-4074-945d-334500079b9e-feast-data\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.300665 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.300630 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-registry-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.300815 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.300677 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-offline-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.308704 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.308673 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnqr\" (UniqueName: \"kubernetes.io/projected/4ae26019-b82e-4074-945d-334500079b9e-kube-api-access-9cnqr\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.802427 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.802395 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-online-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.802427 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.802432 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-ui-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.804554 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.804528 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-online-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.804554 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.804553 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-ui-tls\") pod \"feast-simple-feast-setup-7d84d5c4dd-clf74\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:14.934098 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.934066 2571 generic.go:356] "Generic (PLEG): container finished" podID="f9b14883-da30-43ff-988b-0cc833b19733" containerID="1f8d7488a82abb7b0db8044377e77416759f64981096d9a6532023521d4f1728" exitCode=0 Jun 09 09:50:14.934098 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.934090 2571 generic.go:356] "Generic (PLEG): container finished" podID="f9b14883-da30-43ff-988b-0cc833b19733" containerID="e7850d1dbcf3ff046e8709778e728ba4aa66779a7faf22cd24b70205fb6b8747" exitCode=0 Jun 09 09:50:14.934469 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.934141 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerDied","Data":"1f8d7488a82abb7b0db8044377e77416759f64981096d9a6532023521d4f1728"} Jun 09 09:50:14.934469 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:14.934179 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerDied","Data":"e7850d1dbcf3ff046e8709778e728ba4aa66779a7faf22cd24b70205fb6b8747"} Jun 09 09:50:15.030194 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:15.030158 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:15.159685 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:15.159654 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74"] Jun 09 09:50:15.163032 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:50:15.163007 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ae26019_b82e_4074_945d_334500079b9e.slice/crio-9c06df3bf42e6bebce5a6366f44ea0f56d83354fd112fb285360943da82a0e6a WatchSource:0}: Error finding container 9c06df3bf42e6bebce5a6366f44ea0f56d83354fd112fb285360943da82a0e6a: Status 404 returned error can't find the container with id 9c06df3bf42e6bebce5a6366f44ea0f56d83354fd112fb285360943da82a0e6a Jun 09 09:50:15.938975 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:15.938941 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerStarted","Data":"3d0225744eaaa3c434a69fbdb2505fabd70a8cb96dbb33e80afcfcf2432e8aa4"} Jun 09 09:50:15.939336 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:15.938991 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerStarted","Data":"9c06df3bf42e6bebce5a6366f44ea0f56d83354fd112fb285360943da82a0e6a"} Jun 09 09:50:19.955537 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:19.955503 2571 generic.go:356] "Generic (PLEG): container finished" podID="4ae26019-b82e-4074-945d-334500079b9e" containerID="3d0225744eaaa3c434a69fbdb2505fabd70a8cb96dbb33e80afcfcf2432e8aa4" exitCode=0 Jun 09 09:50:19.955919 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:19.955579 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerDied","Data":"3d0225744eaaa3c434a69fbdb2505fabd70a8cb96dbb33e80afcfcf2432e8aa4"} Jun 09 09:50:20.964425 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:20.964383 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerStarted","Data":"6a26edd68e53433dacdb3d616fcd8bbd75fb21f735ac8d29748ebf5e0ccae8f6"} Jun 09 09:50:20.964939 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:20.964450 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerStarted","Data":"de1f12a7451dcdeeaeb97114a93ff31018641496d12860b336fee7ed407a2f31"} Jun 09 09:50:20.964939 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:20.964472 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerStarted","Data":"fd565f9681e7194f1091d7c2e27d4a86e8f6e7aa137968a22319c5005f5ec997"} Jun 09 09:50:20.964939 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:20.964492 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerStarted","Data":"4aafec8f6caec6449affe5c68da3f78d9dea6b6d8cc7a8f2a6ff30b271f109d4"} Jun 09 09:50:20.989915 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:20.989856 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podStartSLOduration=2.5588351339999997 podStartE2EDuration="6.989835239s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.431000105s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:20.988515243 +0000 UTC m=+1027.864326196" watchObservedRunningTime="2026-06-09 09:50:20.989835239 +0000 UTC m=+1027.865646179" Jun 09 09:50:21.031055 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:21.030997 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:21.031055 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:21.031059 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:21.031292 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:21.031081 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:21.031292 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:21.031101 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:21.033234 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:21.033191 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.17:8443: connect: connection refused" Jun 09 09:50:21.033362 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:21.033228 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.17:6571: connect: connection refused" Jun 09 09:50:21.033362 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:21.033334 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.17:6567/health\": dial tcp 10.134.0.17:6567: connect: connection refused" Jun 09 09:50:21.033464 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:21.033428 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.17:8816: connect: connection refused" Jun 09 09:50:22.722010 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:22.721965 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jun 09 09:50:22.722564 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:22.722038 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jun 09 09:50:24.031392 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:24.031340 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.17:6571: connect: connection refused" Jun 09 09:50:24.031848 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:24.031388 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.17:6567/health\": dial tcp 10.134.0.17:6567: connect: connection refused" Jun 09 09:50:24.031848 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:24.031340 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.17:8443: connect: connection refused" Jun 09 09:50:24.031848 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:24.031497 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.17:8816: connect: connection refused" Jun 09 09:50:25.030635 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:25.030583 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:25.030875 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:25.030664 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:25.030875 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:25.030685 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:25.030875 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:25.030702 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:27.031791 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:27.031714 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:27.032238 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:27.032216 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:27.032373 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:27.032359 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:27.032436 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:27.032422 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:27.036374 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:27.036353 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:27.994941 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:27.994907 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:27.995145 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:27.994977 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:27.997528 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:27.997511 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:50:32.722068 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:32.722027 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jun 09 09:50:32.722531 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:32.722036 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jun 09 09:50:42.721543 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:42.721492 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jun 09 09:50:42.721543 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:42.721532 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jun 09 09:50:42.722027 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:42.721634 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:50:42.722027 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:42.721699 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:50:44.053547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.053512 2571 generic.go:356] "Generic (PLEG): container finished" podID="f9b14883-da30-43ff-988b-0cc833b19733" containerID="a043dcaff0b0237de0ce011048f6691a806d523cfde234dfda31b068a8dd38fb" exitCode=137 Jun 09 09:50:44.053547 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.053538 2571 generic.go:356] "Generic (PLEG): container finished" podID="f9b14883-da30-43ff-988b-0cc833b19733" containerID="8ef7237bbef748fb1b7f96b979e18eb4e0dd01502be2841e7f000a7739e95b23" exitCode=137 Jun 09 09:50:44.053967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.053585 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerDied","Data":"a043dcaff0b0237de0ce011048f6691a806d523cfde234dfda31b068a8dd38fb"} Jun 09 09:50:44.053967 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.053628 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerDied","Data":"8ef7237bbef748fb1b7f96b979e18eb4e0dd01502be2841e7f000a7739e95b23"} Jun 09 09:50:44.506530 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.506506 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:50:44.531112 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.531072 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls\") pod \"f9b14883-da30-43ff-988b-0cc833b19733\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " Jun 09 09:50:44.531112 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.531108 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-registry-tls\") pod \"f9b14883-da30-43ff-988b-0cc833b19733\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " Jun 09 09:50:44.531309 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.531134 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-online-tls\") pod \"f9b14883-da30-43ff-988b-0cc833b19733\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " Jun 09 09:50:44.531309 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.531179 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-offline-tls\") pod \"f9b14883-da30-43ff-988b-0cc833b19733\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " Jun 09 09:50:44.531309 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.531250 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9b14883-da30-43ff-988b-0cc833b19733-feast-data\") pod \"f9b14883-da30-43ff-988b-0cc833b19733\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " Jun 09 09:50:44.531309 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.531281 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7l8w\" (UniqueName: \"kubernetes.io/projected/f9b14883-da30-43ff-988b-0cc833b19733-kube-api-access-n7l8w\") pod \"f9b14883-da30-43ff-988b-0cc833b19733\" (UID: \"f9b14883-da30-43ff-988b-0cc833b19733\") " Jun 09 09:50:44.531862 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.531813 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9b14883-da30-43ff-988b-0cc833b19733-feast-data" (OuterVolumeSpecName: "feast-data") pod "f9b14883-da30-43ff-988b-0cc833b19733" (UID: "f9b14883-da30-43ff-988b-0cc833b19733"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:50:44.533897 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.533858 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f9b14883-da30-43ff-988b-0cc833b19733" (UID: "f9b14883-da30-43ff-988b-0cc833b19733"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:50:44.534009 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.533944 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9b14883-da30-43ff-988b-0cc833b19733-kube-api-access-n7l8w" (OuterVolumeSpecName: "kube-api-access-n7l8w") pod "f9b14883-da30-43ff-988b-0cc833b19733" (UID: "f9b14883-da30-43ff-988b-0cc833b19733"). InnerVolumeSpecName "kube-api-access-n7l8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:50:44.534009 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.533945 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f9b14883-da30-43ff-988b-0cc833b19733" (UID: "f9b14883-da30-43ff-988b-0cc833b19733"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:50:44.534111 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.534050 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-online-tls" (OuterVolumeSpecName: "online-tls") pod "f9b14883-da30-43ff-988b-0cc833b19733" (UID: "f9b14883-da30-43ff-988b-0cc833b19733"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:50:44.534420 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.534396 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f9b14883-da30-43ff-988b-0cc833b19733" (UID: "f9b14883-da30-43ff-988b-0cc833b19733"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:50:44.631743 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.631703 2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-ui-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:50:44.631743 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.631735 2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-registry-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:50:44.631743 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.631772 2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-online-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:50:44.631988 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.631781 2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9b14883-da30-43ff-988b-0cc833b19733-offline-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:50:44.631988 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.631788 2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9b14883-da30-43ff-988b-0cc833b19733-feast-data\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:50:44.631988 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:44.631796 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7l8w\" (UniqueName: \"kubernetes.io/projected/f9b14883-da30-43ff-988b-0cc833b19733-kube-api-access-n7l8w\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:50:45.059744 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:45.059708 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" event={"ID":"f9b14883-da30-43ff-988b-0cc833b19733","Type":"ContainerDied","Data":"e28d736bd789dcfb11a4b7793d948dce8de0e06056d21d1bbbd9a70e9c8b5332"} Jun 09 09:50:45.060283 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:45.059781 2571 scope.go:117] "RemoveContainer" containerID="1f8d7488a82abb7b0db8044377e77416759f64981096d9a6532023521d4f1728" Jun 09 09:50:45.060283 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:45.059716 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8" Jun 09 09:50:45.068269 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:45.068247 2571 scope.go:117] "RemoveContainer" containerID="a043dcaff0b0237de0ce011048f6691a806d523cfde234dfda31b068a8dd38fb" Jun 09 09:50:45.078973 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:45.078949 2571 scope.go:117] "RemoveContainer" containerID="e7850d1dbcf3ff046e8709778e728ba4aa66779a7faf22cd24b70205fb6b8747" Jun 09 09:50:45.083324 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:45.083299 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8"] Jun 09 09:50:45.086901 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:45.086863 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-xh5m8"] Jun 09 09:50:45.087523 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:45.087506 2571 scope.go:117] "RemoveContainer" containerID="8ef7237bbef748fb1b7f96b979e18eb4e0dd01502be2841e7f000a7739e95b23" Jun 09 09:50:45.094458 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:45.094437 2571 scope.go:117] "RemoveContainer" containerID="3aa753282fc25273036632878195ddfaff9084d87dcda4cf98e5006bb44e6658" Jun 09 09:50:45.631941 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:50:45.631908 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9b14883-da30-43ff-988b-0cc833b19733" path="/var/lib/kubelet/pods/f9b14883-da30-43ff-988b-0cc833b19733/volumes" Jun 09 09:51:29.758698 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.758660 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567"] Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.758992 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="ui" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759010 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="ui" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759024 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="offline" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759032 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="offline" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759052 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="feast-init" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759061 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="feast-init" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759074 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="registry" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759081 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="registry" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759091 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="online" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759098 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="online" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759164 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="registry" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759175 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="ui" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759185 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="online" Jun 09 09:51:29.759239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.759196 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b14883-da30-43ff-988b-0cc833b19733" containerName="offline" Jun 09 09:51:29.763788 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.763766 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.766851 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.766832 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Jun 09 09:51:29.766948 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.766905 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jun 09 09:51:29.767002 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.766944 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jun 09 09:51:29.767002 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.766954 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jun 09 09:51:29.767360 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.767344 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jun 09 09:51:29.767428 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.767376 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jun 09 09:51:29.767482 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.767426 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-6gx67\"" Jun 09 09:51:29.767482 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.767464 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jun 09 09:51:29.779508 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.779489 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567"] Jun 09 09:51:29.851938 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.851906 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-online-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.851938 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.851942 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/42ca9051-3d94-43ea-b147-63083ba936be-registry-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.852136 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.851984 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-ui-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.852136 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.852013 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf4b6\" (UniqueName: \"kubernetes.io/projected/42ca9051-3d94-43ea-b147-63083ba936be-kube-api-access-gf4b6\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.852136 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.852033 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-offline-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.852136 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.852068 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/42ca9051-3d94-43ea-b147-63083ba936be-feast-data\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.953263 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.953232 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-ui-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.953426 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.953272 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf4b6\" (UniqueName: \"kubernetes.io/projected/42ca9051-3d94-43ea-b147-63083ba936be-kube-api-access-gf4b6\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.953426 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.953305 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-offline-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.953426 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.953355 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/42ca9051-3d94-43ea-b147-63083ba936be-feast-data\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.953426 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.953386 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-online-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.953426 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.953412 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/42ca9051-3d94-43ea-b147-63083ba936be-registry-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.953621 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:51:29.953468 2571 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Jun 09 09:51:29.953621 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:51:29.953490 2571 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Jun 09 09:51:29.953621 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:51:29.953548 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-offline-tls podName:42ca9051-3d94-43ea-b147-63083ba936be nodeName:}" failed. No retries permitted until 2026-06-09 09:51:30.45352938 +0000 UTC m=+1097.329340303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-offline-tls") pod "feast-simple-feast-remote-setup-55589c847b-vd567" (UID: "42ca9051-3d94-43ea-b147-63083ba936be") : secret "feast-simple-feast-remote-setup-offline-tls" not found Jun 09 09:51:29.953621 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:51:29.953562 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-online-tls podName:42ca9051-3d94-43ea-b147-63083ba936be nodeName:}" failed. No retries permitted until 2026-06-09 09:51:30.453556461 +0000 UTC m=+1097.329367382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-online-tls") pod "feast-simple-feast-remote-setup-55589c847b-vd567" (UID: "42ca9051-3d94-43ea-b147-63083ba936be") : secret "feast-simple-feast-remote-setup-online-tls" not found Jun 09 09:51:29.953861 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.953842 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/42ca9051-3d94-43ea-b147-63083ba936be-feast-data\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.954092 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.954077 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/42ca9051-3d94-43ea-b147-63083ba936be-registry-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.955849 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.955825 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-ui-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:29.961995 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:29.961972 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf4b6\" (UniqueName: \"kubernetes.io/projected/42ca9051-3d94-43ea-b147-63083ba936be-kube-api-access-gf4b6\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:30.456308 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:30.456255 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-online-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:30.456544 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:30.456330 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-offline-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:30.458646 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:30.458614 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-offline-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:30.458768 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:30.458670 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-online-tls\") pod \"feast-simple-feast-remote-setup-55589c847b-vd567\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:30.672904 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:30.672870 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:30.801397 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:30.801371 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567"] Jun 09 09:51:30.803180 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:51:30.803152 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42ca9051_3d94_43ea_b147_63083ba936be.slice/crio-bb469c3db370a0de91ae805c7d440b3b51ab14153b7d5a1d524141e6307a3b5a WatchSource:0}: Error finding container bb469c3db370a0de91ae805c7d440b3b51ab14153b7d5a1d524141e6307a3b5a: Status 404 returned error can't find the container with id bb469c3db370a0de91ae805c7d440b3b51ab14153b7d5a1d524141e6307a3b5a Jun 09 09:51:31.219848 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:31.219816 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" event={"ID":"42ca9051-3d94-43ea-b147-63083ba936be","Type":"ContainerStarted","Data":"8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0"} Jun 09 09:51:31.219994 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:31.219856 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" event={"ID":"42ca9051-3d94-43ea-b147-63083ba936be","Type":"ContainerStarted","Data":"bb469c3db370a0de91ae805c7d440b3b51ab14153b7d5a1d524141e6307a3b5a"} Jun 09 09:51:36.238544 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:36.238512 2571 generic.go:356] "Generic (PLEG): container finished" podID="42ca9051-3d94-43ea-b147-63083ba936be" containerID="8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0" exitCode=0 Jun 09 09:51:36.238544 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:36.238547 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" event={"ID":"42ca9051-3d94-43ea-b147-63083ba936be","Type":"ContainerDied","Data":"8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0"} Jun 09 09:51:37.246319 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:37.246278 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" event={"ID":"42ca9051-3d94-43ea-b147-63083ba936be","Type":"ContainerStarted","Data":"c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0"} Jun 09 09:51:37.246664 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:37.246342 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" event={"ID":"42ca9051-3d94-43ea-b147-63083ba936be","Type":"ContainerStarted","Data":"2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d"} Jun 09 09:51:37.246664 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:37.246365 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" event={"ID":"42ca9051-3d94-43ea-b147-63083ba936be","Type":"ContainerStarted","Data":"220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849"} Jun 09 09:51:37.269987 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:37.269934 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podStartSLOduration=3.8831665060000002 podStartE2EDuration="8.269912775s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.386746269s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:51:37.268158199 +0000 UTC m=+1104.143969137" watchObservedRunningTime="2026-06-09 09:51:37.269912775 +0000 UTC m=+1104.145723717" Jun 09 09:51:39.673918 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:39.673878 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:39.674385 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:39.673939 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:39.674385 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:39.673955 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:39.675819 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:39.675783 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jun 09 09:51:39.676064 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:39.675795 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.18:8816: connect: connection refused" Jun 09 09:51:39.676179 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:39.675819 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jun 09 09:51:40.673732 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:40.673686 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:40.673732 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:40.673742 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:40.674006 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:40.673773 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:42.674046 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:42.674016 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:42.674514 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:42.674136 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:42.674896 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:42.674874 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:42.675014 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:42.674923 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:42.678795 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:42.678771 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:51:43.274814 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:51:43.274786 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:52:45.046615 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:45.046531 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567"] Jun 09 09:52:45.047165 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:45.046769 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="online" containerID="cri-o://220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849" gracePeriod=30 Jun 09 09:52:45.047165 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:45.046838 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="offline" containerID="cri-o://2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d" gracePeriod=30 Jun 09 09:52:45.047165 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:45.046845 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="ui" containerID="cri-o://c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0" gracePeriod=30 Jun 09 09:52:45.149164 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:45.149127 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74"] Jun 09 09:52:45.149478 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:45.149421 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="registry" containerID="cri-o://4aafec8f6caec6449affe5c68da3f78d9dea6b6d8cc7a8f2a6ff30b271f109d4" gracePeriod=30 Jun 09 09:52:45.149610 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:45.149464 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="offline" containerID="cri-o://de1f12a7451dcdeeaeb97114a93ff31018641496d12860b336fee7ed407a2f31" gracePeriod=30 Jun 09 09:52:45.149610 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:45.149512 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="online" containerID="cri-o://fd565f9681e7194f1091d7c2e27d4a86e8f6e7aa137968a22319c5005f5ec997" gracePeriod=30 Jun 09 09:52:45.149610 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:45.149514 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="ui" containerID="cri-o://6a26edd68e53433dacdb3d616fcd8bbd75fb21f735ac8d29748ebf5e0ccae8f6" gracePeriod=30 Jun 09 09:52:46.493931 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:46.493895 2571 generic.go:356] "Generic (PLEG): container finished" podID="4ae26019-b82e-4074-945d-334500079b9e" containerID="6a26edd68e53433dacdb3d616fcd8bbd75fb21f735ac8d29748ebf5e0ccae8f6" exitCode=0 Jun 09 09:52:46.493931 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:46.493923 2571 generic.go:356] "Generic (PLEG): container finished" podID="4ae26019-b82e-4074-945d-334500079b9e" containerID="fd565f9681e7194f1091d7c2e27d4a86e8f6e7aa137968a22319c5005f5ec997" exitCode=0 Jun 09 09:52:46.494392 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:46.493968 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerDied","Data":"6a26edd68e53433dacdb3d616fcd8bbd75fb21f735ac8d29748ebf5e0ccae8f6"} Jun 09 09:52:46.494392 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:46.494018 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerDied","Data":"fd565f9681e7194f1091d7c2e27d4a86e8f6e7aa137968a22319c5005f5ec997"} Jun 09 09:52:46.496062 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:46.496041 2571 generic.go:356] "Generic (PLEG): container finished" podID="42ca9051-3d94-43ea-b147-63083ba936be" containerID="c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0" exitCode=0 Jun 09 09:52:46.496062 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:46.496060 2571 generic.go:356] "Generic (PLEG): container finished" podID="42ca9051-3d94-43ea-b147-63083ba936be" containerID="220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849" exitCode=0 Jun 09 09:52:46.496200 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:46.496109 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" event={"ID":"42ca9051-3d94-43ea-b147-63083ba936be","Type":"ContainerDied","Data":"c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0"} Jun 09 09:52:46.496200 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:46.496141 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" event={"ID":"42ca9051-3d94-43ea-b147-63083ba936be","Type":"ContainerDied","Data":"220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849"} Jun 09 09:52:47.994974 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:47.994936 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.17:8443: connect: connection refused" Jun 09 09:52:47.995399 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:47.994947 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.17:6567/health\": dial tcp 10.134.0.17:6567: connect: connection refused" Jun 09 09:52:52.675093 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:52.675054 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jun 09 09:52:53.272455 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:53.272416 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jun 09 09:52:57.995109 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:57.995064 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.17:8443: connect: connection refused" Jun 09 09:52:57.995109 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:52:57.995078 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.17:6567/health\": dial tcp 10.134.0.17:6567: connect: connection refused" Jun 09 09:53:02.674859 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:02.674818 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jun 09 09:53:03.273160 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:03.273115 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jun 09 09:53:07.995514 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:07.995466 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.17:8443: connect: connection refused" Jun 09 09:53:07.995987 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:07.995473 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.17:6567/health\": dial tcp 10.134.0.17:6567: connect: connection refused" Jun 09 09:53:07.995987 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:07.995608 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:53:07.995987 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:07.995809 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:53:12.675368 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:12.675323 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jun 09 09:53:12.675832 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:12.675446 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:53:13.272860 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:13.272810 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jun 09 09:53:13.273051 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:13.272940 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:53:13.639209 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:13.639133 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:53:13.640087 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:13.640066 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:53:15.241097 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.241076 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:53:15.306736 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.306668 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/42ca9051-3d94-43ea-b147-63083ba936be-registry-tls\") pod \"42ca9051-3d94-43ea-b147-63083ba936be\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " Jun 09 09:53:15.306736 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.306704 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-online-tls\") pod \"42ca9051-3d94-43ea-b147-63083ba936be\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " Jun 09 09:53:15.306736 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.306736 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/42ca9051-3d94-43ea-b147-63083ba936be-feast-data\") pod \"42ca9051-3d94-43ea-b147-63083ba936be\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " Jun 09 09:53:15.306990 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.306785 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-ui-tls\") pod \"42ca9051-3d94-43ea-b147-63083ba936be\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " Jun 09 09:53:15.306990 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.306828 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf4b6\" (UniqueName: \"kubernetes.io/projected/42ca9051-3d94-43ea-b147-63083ba936be-kube-api-access-gf4b6\") pod \"42ca9051-3d94-43ea-b147-63083ba936be\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " Jun 09 09:53:15.306990 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.306905 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-offline-tls\") pod \"42ca9051-3d94-43ea-b147-63083ba936be\" (UID: \"42ca9051-3d94-43ea-b147-63083ba936be\") " Jun 09 09:53:15.307083 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.307061 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ca9051-3d94-43ea-b147-63083ba936be-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "42ca9051-3d94-43ea-b147-63083ba936be" (UID: "42ca9051-3d94-43ea-b147-63083ba936be"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:53:15.307500 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.307461 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42ca9051-3d94-43ea-b147-63083ba936be-feast-data" (OuterVolumeSpecName: "feast-data") pod "42ca9051-3d94-43ea-b147-63083ba936be" (UID: "42ca9051-3d94-43ea-b147-63083ba936be"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:53:15.309125 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.309095 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ca9051-3d94-43ea-b147-63083ba936be-kube-api-access-gf4b6" (OuterVolumeSpecName: "kube-api-access-gf4b6") pod "42ca9051-3d94-43ea-b147-63083ba936be" (UID: "42ca9051-3d94-43ea-b147-63083ba936be"). InnerVolumeSpecName "kube-api-access-gf4b6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:53:15.309225 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.309129 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "42ca9051-3d94-43ea-b147-63083ba936be" (UID: "42ca9051-3d94-43ea-b147-63083ba936be"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:53:15.309276 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.309245 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-online-tls" (OuterVolumeSpecName: "online-tls") pod "42ca9051-3d94-43ea-b147-63083ba936be" (UID: "42ca9051-3d94-43ea-b147-63083ba936be"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:53:15.309331 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.309300 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "42ca9051-3d94-43ea-b147-63083ba936be" (UID: "42ca9051-3d94-43ea-b147-63083ba936be"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:53:15.407969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.407929 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf4b6\" (UniqueName: \"kubernetes.io/projected/42ca9051-3d94-43ea-b147-63083ba936be-kube-api-access-gf4b6\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:15.407969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.407963 2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-offline-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:15.407969 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.407973 2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/42ca9051-3d94-43ea-b147-63083ba936be-registry-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:15.408187 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.408001 2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-online-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:15.408187 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.408010 2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/42ca9051-3d94-43ea-b147-63083ba936be-feast-data\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:15.408187 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.408019 2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/42ca9051-3d94-43ea-b147-63083ba936be-ui-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:15.598486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.598400 2571 generic.go:356] "Generic (PLEG): container finished" podID="4ae26019-b82e-4074-945d-334500079b9e" containerID="de1f12a7451dcdeeaeb97114a93ff31018641496d12860b336fee7ed407a2f31" exitCode=137 Jun 09 09:53:15.598486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.598428 2571 generic.go:356] "Generic (PLEG): container finished" podID="4ae26019-b82e-4074-945d-334500079b9e" containerID="4aafec8f6caec6449affe5c68da3f78d9dea6b6d8cc7a8f2a6ff30b271f109d4" exitCode=137 Jun 09 09:53:15.598486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.598468 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerDied","Data":"de1f12a7451dcdeeaeb97114a93ff31018641496d12860b336fee7ed407a2f31"} Jun 09 09:53:15.598732 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.598511 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerDied","Data":"4aafec8f6caec6449affe5c68da3f78d9dea6b6d8cc7a8f2a6ff30b271f109d4"} Jun 09 09:53:15.600509 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.600483 2571 generic.go:356] "Generic (PLEG): container finished" podID="42ca9051-3d94-43ea-b147-63083ba936be" containerID="2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d" exitCode=137 Jun 09 09:53:15.600603 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.600531 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" event={"ID":"42ca9051-3d94-43ea-b147-63083ba936be","Type":"ContainerDied","Data":"2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d"} Jun 09 09:53:15.600603 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.600539 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" Jun 09 09:53:15.600603 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.600564 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567" event={"ID":"42ca9051-3d94-43ea-b147-63083ba936be","Type":"ContainerDied","Data":"bb469c3db370a0de91ae805c7d440b3b51ab14153b7d5a1d524141e6307a3b5a"} Jun 09 09:53:15.600603 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.600583 2571 scope.go:117] "RemoveContainer" containerID="c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0" Jun 09 09:53:15.609131 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.609112 2571 scope.go:117] "RemoveContainer" containerID="2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d" Jun 09 09:53:15.616149 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.616133 2571 scope.go:117] "RemoveContainer" containerID="220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849" Jun 09 09:53:15.621726 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.621702 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567"] Jun 09 09:53:15.624010 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.623987 2571 scope.go:117] "RemoveContainer" containerID="8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0" Jun 09 09:53:15.624082 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.624012 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55589c847b-vd567"] Jun 09 09:53:15.630848 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.630832 2571 scope.go:117] "RemoveContainer" containerID="c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0" Jun 09 09:53:15.631095 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:53:15.631080 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0\": container with ID starting with c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0 not found: ID does not exist" containerID="c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0" Jun 09 09:53:15.631163 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.631102 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0"} err="failed to get container status \"c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0\": rpc error: code = NotFound desc = could not find container \"c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0\": container with ID starting with c04dcf3f2c4dd34901bee5f3861aebb5cf378cfa4562b7aed1e937df7d3ee6e0 not found: ID does not exist" Jun 09 09:53:15.631163 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.631118 2571 scope.go:117] "RemoveContainer" containerID="2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d" Jun 09 09:53:15.631258 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.631217 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ca9051-3d94-43ea-b147-63083ba936be" path="/var/lib/kubelet/pods/42ca9051-3d94-43ea-b147-63083ba936be/volumes" Jun 09 09:53:15.631361 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:53:15.631345 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d\": container with ID starting with 2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d not found: ID does not exist" containerID="2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d" Jun 09 09:53:15.631399 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.631367 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d"} err="failed to get container status \"2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d\": rpc error: code = NotFound desc = could not find container \"2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d\": container with ID starting with 2f09155e228076e375789cdfc1cb66fd1cc376d60e7e5125bdd3dc125b43649d not found: ID does not exist" Jun 09 09:53:15.631399 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.631381 2571 scope.go:117] "RemoveContainer" containerID="220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849" Jun 09 09:53:15.631588 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:53:15.631574 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849\": container with ID starting with 220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849 not found: ID does not exist" containerID="220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849" Jun 09 09:53:15.631639 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.631592 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849"} err="failed to get container status \"220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849\": rpc error: code = NotFound desc = could not find container \"220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849\": container with ID starting with 220de76e6e91502bfbe9fe76aa586c5b48ea7637d8e22ee299f3c7aae6fc3849 not found: ID does not exist" Jun 09 09:53:15.631639 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.631604 2571 scope.go:117] "RemoveContainer" containerID="8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0" Jun 09 09:53:15.631820 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:53:15.631800 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0\": container with ID starting with 8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0 not found: ID does not exist" containerID="8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0" Jun 09 09:53:15.631922 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.631821 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0"} err="failed to get container status \"8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0\": rpc error: code = NotFound desc = could not find container \"8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0\": container with ID starting with 8eaddba35cd7c652d0df692a70ef3d14fa998746debda86ac86459e4ac5a03e0 not found: ID does not exist" Jun 09 09:53:15.797330 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.797307 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:53:15.911881 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.911789 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-registry-tls\") pod \"4ae26019-b82e-4074-945d-334500079b9e\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " Jun 09 09:53:15.911881 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.911827 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-offline-tls\") pod \"4ae26019-b82e-4074-945d-334500079b9e\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " Jun 09 09:53:15.911881 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.911848 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae26019-b82e-4074-945d-334500079b9e-feast-data\") pod \"4ae26019-b82e-4074-945d-334500079b9e\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " Jun 09 09:53:15.912148 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.911898 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-ui-tls\") pod \"4ae26019-b82e-4074-945d-334500079b9e\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " Jun 09 09:53:15.912148 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.911921 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-online-tls\") pod \"4ae26019-b82e-4074-945d-334500079b9e\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " Jun 09 09:53:15.912148 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.911940 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cnqr\" (UniqueName: \"kubernetes.io/projected/4ae26019-b82e-4074-945d-334500079b9e-kube-api-access-9cnqr\") pod \"4ae26019-b82e-4074-945d-334500079b9e\" (UID: \"4ae26019-b82e-4074-945d-334500079b9e\") " Jun 09 09:53:15.912484 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.912451 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae26019-b82e-4074-945d-334500079b9e-feast-data" (OuterVolumeSpecName: "feast-data") pod "4ae26019-b82e-4074-945d-334500079b9e" (UID: "4ae26019-b82e-4074-945d-334500079b9e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:53:15.914044 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.914021 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "4ae26019-b82e-4074-945d-334500079b9e" (UID: "4ae26019-b82e-4074-945d-334500079b9e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:53:15.914173 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.914153 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4ae26019-b82e-4074-945d-334500079b9e" (UID: "4ae26019-b82e-4074-945d-334500079b9e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:53:15.914234 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.914153 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae26019-b82e-4074-945d-334500079b9e-kube-api-access-9cnqr" (OuterVolumeSpecName: "kube-api-access-9cnqr") pod "4ae26019-b82e-4074-945d-334500079b9e" (UID: "4ae26019-b82e-4074-945d-334500079b9e"). InnerVolumeSpecName "kube-api-access-9cnqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:53:15.914337 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.914322 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-online-tls" (OuterVolumeSpecName: "online-tls") pod "4ae26019-b82e-4074-945d-334500079b9e" (UID: "4ae26019-b82e-4074-945d-334500079b9e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:53:15.914383 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:15.914369 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4ae26019-b82e-4074-945d-334500079b9e" (UID: "4ae26019-b82e-4074-945d-334500079b9e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:53:16.012581 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.012537 2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-ui-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:16.012581 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.012574 2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-online-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:16.012581 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.012583 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cnqr\" (UniqueName: \"kubernetes.io/projected/4ae26019-b82e-4074-945d-334500079b9e-kube-api-access-9cnqr\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:16.012581 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.012592 2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-registry-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:16.012834 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.012602 2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ae26019-b82e-4074-945d-334500079b9e-offline-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:16.012834 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.012611 2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae26019-b82e-4074-945d-334500079b9e-feast-data\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:53:16.606303 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.606273 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" event={"ID":"4ae26019-b82e-4074-945d-334500079b9e","Type":"ContainerDied","Data":"9c06df3bf42e6bebce5a6366f44ea0f56d83354fd112fb285360943da82a0e6a"} Jun 09 09:53:16.606777 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.606323 2571 scope.go:117] "RemoveContainer" containerID="6a26edd68e53433dacdb3d616fcd8bbd75fb21f735ac8d29748ebf5e0ccae8f6" Jun 09 09:53:16.606777 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.606280 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74" Jun 09 09:53:16.614314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.614298 2571 scope.go:117] "RemoveContainer" containerID="de1f12a7451dcdeeaeb97114a93ff31018641496d12860b336fee7ed407a2f31" Jun 09 09:53:16.621050 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.621028 2571 scope.go:117] "RemoveContainer" containerID="fd565f9681e7194f1091d7c2e27d4a86e8f6e7aa137968a22319c5005f5ec997" Jun 09 09:53:16.627256 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.627233 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74"] Jun 09 09:53:16.628307 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.628252 2571 scope.go:117] "RemoveContainer" containerID="4aafec8f6caec6449affe5c68da3f78d9dea6b6d8cc7a8f2a6ff30b271f109d4" Jun 09 09:53:16.631537 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.631518 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7d84d5c4dd-clf74"] Jun 09 09:53:16.635237 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:16.635221 2571 scope.go:117] "RemoveContainer" containerID="3d0225744eaaa3c434a69fbdb2505fabd70a8cb96dbb33e80afcfcf2432e8aa4" Jun 09 09:53:17.631122 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:17.631083 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ae26019-b82e-4074-945d-334500079b9e" path="/var/lib/kubelet/pods/4ae26019-b82e-4074-945d-334500079b9e/volumes" Jun 09 09:53:28.177892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.177855 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-n5bx7"] Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178116 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="ui" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178130 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="ui" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178143 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="offline" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178149 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="offline" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178157 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="feast-init" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178162 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="feast-init" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178178 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="feast-init" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178185 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="feast-init" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178195 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="offline" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178203 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="offline" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178209 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="registry" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178214 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="registry" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178220 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="online" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178225 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="online" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178231 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="ui" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178235 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="ui" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178241 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="online" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178246 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="online" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178285 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="ui" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178293 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="online" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178298 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="offline" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178305 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae26019-b82e-4074-945d-334500079b9e" containerName="registry" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178311 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="ui" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178318 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="online" Jun 09 09:53:28.178322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.178323 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ca9051-3d94-43ea-b147-63083ba936be" containerName="offline" Jun 09 09:53:28.181254 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.181229 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-n5bx7" Jun 09 09:53:28.183795 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.183774 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jun 09 09:53:28.184919 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.184898 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-l2spf\"" Jun 09 09:53:28.184919 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.184909 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jun 09 09:53:28.184919 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.184900 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Jun 09 09:53:28.189568 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.189551 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-n5bx7"] Jun 09 09:53:28.297804 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.297769 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp2cz\" (UniqueName: \"kubernetes.io/projected/74a1c2cc-6d38-4981-9724-aa90f0978a44-kube-api-access-vp2cz\") pod \"postgres-864846d4f5-n5bx7\" (UID: \"74a1c2cc-6d38-4981-9724-aa90f0978a44\") " pod="test-ns-feast/postgres-864846d4f5-n5bx7" Jun 09 09:53:28.297979 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.297818 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/74a1c2cc-6d38-4981-9724-aa90f0978a44-postgresdata\") pod \"postgres-864846d4f5-n5bx7\" (UID: \"74a1c2cc-6d38-4981-9724-aa90f0978a44\") " pod="test-ns-feast/postgres-864846d4f5-n5bx7" Jun 09 09:53:28.398671 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.398635 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp2cz\" (UniqueName: \"kubernetes.io/projected/74a1c2cc-6d38-4981-9724-aa90f0978a44-kube-api-access-vp2cz\") pod \"postgres-864846d4f5-n5bx7\" (UID: \"74a1c2cc-6d38-4981-9724-aa90f0978a44\") " pod="test-ns-feast/postgres-864846d4f5-n5bx7" Jun 09 09:53:28.398894 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.398690 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/74a1c2cc-6d38-4981-9724-aa90f0978a44-postgresdata\") pod \"postgres-864846d4f5-n5bx7\" (UID: \"74a1c2cc-6d38-4981-9724-aa90f0978a44\") " pod="test-ns-feast/postgres-864846d4f5-n5bx7" Jun 09 09:53:28.399121 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.399101 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/74a1c2cc-6d38-4981-9724-aa90f0978a44-postgresdata\") pod \"postgres-864846d4f5-n5bx7\" (UID: \"74a1c2cc-6d38-4981-9724-aa90f0978a44\") " pod="test-ns-feast/postgres-864846d4f5-n5bx7" Jun 09 09:53:28.406147 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.406123 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp2cz\" (UniqueName: \"kubernetes.io/projected/74a1c2cc-6d38-4981-9724-aa90f0978a44-kube-api-access-vp2cz\") pod \"postgres-864846d4f5-n5bx7\" (UID: \"74a1c2cc-6d38-4981-9724-aa90f0978a44\") " pod="test-ns-feast/postgres-864846d4f5-n5bx7" Jun 09 09:53:28.490783 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.490741 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-n5bx7" Jun 09 09:53:28.612995 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.612833 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-n5bx7"] Jun 09 09:53:28.615883 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:53:28.615858 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74a1c2cc_6d38_4981_9724_aa90f0978a44.slice/crio-0bd0507bde21fcafd4db5661f655f40023843937112f7e93b76178bb24327033 WatchSource:0}: Error finding container 0bd0507bde21fcafd4db5661f655f40023843937112f7e93b76178bb24327033: Status 404 returned error can't find the container with id 0bd0507bde21fcafd4db5661f655f40023843937112f7e93b76178bb24327033 Jun 09 09:53:28.646163 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:28.646138 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-n5bx7" event={"ID":"74a1c2cc-6d38-4981-9724-aa90f0978a44","Type":"ContainerStarted","Data":"0bd0507bde21fcafd4db5661f655f40023843937112f7e93b76178bb24327033"} Jun 09 09:53:34.669996 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:34.669913 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-n5bx7" event={"ID":"74a1c2cc-6d38-4981-9724-aa90f0978a44","Type":"ContainerStarted","Data":"07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f"} Jun 09 09:53:34.686627 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:34.686581 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-n5bx7" podStartSLOduration=1.008206932 podStartE2EDuration="6.68656529s" totalImagesPullingTime="5.678358358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:53:34.685399842 +0000 UTC m=+1221.561210780" watchObservedRunningTime="2026-06-09 09:53:34.68656529 +0000 UTC m=+1221.562376230" Jun 09 09:53:38.859470 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.859442 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k"] Jun 09 09:53:38.865239 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.865222 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:38.868023 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.867999 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Jun 09 09:53:38.868144 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.868086 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-nqkpc\"" Jun 09 09:53:38.868144 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.868108 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Jun 09 09:53:38.869013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.868998 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jun 09 09:53:38.869094 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.869032 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Jun 09 09:53:38.876156 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.876136 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k"] Jun 09 09:53:38.971137 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.971105 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-offline-tls\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:38.971303 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.971142 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4bxv\" (UniqueName: \"kubernetes.io/projected/1f6eb906-0432-40a2-9910-75546c0630cf-kube-api-access-n4bxv\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:38.971303 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.971179 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-online-tls\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:38.971303 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.971198 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f6eb906-0432-40a2-9910-75546c0630cf-feast-data\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:38.971303 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:38.971212 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-registry-tls\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.072106 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.072072 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4bxv\" (UniqueName: \"kubernetes.io/projected/1f6eb906-0432-40a2-9910-75546c0630cf-kube-api-access-n4bxv\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.072274 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.072119 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-online-tls\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.072274 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.072139 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f6eb906-0432-40a2-9910-75546c0630cf-feast-data\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.072274 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.072155 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-registry-tls\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.072274 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.072193 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-offline-tls\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.072572 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.072551 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f6eb906-0432-40a2-9910-75546c0630cf-feast-data\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.074685 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.074659 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-registry-tls\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.074795 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.074707 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-offline-tls\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.074795 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.074726 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-online-tls\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.079787 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.079763 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4bxv\" (UniqueName: \"kubernetes.io/projected/1f6eb906-0432-40a2-9910-75546c0630cf-kube-api-access-n4bxv\") pod \"feast-credit-scoring-684b6c6d7b-pqc2k\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.174120 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.174019 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:39.314175 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.314135 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k"] Jun 09 09:53:39.316962 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:53:39.316937 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6eb906_0432_40a2_9910_75546c0630cf.slice/crio-dbc3214b458ec771f3894f4fe9742cea0fd49a6bad5b5211b5a94712e17d7e67 WatchSource:0}: Error finding container dbc3214b458ec771f3894f4fe9742cea0fd49a6bad5b5211b5a94712e17d7e67: Status 404 returned error can't find the container with id dbc3214b458ec771f3894f4fe9742cea0fd49a6bad5b5211b5a94712e17d7e67 Jun 09 09:53:39.688858 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.688825 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" event={"ID":"1f6eb906-0432-40a2-9910-75546c0630cf","Type":"ContainerStarted","Data":"57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97"} Jun 09 09:53:39.689063 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:39.688878 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" event={"ID":"1f6eb906-0432-40a2-9910-75546c0630cf","Type":"ContainerStarted","Data":"dbc3214b458ec771f3894f4fe9742cea0fd49a6bad5b5211b5a94712e17d7e67"} Jun 09 09:53:41.701978 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:41.701945 2571 generic.go:356] "Generic (PLEG): container finished" podID="1f6eb906-0432-40a2-9910-75546c0630cf" containerID="57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97" exitCode=0 Jun 09 09:53:41.702376 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:41.702008 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" event={"ID":"1f6eb906-0432-40a2-9910-75546c0630cf","Type":"ContainerDied","Data":"57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97"} Jun 09 09:53:42.709845 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:42.709800 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" event={"ID":"1f6eb906-0432-40a2-9910-75546c0630cf","Type":"ContainerStarted","Data":"0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57"} Jun 09 09:53:42.710305 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:42.709887 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" event={"ID":"1f6eb906-0432-40a2-9910-75546c0630cf","Type":"ContainerStarted","Data":"e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0"} Jun 09 09:53:42.710305 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:42.709920 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" event={"ID":"1f6eb906-0432-40a2-9910-75546c0630cf","Type":"ContainerStarted","Data":"6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32"} Jun 09 09:53:42.737856 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:42.737614 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podStartSLOduration=3.247148036 podStartE2EDuration="4.737592051s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.490444015s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:53:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:53:42.736052578 +0000 UTC m=+1229.611863539" watchObservedRunningTime="2026-06-09 09:53:42.737592051 +0000 UTC m=+1229.613402992" Jun 09 09:53:45.174626 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:45.174589 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:45.175040 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:45.174777 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:45.175040 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:45.174814 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:45.176573 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:45.176531 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused" Jun 09 09:53:45.176573 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:45.176552 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.20:6571: connect: connection refused" Jun 09 09:53:45.176688 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:45.176640 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jun 09 09:53:48.174506 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:48.174445 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.20:6571: connect: connection refused" Jun 09 09:53:48.175496 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:48.175472 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:48.175965 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:48.175934 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:48.177915 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:48.177893 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:48.180078 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:48.180056 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:48.734766 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:48.734712 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:48.737898 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:48.737871 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:49.174809 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:49.174699 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:51.175312 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:51.175269 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.20:6571: connect: connection refused" Jun 09 09:53:54.175019 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:54.174991 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:53:54.175772 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:53:54.175738 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:54:55.383245 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.383208 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k"] Jun 09 09:54:55.383782 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.383447 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="registry" containerID="cri-o://6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32" gracePeriod=30 Jun 09 09:54:55.383782 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.383475 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="offline" containerID="cri-o://0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57" gracePeriod=30 Jun 09 09:54:55.383782 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.383504 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="online" containerID="cri-o://e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0" gracePeriod=30 Jun 09 09:54:55.399186 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.399157 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-n5bx7"] Jun 09 09:54:55.399309 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.399292 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-n5bx7" podUID="74a1c2cc-6d38-4981-9724-aa90f0978a44" containerName="postgres" containerID="cri-o://07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f" gracePeriod=30 Jun 09 09:54:55.631080 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.631054 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-n5bx7" Jun 09 09:54:55.755804 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.755741 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp2cz\" (UniqueName: \"kubernetes.io/projected/74a1c2cc-6d38-4981-9724-aa90f0978a44-kube-api-access-vp2cz\") pod \"74a1c2cc-6d38-4981-9724-aa90f0978a44\" (UID: \"74a1c2cc-6d38-4981-9724-aa90f0978a44\") " Jun 09 09:54:55.755804 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.755810 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/74a1c2cc-6d38-4981-9724-aa90f0978a44-postgresdata\") pod \"74a1c2cc-6d38-4981-9724-aa90f0978a44\" (UID: \"74a1c2cc-6d38-4981-9724-aa90f0978a44\") " Jun 09 09:54:55.757944 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.757911 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74a1c2cc-6d38-4981-9724-aa90f0978a44-kube-api-access-vp2cz" (OuterVolumeSpecName: "kube-api-access-vp2cz") pod "74a1c2cc-6d38-4981-9724-aa90f0978a44" (UID: "74a1c2cc-6d38-4981-9724-aa90f0978a44"). InnerVolumeSpecName "kube-api-access-vp2cz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:54:55.785845 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.785805 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a1c2cc-6d38-4981-9724-aa90f0978a44-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "74a1c2cc-6d38-4981-9724-aa90f0978a44" (UID: "74a1c2cc-6d38-4981-9724-aa90f0978a44"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:54:55.856459 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.856409 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp2cz\" (UniqueName: \"kubernetes.io/projected/74a1c2cc-6d38-4981-9724-aa90f0978a44-kube-api-access-vp2cz\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:54:55.856459 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.856455 2571 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/74a1c2cc-6d38-4981-9724-aa90f0978a44-postgresdata\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:54:55.973503 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.973466 2571 generic.go:356] "Generic (PLEG): container finished" podID="74a1c2cc-6d38-4981-9724-aa90f0978a44" containerID="07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f" exitCode=0 Jun 09 09:54:55.973656 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.973510 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-n5bx7" Jun 09 09:54:55.973656 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.973516 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-n5bx7" event={"ID":"74a1c2cc-6d38-4981-9724-aa90f0978a44","Type":"ContainerDied","Data":"07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f"} Jun 09 09:54:55.973656 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.973557 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-n5bx7" event={"ID":"74a1c2cc-6d38-4981-9724-aa90f0978a44","Type":"ContainerDied","Data":"0bd0507bde21fcafd4db5661f655f40023843937112f7e93b76178bb24327033"} Jun 09 09:54:55.973656 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.973579 2571 scope.go:117] "RemoveContainer" containerID="07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f" Jun 09 09:54:55.982698 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.982682 2571 scope.go:117] "RemoveContainer" containerID="07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f" Jun 09 09:54:55.982969 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:54:55.982949 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f\": container with ID starting with 07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f not found: ID does not exist" containerID="07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f" Jun 09 09:54:55.983052 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:55.982976 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f"} err="failed to get container status \"07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f\": rpc error: code = NotFound desc = could not find container \"07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f\": container with ID starting with 07c6d47a7991074930526eb456fd51313e83476fb0515961c4ee350c10477b6f not found: ID does not exist" Jun 09 09:54:56.008068 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:56.008011 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-n5bx7"] Jun 09 09:54:56.020064 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:56.020040 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-n5bx7"] Jun 09 09:54:56.979220 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:56.979188 2571 generic.go:356] "Generic (PLEG): container finished" podID="1f6eb906-0432-40a2-9910-75546c0630cf" containerID="e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0" exitCode=0 Jun 09 09:54:56.979593 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:56.979236 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" event={"ID":"1f6eb906-0432-40a2-9910-75546c0630cf","Type":"ContainerDied","Data":"e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0"} Jun 09 09:54:57.630917 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:57.630889 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74a1c2cc-6d38-4981-9724-aa90f0978a44" path="/var/lib/kubelet/pods/74a1c2cc-6d38-4981-9724-aa90f0978a44/volumes" Jun 09 09:54:58.735145 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:54:58.735102 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jun 09 09:55:08.735866 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:08.735824 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jun 09 09:55:18.735157 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:18.735112 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jun 09 09:55:18.735563 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:18.735238 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:55:26.030373 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.030347 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:55:26.081534 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.081499 2571 generic.go:356] "Generic (PLEG): container finished" podID="1f6eb906-0432-40a2-9910-75546c0630cf" containerID="0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57" exitCode=137 Jun 09 09:55:26.081534 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.081528 2571 generic.go:356] "Generic (PLEG): container finished" podID="1f6eb906-0432-40a2-9910-75546c0630cf" containerID="6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32" exitCode=137 Jun 09 09:55:26.081737 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.081557 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" event={"ID":"1f6eb906-0432-40a2-9910-75546c0630cf","Type":"ContainerDied","Data":"0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57"} Jun 09 09:55:26.081737 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.081567 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" Jun 09 09:55:26.081737 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.081596 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" event={"ID":"1f6eb906-0432-40a2-9910-75546c0630cf","Type":"ContainerDied","Data":"6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32"} Jun 09 09:55:26.081737 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.081613 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k" event={"ID":"1f6eb906-0432-40a2-9910-75546c0630cf","Type":"ContainerDied","Data":"dbc3214b458ec771f3894f4fe9742cea0fd49a6bad5b5211b5a94712e17d7e67"} Jun 09 09:55:26.081737 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.081634 2571 scope.go:117] "RemoveContainer" containerID="0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57" Jun 09 09:55:26.089345 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.089326 2571 scope.go:117] "RemoveContainer" containerID="e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0" Jun 09 09:55:26.096331 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.096314 2571 scope.go:117] "RemoveContainer" containerID="6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32" Jun 09 09:55:26.103123 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.103107 2571 scope.go:117] "RemoveContainer" containerID="57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97" Jun 09 09:55:26.109269 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.109255 2571 scope.go:117] "RemoveContainer" containerID="0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57" Jun 09 09:55:26.109514 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:55:26.109497 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57\": container with ID starting with 0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57 not found: ID does not exist" containerID="0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57" Jun 09 09:55:26.109570 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.109526 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57"} err="failed to get container status \"0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57\": rpc error: code = NotFound desc = could not find container \"0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57\": container with ID starting with 0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57 not found: ID does not exist" Jun 09 09:55:26.109570 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.109542 2571 scope.go:117] "RemoveContainer" containerID="e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0" Jun 09 09:55:26.109782 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:55:26.109740 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0\": container with ID starting with e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0 not found: ID does not exist" containerID="e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0" Jun 09 09:55:26.109855 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.109793 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0"} err="failed to get container status \"e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0\": rpc error: code = NotFound desc = could not find container \"e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0\": container with ID starting with e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0 not found: ID does not exist" Jun 09 09:55:26.109855 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.109814 2571 scope.go:117] "RemoveContainer" containerID="6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32" Jun 09 09:55:26.110032 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:55:26.110016 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32\": container with ID starting with 6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32 not found: ID does not exist" containerID="6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32" Jun 09 09:55:26.110073 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.110036 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32"} err="failed to get container status \"6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32\": rpc error: code = NotFound desc = could not find container \"6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32\": container with ID starting with 6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32 not found: ID does not exist" Jun 09 09:55:26.110073 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.110056 2571 scope.go:117] "RemoveContainer" containerID="57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97" Jun 09 09:55:26.110243 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:55:26.110226 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97\": container with ID starting with 57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97 not found: ID does not exist" containerID="57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97" Jun 09 09:55:26.110311 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.110249 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97"} err="failed to get container status \"57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97\": rpc error: code = NotFound desc = could not find container \"57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97\": container with ID starting with 57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97 not found: ID does not exist" Jun 09 09:55:26.110311 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.110267 2571 scope.go:117] "RemoveContainer" containerID="0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57" Jun 09 09:55:26.110507 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.110489 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57"} err="failed to get container status \"0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57\": rpc error: code = NotFound desc = could not find container \"0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57\": container with ID starting with 0782fb26a522c1cc4d559f47611064869eb1e1c97f10f710401894c5ad63ff57 not found: ID does not exist" Jun 09 09:55:26.110555 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.110508 2571 scope.go:117] "RemoveContainer" containerID="e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0" Jun 09 09:55:26.110701 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.110683 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0"} err="failed to get container status \"e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0\": rpc error: code = NotFound desc = could not find container \"e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0\": container with ID starting with e454808f22fb1a499abe546f03048e638153f2cfafe2ab1df9541530c2cd79d0 not found: ID does not exist" Jun 09 09:55:26.110784 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.110703 2571 scope.go:117] "RemoveContainer" containerID="6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32" Jun 09 09:55:26.110943 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.110921 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32"} err="failed to get container status \"6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32\": rpc error: code = NotFound desc = could not find container \"6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32\": container with ID starting with 6d1e67ba9d13bd69d8f3d17b5d03adf84e96bc14781fba314493215d53501c32 not found: ID does not exist" Jun 09 09:55:26.110943 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.110940 2571 scope.go:117] "RemoveContainer" containerID="57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97" Jun 09 09:55:26.111122 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.111107 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97"} err="failed to get container status \"57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97\": rpc error: code = NotFound desc = could not find container \"57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97\": container with ID starting with 57e20156b176c2725279d073b0e8a477c88f70b1ff7d2c5a345465a4ba2e3f97 not found: ID does not exist" Jun 09 09:55:26.167476 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.167411 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f6eb906-0432-40a2-9910-75546c0630cf-feast-data\") pod \"1f6eb906-0432-40a2-9910-75546c0630cf\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " Jun 09 09:55:26.167476 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.167451 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-online-tls\") pod \"1f6eb906-0432-40a2-9910-75546c0630cf\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " Jun 09 09:55:26.167476 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.167473 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4bxv\" (UniqueName: \"kubernetes.io/projected/1f6eb906-0432-40a2-9910-75546c0630cf-kube-api-access-n4bxv\") pod \"1f6eb906-0432-40a2-9910-75546c0630cf\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " Jun 09 09:55:26.167698 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.167490 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-registry-tls\") pod \"1f6eb906-0432-40a2-9910-75546c0630cf\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " Jun 09 09:55:26.167698 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.167544 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-offline-tls\") pod \"1f6eb906-0432-40a2-9910-75546c0630cf\" (UID: \"1f6eb906-0432-40a2-9910-75546c0630cf\") " Jun 09 09:55:26.169508 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.169479 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6eb906-0432-40a2-9910-75546c0630cf-kube-api-access-n4bxv" (OuterVolumeSpecName: "kube-api-access-n4bxv") pod "1f6eb906-0432-40a2-9910-75546c0630cf" (UID: "1f6eb906-0432-40a2-9910-75546c0630cf"). InnerVolumeSpecName "kube-api-access-n4bxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:55:26.169633 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.169488 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-online-tls" (OuterVolumeSpecName: "online-tls") pod "1f6eb906-0432-40a2-9910-75546c0630cf" (UID: "1f6eb906-0432-40a2-9910-75546c0630cf"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:55:26.169900 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.169881 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1f6eb906-0432-40a2-9910-75546c0630cf" (UID: "1f6eb906-0432-40a2-9910-75546c0630cf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:55:26.169976 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.169932 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1f6eb906-0432-40a2-9910-75546c0630cf" (UID: "1f6eb906-0432-40a2-9910-75546c0630cf"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:55:26.175613 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.175589 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6eb906-0432-40a2-9910-75546c0630cf-feast-data" (OuterVolumeSpecName: "feast-data") pod "1f6eb906-0432-40a2-9910-75546c0630cf" (UID: "1f6eb906-0432-40a2-9910-75546c0630cf"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:55:26.268452 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.268418 2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f6eb906-0432-40a2-9910-75546c0630cf-feast-data\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:55:26.268599 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.268468 2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-online-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:55:26.268599 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.268480 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4bxv\" (UniqueName: \"kubernetes.io/projected/1f6eb906-0432-40a2-9910-75546c0630cf-kube-api-access-n4bxv\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:55:26.268599 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.268489 2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-registry-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:55:26.268599 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.268498 2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f6eb906-0432-40a2-9910-75546c0630cf-offline-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:55:26.407873 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.407842 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k"] Jun 09 09:55:26.412594 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:26.412571 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-684b6c6d7b-pqc2k"] Jun 09 09:55:27.631117 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:55:27.631084 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" path="/var/lib/kubelet/pods/1f6eb906-0432-40a2-9910-75546c0630cf/volumes" Jun 09 09:57:10.335517 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335437 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-lcvx2"] Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335827 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="feast-init" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335845 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="feast-init" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335875 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74a1c2cc-6d38-4981-9724-aa90f0978a44" containerName="postgres" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335884 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="74a1c2cc-6d38-4981-9724-aa90f0978a44" containerName="postgres" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335895 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="registry" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335904 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="registry" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335914 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="online" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335922 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="online" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335932 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="offline" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335941 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="offline" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.335993 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="74a1c2cc-6d38-4981-9724-aa90f0978a44" containerName="postgres" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.336005 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="offline" Jun 09 09:57:10.336013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.336015 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="online" Jun 09 09:57:10.336458 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.336023 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6eb906-0432-40a2-9910-75546c0630cf" containerName="registry" Jun 09 09:57:10.338824 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.338805 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" Jun 09 09:57:10.341767 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.341721 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Jun 09 09:57:10.341902 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.341884 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-qv5vx\"" Jun 09 09:57:10.343032 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.343017 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Jun 09 09:57:10.355215 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.355186 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-lcvx2"] Jun 09 09:57:10.479713 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.479680 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqmx5\" (UniqueName: \"kubernetes.io/projected/98ab6f01-c838-4ff3-84ad-755b16e7bb21-kube-api-access-cqmx5\") pod \"redis-69bbd798b6-lcvx2\" (UID: \"98ab6f01-c838-4ff3-84ad-755b16e7bb21\") " pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" Jun 09 09:57:10.580968 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.580935 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqmx5\" (UniqueName: \"kubernetes.io/projected/98ab6f01-c838-4ff3-84ad-755b16e7bb21-kube-api-access-cqmx5\") pod \"redis-69bbd798b6-lcvx2\" (UID: \"98ab6f01-c838-4ff3-84ad-755b16e7bb21\") " pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" Jun 09 09:57:10.590950 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.590889 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqmx5\" (UniqueName: \"kubernetes.io/projected/98ab6f01-c838-4ff3-84ad-755b16e7bb21-kube-api-access-cqmx5\") pod \"redis-69bbd798b6-lcvx2\" (UID: \"98ab6f01-c838-4ff3-84ad-755b16e7bb21\") " pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" Jun 09 09:57:10.647475 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.647441 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" Jun 09 09:57:10.771841 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.771725 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-lcvx2"] Jun 09 09:57:10.774404 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:57:10.774376 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98ab6f01_c838_4ff3_84ad_755b16e7bb21.slice/crio-c955cd5a7819b6275c8bfd2d0b9b6e6d743f4839525aba156b34cde696730704 WatchSource:0}: Error finding container c955cd5a7819b6275c8bfd2d0b9b6e6d743f4839525aba156b34cde696730704: Status 404 returned error can't find the container with id c955cd5a7819b6275c8bfd2d0b9b6e6d743f4839525aba156b34cde696730704 Jun 09 09:57:10.776121 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:10.776104 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 09:57:11.422883 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:11.422839 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" event={"ID":"98ab6f01-c838-4ff3-84ad-755b16e7bb21","Type":"ContainerStarted","Data":"c955cd5a7819b6275c8bfd2d0b9b6e6d743f4839525aba156b34cde696730704"} Jun 09 09:57:12.426987 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:12.426953 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" event={"ID":"98ab6f01-c838-4ff3-84ad-755b16e7bb21","Type":"ContainerStarted","Data":"c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0"} Jun 09 09:57:15.754893 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:15.754841 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" podStartSLOduration=4.227247933 podStartE2EDuration="5.754822694s" totalImagesPullingTime="1.527574761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:57:12.446797582 +0000 UTC m=+1439.322608523" watchObservedRunningTime="2026-06-09 09:57:15.754822694 +0000 UTC m=+1442.630633633" Jun 09 09:57:15.755587 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:15.755570 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cp85w"] Jun 09 09:57:15.758784 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:15.758736 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" Jun 09 09:57:15.761936 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:15.761916 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Jun 09 09:57:15.766077 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:15.766045 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cp85w"] Jun 09 09:57:15.921048 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:15.921003 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d93cc7ad-0796-4183-b646-7616f1b5cd39-postgresdata\") pod \"postgres-864846d4f5-cp85w\" (UID: \"d93cc7ad-0796-4183-b646-7616f1b5cd39\") " pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" Jun 09 09:57:15.921298 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:15.921108 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sxwn\" (UniqueName: \"kubernetes.io/projected/d93cc7ad-0796-4183-b646-7616f1b5cd39-kube-api-access-6sxwn\") pod \"postgres-864846d4f5-cp85w\" (UID: \"d93cc7ad-0796-4183-b646-7616f1b5cd39\") " pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" Jun 09 09:57:16.022076 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:16.021986 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d93cc7ad-0796-4183-b646-7616f1b5cd39-postgresdata\") pod \"postgres-864846d4f5-cp85w\" (UID: \"d93cc7ad-0796-4183-b646-7616f1b5cd39\") " pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" Jun 09 09:57:16.022076 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:16.022051 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sxwn\" (UniqueName: \"kubernetes.io/projected/d93cc7ad-0796-4183-b646-7616f1b5cd39-kube-api-access-6sxwn\") pod \"postgres-864846d4f5-cp85w\" (UID: \"d93cc7ad-0796-4183-b646-7616f1b5cd39\") " pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" Jun 09 09:57:16.022383 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:16.022361 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d93cc7ad-0796-4183-b646-7616f1b5cd39-postgresdata\") pod \"postgres-864846d4f5-cp85w\" (UID: \"d93cc7ad-0796-4183-b646-7616f1b5cd39\") " pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" Jun 09 09:57:16.032322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:16.032300 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sxwn\" (UniqueName: \"kubernetes.io/projected/d93cc7ad-0796-4183-b646-7616f1b5cd39-kube-api-access-6sxwn\") pod \"postgres-864846d4f5-cp85w\" (UID: \"d93cc7ad-0796-4183-b646-7616f1b5cd39\") " pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" Jun 09 09:57:16.067495 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:16.067468 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" Jun 09 09:57:16.189800 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:16.189770 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cp85w"] Jun 09 09:57:16.192784 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:57:16.192739 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd93cc7ad_0796_4183_b646_7616f1b5cd39.slice/crio-dc2c7df026db0d8e622a24b91994f28b588c5f7ff8563bf63cb79c4e59431796 WatchSource:0}: Error finding container dc2c7df026db0d8e622a24b91994f28b588c5f7ff8563bf63cb79c4e59431796: Status 404 returned error can't find the container with id dc2c7df026db0d8e622a24b91994f28b588c5f7ff8563bf63cb79c4e59431796 Jun 09 09:57:16.442423 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:16.442339 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" event={"ID":"d93cc7ad-0796-4183-b646-7616f1b5cd39","Type":"ContainerStarted","Data":"cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6"} Jun 09 09:57:16.442423 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:16.442394 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" event={"ID":"d93cc7ad-0796-4183-b646-7616f1b5cd39","Type":"ContainerStarted","Data":"dc2c7df026db0d8e622a24b91994f28b588c5f7ff8563bf63cb79c4e59431796"} Jun 09 09:57:16.459446 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:16.459396 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" podStartSLOduration=1.459380403 podStartE2EDuration="1.459380403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:57:16.458413084 +0000 UTC m=+1443.334224024" watchObservedRunningTime="2026-06-09 09:57:16.459380403 +0000 UTC m=+1443.335191352" Jun 09 09:57:21.296465 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.296429 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6"] Jun 09 09:57:21.302302 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.302281 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.305446 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.305425 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Jun 09 09:57:21.305446 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.305430 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Jun 09 09:57:21.305630 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.305452 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-65sfs\"" Jun 09 09:57:21.305630 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.305537 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Jun 09 09:57:21.312052 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.311933 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6"] Jun 09 09:57:21.462020 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.461988 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-registry-tls\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.462212 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.462048 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5e9d84-3215-4a33-9dcb-97952341310f-feast-data\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.462212 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.462073 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp5xx\" (UniqueName: \"kubernetes.io/projected/ff5e9d84-3215-4a33-9dcb-97952341310f-kube-api-access-mp5xx\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.462212 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.462097 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-online-tls\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.562612 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.562532 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-registry-tls\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.562612 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.562586 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5e9d84-3215-4a33-9dcb-97952341310f-feast-data\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.562791 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.562611 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp5xx\" (UniqueName: \"kubernetes.io/projected/ff5e9d84-3215-4a33-9dcb-97952341310f-kube-api-access-mp5xx\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.562791 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.562636 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-online-tls\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.562791 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:57:21.562690 2571 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found Jun 09 09:57:21.562791 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:57:21.562778 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-registry-tls podName:ff5e9d84-3215-4a33-9dcb-97952341310f nodeName:}" failed. No retries permitted until 2026-06-09 09:57:22.062740052 +0000 UTC m=+1448.938550984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-registry-tls") pod "feast-credit-scoring-6d675df98f-g96s6" (UID: "ff5e9d84-3215-4a33-9dcb-97952341310f") : secret "feast-credit-scoring-registry-tls" not found Jun 09 09:57:21.563020 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.562999 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5e9d84-3215-4a33-9dcb-97952341310f-feast-data\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.564971 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.564954 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-online-tls\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:21.574420 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:21.574392 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp5xx\" (UniqueName: \"kubernetes.io/projected/ff5e9d84-3215-4a33-9dcb-97952341310f-kube-api-access-mp5xx\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:22.067030 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:22.066992 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-registry-tls\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:22.069322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:22.069302 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-registry-tls\") pod \"feast-credit-scoring-6d675df98f-g96s6\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:22.211792 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:22.211729 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:22.341892 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:22.341796 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6"] Jun 09 09:57:22.345574 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:57:22.345544 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5e9d84_3215_4a33_9dcb_97952341310f.slice/crio-cc3c002c811ede94d15859b367d4b3ac95a77f87d87623816a59780d646053a9 WatchSource:0}: Error finding container cc3c002c811ede94d15859b367d4b3ac95a77f87d87623816a59780d646053a9: Status 404 returned error can't find the container with id cc3c002c811ede94d15859b367d4b3ac95a77f87d87623816a59780d646053a9 Jun 09 09:57:22.464909 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:22.464874 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" event={"ID":"ff5e9d84-3215-4a33-9dcb-97952341310f","Type":"ContainerStarted","Data":"7439d79f307668ce9a75d0853ce97b10e586880aac804a04a2ae13ebff62110b"} Jun 09 09:57:22.465051 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:22.464922 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" event={"ID":"ff5e9d84-3215-4a33-9dcb-97952341310f","Type":"ContainerStarted","Data":"cc3c002c811ede94d15859b367d4b3ac95a77f87d87623816a59780d646053a9"} Jun 09 09:57:23.469640 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:23.469550 2571 generic.go:356] "Generic (PLEG): container finished" podID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerID="7439d79f307668ce9a75d0853ce97b10e586880aac804a04a2ae13ebff62110b" exitCode=0 Jun 09 09:57:23.469640 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:23.469608 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" event={"ID":"ff5e9d84-3215-4a33-9dcb-97952341310f","Type":"ContainerDied","Data":"7439d79f307668ce9a75d0853ce97b10e586880aac804a04a2ae13ebff62110b"} Jun 09 09:57:24.475407 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:24.475368 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" event={"ID":"ff5e9d84-3215-4a33-9dcb-97952341310f","Type":"ContainerStarted","Data":"8a6181d0c17a821679a1cfe6438de01b12ad2d75535df9e39ac2e77d7befdc7b"} Jun 09 09:57:24.475844 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:24.475424 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" event={"ID":"ff5e9d84-3215-4a33-9dcb-97952341310f","Type":"ContainerStarted","Data":"4c7b637e5d82fbba21ddd4f0c11f86f75561cc47cc35902a6f4e794bd620916d"} Jun 09 09:57:24.499583 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:24.499519 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podStartSLOduration=2.684031541 podStartE2EDuration="3.499500966s" totalImagesPullingTime="0s" totalInitContainerRuntime="815.469425ms" isStatefulPod=false podCreationTimestamp="2026-06-09 09:57:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:57:24.49711762 +0000 UTC m=+1451.372928580" watchObservedRunningTime="2026-06-09 09:57:24.499500966 +0000 UTC m=+1451.375311912" Jun 09 09:57:25.212035 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:25.211998 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:25.212205 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:25.212068 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:25.213645 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:25.213613 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused" Jun 09 09:57:25.213813 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:25.213648 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Jun 09 09:57:28.212281 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:28.212234 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused" Jun 09 09:57:28.212281 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:28.212255 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Jun 09 09:57:31.212314 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:31.212262 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused" Jun 09 09:57:31.217551 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:31.217517 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:31.217884 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:31.217859 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:31.220558 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:31.220531 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:32.212245 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:32.212213 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:34.212668 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:34.212635 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:34.513300 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:34.513224 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:57:37.009910 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.009872 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz"] Jun 09 09:57:37.013088 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.013072 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.016027 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.016002 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Jun 09 09:57:37.016154 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.016003 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Jun 09 09:57:37.016308 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.016288 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-bp29b\"" Jun 09 09:57:37.016401 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.016378 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Jun 09 09:57:37.026310 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.026288 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz"] Jun 09 09:57:37.083943 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.083908 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-registry-tls\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.084102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.083965 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8bace35e-ed0c-4c1a-924b-814ba0200d65-feast-data\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.084102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.083986 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-online-tls\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.084102 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.084023 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlvbz\" (UniqueName: \"kubernetes.io/projected/8bace35e-ed0c-4c1a-924b-814ba0200d65-kube-api-access-dlvbz\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.184862 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.184828 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-registry-tls\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.185013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.184890 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8bace35e-ed0c-4c1a-924b-814ba0200d65-feast-data\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.185013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.184917 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-online-tls\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.185013 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.184946 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlvbz\" (UniqueName: \"kubernetes.io/projected/8bace35e-ed0c-4c1a-924b-814ba0200d65-kube-api-access-dlvbz\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.185013 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:57:37.184992 2571 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found Jun 09 09:57:37.185169 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:57:37.185074 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-registry-tls podName:8bace35e-ed0c-4c1a-924b-814ba0200d65 nodeName:}" failed. No retries permitted until 2026-06-09 09:57:37.685053257 +0000 UTC m=+1464.560864191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-registry-tls") pod "feast-driver-ranking-64dc4c5bc4-dgktz" (UID: "8bace35e-ed0c-4c1a-924b-814ba0200d65") : secret "feast-driver-ranking-registry-tls" not found Jun 09 09:57:37.185310 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.185288 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8bace35e-ed0c-4c1a-924b-814ba0200d65-feast-data\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.187335 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.187313 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-online-tls\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.196029 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.196006 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlvbz\" (UniqueName: \"kubernetes.io/projected/8bace35e-ed0c-4c1a-924b-814ba0200d65-kube-api-access-dlvbz\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.687089 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.687047 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-registry-tls\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.689434 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.689412 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-registry-tls\") pod \"feast-driver-ranking-64dc4c5bc4-dgktz\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:37.922184 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:37.922146 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:38.057744 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:38.057716 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz"] Jun 09 09:57:38.058499 ip-10-0-131-231 kubenswrapper[2571]: W0609 09:57:38.058480 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bace35e_ed0c_4c1a_924b_814ba0200d65.slice/crio-e62d74f78cdfb888b5743b6567d233b3e8ba0b49724aadda740a97dc388e445e WatchSource:0}: Error finding container e62d74f78cdfb888b5743b6567d233b3e8ba0b49724aadda740a97dc388e445e: Status 404 returned error can't find the container with id e62d74f78cdfb888b5743b6567d233b3e8ba0b49724aadda740a97dc388e445e Jun 09 09:57:38.526536 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:38.526495 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" event={"ID":"8bace35e-ed0c-4c1a-924b-814ba0200d65","Type":"ContainerStarted","Data":"112eef8da940d7b94ad618285a0e252777f55fc38a4582cf8db514f3a24c8020"} Jun 09 09:57:38.526696 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:38.526551 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" event={"ID":"8bace35e-ed0c-4c1a-924b-814ba0200d65","Type":"ContainerStarted","Data":"e62d74f78cdfb888b5743b6567d233b3e8ba0b49724aadda740a97dc388e445e"} Jun 09 09:57:42.546866 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:42.546833 2571 generic.go:356] "Generic (PLEG): container finished" podID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerID="112eef8da940d7b94ad618285a0e252777f55fc38a4582cf8db514f3a24c8020" exitCode=0 Jun 09 09:57:42.547219 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:42.546877 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" event={"ID":"8bace35e-ed0c-4c1a-924b-814ba0200d65","Type":"ContainerDied","Data":"112eef8da940d7b94ad618285a0e252777f55fc38a4582cf8db514f3a24c8020"} Jun 09 09:57:43.553263 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:43.553227 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" event={"ID":"8bace35e-ed0c-4c1a-924b-814ba0200d65","Type":"ContainerStarted","Data":"476b6585c3bf22ec94e376f707eccdcc079dff9b981b80b190ab8bc5fd79b79a"} Jun 09 09:57:43.553778 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:43.553279 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" event={"ID":"8bace35e-ed0c-4c1a-924b-814ba0200d65","Type":"ContainerStarted","Data":"c88aa7d21387a96324b1b55fdc3e33ff3248250fd123980ba9b98df137328eae"} Jun 09 09:57:43.922772 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:43.922661 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:43.922924 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:43.922790 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:43.923875 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:43.923835 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jun 09 09:57:43.923987 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:43.923841 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" Jun 09 09:57:46.923023 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:46.922981 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" Jun 09 09:57:46.923595 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:46.922981 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jun 09 09:57:47.923217 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:47.923178 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:47.923699 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:47.923245 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:49.922820 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:49.922733 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" Jun 09 09:57:49.927955 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:49.927929 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:49.930913 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:49.930890 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:49.971518 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:49.971454 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podStartSLOduration=9.569526833 podStartE2EDuration="13.9714392s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.401912367s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:57:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:57:43.587228421 +0000 UTC m=+1470.463039361" watchObservedRunningTime="2026-06-09 09:57:49.9714392 +0000 UTC m=+1476.847250121" Jun 09 09:57:52.922733 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:52.922689 2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" Jun 09 09:57:55.923517 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:55.923479 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:57:55.924097 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:57:55.924077 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:58:13.660240 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:58:13.660210 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:58:13.664004 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:58:13.663969 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 09:59:12.578512 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:12.578479 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6"] Jun 09 09:59:12.579103 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:12.578811 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="registry" containerID="cri-o://4c7b637e5d82fbba21ddd4f0c11f86f75561cc47cc35902a6f4e794bd620916d" gracePeriod=30 Jun 09 09:59:12.579103 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:12.578850 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="online" containerID="cri-o://8a6181d0c17a821679a1cfe6438de01b12ad2d75535df9e39ac2e77d7befdc7b" gracePeriod=30 Jun 09 09:59:12.585790 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:12.585721 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz"] Jun 09 09:59:12.586008 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:12.585981 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="online" containerID="cri-o://476b6585c3bf22ec94e376f707eccdcc079dff9b981b80b190ab8bc5fd79b79a" gracePeriod=30 Jun 09 09:59:12.586008 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:12.585971 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="registry" containerID="cri-o://c88aa7d21387a96324b1b55fdc3e33ff3248250fd123980ba9b98df137328eae" gracePeriod=30 Jun 09 09:59:13.887292 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:13.887262 2571 generic.go:356] "Generic (PLEG): container finished" podID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerID="8a6181d0c17a821679a1cfe6438de01b12ad2d75535df9e39ac2e77d7befdc7b" exitCode=0 Jun 09 09:59:13.887680 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:13.887340 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" event={"ID":"ff5e9d84-3215-4a33-9dcb-97952341310f","Type":"ContainerDied","Data":"8a6181d0c17a821679a1cfe6438de01b12ad2d75535df9e39ac2e77d7befdc7b"} Jun 09 09:59:13.889164 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:13.889142 2571 generic.go:356] "Generic (PLEG): container finished" podID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerID="476b6585c3bf22ec94e376f707eccdcc079dff9b981b80b190ab8bc5fd79b79a" exitCode=0 Jun 09 09:59:13.889265 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:13.889177 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" event={"ID":"8bace35e-ed0c-4c1a-924b-814ba0200d65","Type":"ContainerDied","Data":"476b6585c3bf22ec94e376f707eccdcc079dff9b981b80b190ab8bc5fd79b79a"} Jun 09 09:59:14.796636 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:14.796610 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cp85w"] Jun 09 09:59:14.796815 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:14.796794 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" podUID="d93cc7ad-0796-4183-b646-7616f1b5cd39" containerName="postgres" containerID="cri-o://cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6" gracePeriod=30 Jun 09 09:59:14.802309 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:14.802283 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-lcvx2"] Jun 09 09:59:14.802488 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:14.802465 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" podUID="98ab6f01-c838-4ff3-84ad-755b16e7bb21" containerName="redis" containerID="cri-o://c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0" gracePeriod=30 Jun 09 09:59:15.056119 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.056086 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" Jun 09 09:59:15.058903 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.058885 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" Jun 09 09:59:15.153307 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.153269 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sxwn\" (UniqueName: \"kubernetes.io/projected/d93cc7ad-0796-4183-b646-7616f1b5cd39-kube-api-access-6sxwn\") pod \"d93cc7ad-0796-4183-b646-7616f1b5cd39\" (UID: \"d93cc7ad-0796-4183-b646-7616f1b5cd39\") " Jun 09 09:59:15.153307 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.153310 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d93cc7ad-0796-4183-b646-7616f1b5cd39-postgresdata\") pod \"d93cc7ad-0796-4183-b646-7616f1b5cd39\" (UID: \"d93cc7ad-0796-4183-b646-7616f1b5cd39\") " Jun 09 09:59:15.153524 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.153339 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqmx5\" (UniqueName: \"kubernetes.io/projected/98ab6f01-c838-4ff3-84ad-755b16e7bb21-kube-api-access-cqmx5\") pod \"98ab6f01-c838-4ff3-84ad-755b16e7bb21\" (UID: \"98ab6f01-c838-4ff3-84ad-755b16e7bb21\") " Jun 09 09:59:15.155424 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.155392 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93cc7ad-0796-4183-b646-7616f1b5cd39-kube-api-access-6sxwn" (OuterVolumeSpecName: "kube-api-access-6sxwn") pod "d93cc7ad-0796-4183-b646-7616f1b5cd39" (UID: "d93cc7ad-0796-4183-b646-7616f1b5cd39"). InnerVolumeSpecName "kube-api-access-6sxwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:59:15.155543 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.155453 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98ab6f01-c838-4ff3-84ad-755b16e7bb21-kube-api-access-cqmx5" (OuterVolumeSpecName: "kube-api-access-cqmx5") pod "98ab6f01-c838-4ff3-84ad-755b16e7bb21" (UID: "98ab6f01-c838-4ff3-84ad-755b16e7bb21"). InnerVolumeSpecName "kube-api-access-cqmx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:59:15.182384 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.182349 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d93cc7ad-0796-4183-b646-7616f1b5cd39-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "d93cc7ad-0796-4183-b646-7616f1b5cd39" (UID: "d93cc7ad-0796-4183-b646-7616f1b5cd39"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:59:15.253903 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.253873 2571 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d93cc7ad-0796-4183-b646-7616f1b5cd39-postgresdata\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:15.253903 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.253899 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqmx5\" (UniqueName: \"kubernetes.io/projected/98ab6f01-c838-4ff3-84ad-755b16e7bb21-kube-api-access-cqmx5\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:15.254054 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.253910 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sxwn\" (UniqueName: \"kubernetes.io/projected/d93cc7ad-0796-4183-b646-7616f1b5cd39-kube-api-access-6sxwn\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:15.896893 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.896808 2571 generic.go:356] "Generic (PLEG): container finished" podID="d93cc7ad-0796-4183-b646-7616f1b5cd39" containerID="cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6" exitCode=0 Jun 09 09:59:15.896893 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.896868 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" Jun 09 09:59:15.897094 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.896893 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" event={"ID":"d93cc7ad-0796-4183-b646-7616f1b5cd39","Type":"ContainerDied","Data":"cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6"} Jun 09 09:59:15.897094 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.896932 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-cp85w" event={"ID":"d93cc7ad-0796-4183-b646-7616f1b5cd39","Type":"ContainerDied","Data":"dc2c7df026db0d8e622a24b91994f28b588c5f7ff8563bf63cb79c4e59431796"} Jun 09 09:59:15.897094 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.896950 2571 scope.go:117] "RemoveContainer" containerID="cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6" Jun 09 09:59:15.898203 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.898184 2571 generic.go:356] "Generic (PLEG): container finished" podID="98ab6f01-c838-4ff3-84ad-755b16e7bb21" containerID="c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0" exitCode=0 Jun 09 09:59:15.898296 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.898212 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" event={"ID":"98ab6f01-c838-4ff3-84ad-755b16e7bb21","Type":"ContainerDied","Data":"c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0"} Jun 09 09:59:15.898296 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.898233 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" event={"ID":"98ab6f01-c838-4ff3-84ad-755b16e7bb21","Type":"ContainerDied","Data":"c955cd5a7819b6275c8bfd2d0b9b6e6d743f4839525aba156b34cde696730704"} Jun 09 09:59:15.898296 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.898237 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-lcvx2" Jun 09 09:59:15.904609 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.904593 2571 scope.go:117] "RemoveContainer" containerID="cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6" Jun 09 09:59:15.904879 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:59:15.904860 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6\": container with ID starting with cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6 not found: ID does not exist" containerID="cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6" Jun 09 09:59:15.904931 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.904886 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6"} err="failed to get container status \"cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6\": rpc error: code = NotFound desc = could not find container \"cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6\": container with ID starting with cca23e72ad8ad0858fa08d5fdc6d869aee40e2f0aa81e66281ec51064e4ba4f6 not found: ID does not exist" Jun 09 09:59:15.904931 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.904903 2571 scope.go:117] "RemoveContainer" containerID="c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0" Jun 09 09:59:15.911363 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.911345 2571 scope.go:117] "RemoveContainer" containerID="c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0" Jun 09 09:59:15.911610 ip-10-0-131-231 kubenswrapper[2571]: E0609 09:59:15.911591 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0\": container with ID starting with c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0 not found: ID does not exist" containerID="c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0" Jun 09 09:59:15.911660 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.911616 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0"} err="failed to get container status \"c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0\": rpc error: code = NotFound desc = could not find container \"c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0\": container with ID starting with c69dc0adc09ab50fe3b5171d16a6ef9b96f5dd7d5ff7dd39dca37de15415bbc0 not found: ID does not exist" Jun 09 09:59:15.915486 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.915466 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-lcvx2"] Jun 09 09:59:15.918925 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.918905 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-lcvx2"] Jun 09 09:59:15.930807 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.930785 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cp85w"] Jun 09 09:59:15.934457 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:15.934437 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cp85w"] Jun 09 09:59:17.631159 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:17.631129 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98ab6f01-c838-4ff3-84ad-755b16e7bb21" path="/var/lib/kubelet/pods/98ab6f01-c838-4ff3-84ad-755b16e7bb21/volumes" Jun 09 09:59:17.631519 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:17.631450 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d93cc7ad-0796-4183-b646-7616f1b5cd39" path="/var/lib/kubelet/pods/d93cc7ad-0796-4183-b646-7616f1b5cd39/volumes" Jun 09 09:59:19.929322 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:19.929288 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jun 09 09:59:21.218570 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:21.218529 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Jun 09 09:59:29.928837 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:29.928781 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jun 09 09:59:31.218903 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:31.218848 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Jun 09 09:59:39.928938 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:39.928895 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jun 09 09:59:39.929302 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:39.929008 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:59:41.218117 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:41.218074 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Jun 09 09:59:41.218490 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:41.218198 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:59:42.997580 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:42.997552 2571 generic.go:356] "Generic (PLEG): container finished" podID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerID="4c7b637e5d82fbba21ddd4f0c11f86f75561cc47cc35902a6f4e794bd620916d" exitCode=137 Jun 09 09:59:42.998016 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:42.997625 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" event={"ID":"ff5e9d84-3215-4a33-9dcb-97952341310f","Type":"ContainerDied","Data":"4c7b637e5d82fbba21ddd4f0c11f86f75561cc47cc35902a6f4e794bd620916d"} Jun 09 09:59:42.999454 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:42.999429 2571 generic.go:356] "Generic (PLEG): container finished" podID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerID="c88aa7d21387a96324b1b55fdc3e33ff3248250fd123980ba9b98df137328eae" exitCode=137 Jun 09 09:59:42.999575 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:42.999464 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" event={"ID":"8bace35e-ed0c-4c1a-924b-814ba0200d65","Type":"ContainerDied","Data":"c88aa7d21387a96324b1b55fdc3e33ff3248250fd123980ba9b98df137328eae"} Jun 09 09:59:43.235785 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.235764 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:59:43.240989 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.240968 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:59:43.347833 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.347740 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-online-tls\") pod \"ff5e9d84-3215-4a33-9dcb-97952341310f\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " Jun 09 09:59:43.347833 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.347811 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8bace35e-ed0c-4c1a-924b-814ba0200d65-feast-data\") pod \"8bace35e-ed0c-4c1a-924b-814ba0200d65\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " Jun 09 09:59:43.348099 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.347915 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp5xx\" (UniqueName: \"kubernetes.io/projected/ff5e9d84-3215-4a33-9dcb-97952341310f-kube-api-access-mp5xx\") pod \"ff5e9d84-3215-4a33-9dcb-97952341310f\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " Jun 09 09:59:43.348099 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.347949 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-registry-tls\") pod \"8bace35e-ed0c-4c1a-924b-814ba0200d65\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " Jun 09 09:59:43.348099 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.347991 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-registry-tls\") pod \"ff5e9d84-3215-4a33-9dcb-97952341310f\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " Jun 09 09:59:43.348099 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.348019 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5e9d84-3215-4a33-9dcb-97952341310f-feast-data\") pod \"ff5e9d84-3215-4a33-9dcb-97952341310f\" (UID: \"ff5e9d84-3215-4a33-9dcb-97952341310f\") " Jun 09 09:59:43.348099 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.348053 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlvbz\" (UniqueName: \"kubernetes.io/projected/8bace35e-ed0c-4c1a-924b-814ba0200d65-kube-api-access-dlvbz\") pod \"8bace35e-ed0c-4c1a-924b-814ba0200d65\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " Jun 09 09:59:43.348099 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.348095 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-online-tls\") pod \"8bace35e-ed0c-4c1a-924b-814ba0200d65\" (UID: \"8bace35e-ed0c-4c1a-924b-814ba0200d65\") " Jun 09 09:59:43.349396 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.348249 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bace35e-ed0c-4c1a-924b-814ba0200d65-feast-data" (OuterVolumeSpecName: "feast-data") pod "8bace35e-ed0c-4c1a-924b-814ba0200d65" (UID: "8bace35e-ed0c-4c1a-924b-814ba0200d65"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:59:43.350146 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.350115 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8bace35e-ed0c-4c1a-924b-814ba0200d65" (UID: "8bace35e-ed0c-4c1a-924b-814ba0200d65"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:59:43.350411 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.350383 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ff5e9d84-3215-4a33-9dcb-97952341310f" (UID: "ff5e9d84-3215-4a33-9dcb-97952341310f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:59:43.350411 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.350395 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-online-tls" (OuterVolumeSpecName: "online-tls") pod "ff5e9d84-3215-4a33-9dcb-97952341310f" (UID: "ff5e9d84-3215-4a33-9dcb-97952341310f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:59:43.350560 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.350498 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-online-tls" (OuterVolumeSpecName: "online-tls") pod "8bace35e-ed0c-4c1a-924b-814ba0200d65" (UID: "8bace35e-ed0c-4c1a-924b-814ba0200d65"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:59:43.350560 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.350503 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5e9d84-3215-4a33-9dcb-97952341310f-kube-api-access-mp5xx" (OuterVolumeSpecName: "kube-api-access-mp5xx") pod "ff5e9d84-3215-4a33-9dcb-97952341310f" (UID: "ff5e9d84-3215-4a33-9dcb-97952341310f"). InnerVolumeSpecName "kube-api-access-mp5xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:59:43.350655 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.350574 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bace35e-ed0c-4c1a-924b-814ba0200d65-kube-api-access-dlvbz" (OuterVolumeSpecName: "kube-api-access-dlvbz") pod "8bace35e-ed0c-4c1a-924b-814ba0200d65" (UID: "8bace35e-ed0c-4c1a-924b-814ba0200d65"). InnerVolumeSpecName "kube-api-access-dlvbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:59:43.357496 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.357471 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5e9d84-3215-4a33-9dcb-97952341310f-feast-data" (OuterVolumeSpecName: "feast-data") pod "ff5e9d84-3215-4a33-9dcb-97952341310f" (UID: "ff5e9d84-3215-4a33-9dcb-97952341310f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:59:43.449612 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.449570 2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8bace35e-ed0c-4c1a-924b-814ba0200d65-feast-data\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:43.449612 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.449610 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp5xx\" (UniqueName: \"kubernetes.io/projected/ff5e9d84-3215-4a33-9dcb-97952341310f-kube-api-access-mp5xx\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:43.449612 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.449620 2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-registry-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:43.449823 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.449629 2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-registry-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:43.449823 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.449637 2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5e9d84-3215-4a33-9dcb-97952341310f-feast-data\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:43.449823 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.449645 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlvbz\" (UniqueName: \"kubernetes.io/projected/8bace35e-ed0c-4c1a-924b-814ba0200d65-kube-api-access-dlvbz\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:43.449823 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.449652 2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8bace35e-ed0c-4c1a-924b-814ba0200d65-online-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:43.449823 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:43.449659 2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff5e9d84-3215-4a33-9dcb-97952341310f-online-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Jun 09 09:59:44.004478 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.004444 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" event={"ID":"ff5e9d84-3215-4a33-9dcb-97952341310f","Type":"ContainerDied","Data":"cc3c002c811ede94d15859b367d4b3ac95a77f87d87623816a59780d646053a9"} Jun 09 09:59:44.004478 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.004465 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6" Jun 09 09:59:44.004973 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.004542 2571 scope.go:117] "RemoveContainer" containerID="8a6181d0c17a821679a1cfe6438de01b12ad2d75535df9e39ac2e77d7befdc7b" Jun 09 09:59:44.006554 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.006529 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" event={"ID":"8bace35e-ed0c-4c1a-924b-814ba0200d65","Type":"ContainerDied","Data":"e62d74f78cdfb888b5743b6567d233b3e8ba0b49724aadda740a97dc388e445e"} Jun 09 09:59:44.006678 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.006596 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz" Jun 09 09:59:44.013803 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.013777 2571 scope.go:117] "RemoveContainer" containerID="4c7b637e5d82fbba21ddd4f0c11f86f75561cc47cc35902a6f4e794bd620916d" Jun 09 09:59:44.022511 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.022493 2571 scope.go:117] "RemoveContainer" containerID="7439d79f307668ce9a75d0853ce97b10e586880aac804a04a2ae13ebff62110b" Jun 09 09:59:44.028200 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.028153 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6"] Jun 09 09:59:44.029734 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.029715 2571 scope.go:117] "RemoveContainer" containerID="476b6585c3bf22ec94e376f707eccdcc079dff9b981b80b190ab8bc5fd79b79a" Jun 09 09:59:44.032229 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.032211 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6d675df98f-g96s6"] Jun 09 09:59:44.037396 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.037382 2571 scope.go:117] "RemoveContainer" containerID="c88aa7d21387a96324b1b55fdc3e33ff3248250fd123980ba9b98df137328eae" Jun 09 09:59:44.043877 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.043854 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz"] Jun 09 09:59:44.045422 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.045405 2571 scope.go:117] "RemoveContainer" containerID="112eef8da940d7b94ad618285a0e252777f55fc38a4582cf8db514f3a24c8020" Jun 09 09:59:44.047038 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:44.047021 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-64dc4c5bc4-dgktz"] Jun 09 09:59:45.631679 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:45.631638 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" path="/var/lib/kubelet/pods/8bace35e-ed0c-4c1a-924b-814ba0200d65/volumes" Jun 09 09:59:45.632284 ip-10-0-131-231 kubenswrapper[2571]: I0609 09:59:45.632263 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" path="/var/lib/kubelet/pods/ff5e9d84-3215-4a33-9dcb-97952341310f/volumes" Jun 09 10:03:13.685996 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:03:13.685971 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 10:03:13.687801 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:03:13.687779 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 10:08:13.705199 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:08:13.705170 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 10:08:13.706057 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:08:13.706040 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 10:10:23.117977 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.117944 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kgxsx/must-gather-ts2pp"] Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118236 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98ab6f01-c838-4ff3-84ad-755b16e7bb21" containerName="redis" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118254 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ab6f01-c838-4ff3-84ad-755b16e7bb21" containerName="redis" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118267 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="online" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118276 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="online" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118296 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="registry" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118304 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="registry" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118317 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="feast-init" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118326 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="feast-init" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118335 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="online" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118343 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="online" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118352 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93cc7ad-0796-4183-b646-7616f1b5cd39" containerName="postgres" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118359 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93cc7ad-0796-4183-b646-7616f1b5cd39" containerName="postgres" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118366 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="registry" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118374 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="registry" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118385 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="feast-init" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118392 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="feast-init" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118459 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="registry" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118468 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="98ab6f01-c838-4ff3-84ad-755b16e7bb21" containerName="redis" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118473 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93cc7ad-0796-4183-b646-7616f1b5cd39" containerName="postgres" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118479 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff5e9d84-3215-4a33-9dcb-97952341310f" containerName="online" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118484 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="registry" Jun 09 10:10:23.120294 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.118488 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bace35e-ed0c-4c1a-924b-814ba0200d65" containerName="online" Jun 09 10:10:23.121198 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.121178 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kgxsx/must-gather-ts2pp" Jun 09 10:10:23.123704 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.123655 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kgxsx\"/\"kube-root-ca.crt\"" Jun 09 10:10:23.123704 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.123655 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kgxsx\"/\"default-dockercfg-h772p\"" Jun 09 10:10:23.123859 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.123838 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kgxsx\"/\"openshift-service-ca.crt\"" Jun 09 10:10:23.129952 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.129931 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kgxsx/must-gather-ts2pp"] Jun 09 10:10:23.236617 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.236587 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e57981b2-a279-4073-a222-124568833cda-must-gather-output\") pod \"must-gather-ts2pp\" (UID: \"e57981b2-a279-4073-a222-124568833cda\") " pod="openshift-must-gather-kgxsx/must-gather-ts2pp" Jun 09 10:10:23.236827 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.236627 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vcdv\" (UniqueName: \"kubernetes.io/projected/e57981b2-a279-4073-a222-124568833cda-kube-api-access-5vcdv\") pod \"must-gather-ts2pp\" (UID: \"e57981b2-a279-4073-a222-124568833cda\") " pod="openshift-must-gather-kgxsx/must-gather-ts2pp" Jun 09 10:10:23.337548 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.337513 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e57981b2-a279-4073-a222-124568833cda-must-gather-output\") pod \"must-gather-ts2pp\" (UID: \"e57981b2-a279-4073-a222-124568833cda\") " pod="openshift-must-gather-kgxsx/must-gather-ts2pp" Jun 09 10:10:23.337739 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.337563 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vcdv\" (UniqueName: \"kubernetes.io/projected/e57981b2-a279-4073-a222-124568833cda-kube-api-access-5vcdv\") pod \"must-gather-ts2pp\" (UID: \"e57981b2-a279-4073-a222-124568833cda\") " pod="openshift-must-gather-kgxsx/must-gather-ts2pp" Jun 09 10:10:23.337890 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.337869 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e57981b2-a279-4073-a222-124568833cda-must-gather-output\") pod \"must-gather-ts2pp\" (UID: \"e57981b2-a279-4073-a222-124568833cda\") " pod="openshift-must-gather-kgxsx/must-gather-ts2pp" Jun 09 10:10:23.346620 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.346595 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vcdv\" (UniqueName: \"kubernetes.io/projected/e57981b2-a279-4073-a222-124568833cda-kube-api-access-5vcdv\") pod \"must-gather-ts2pp\" (UID: \"e57981b2-a279-4073-a222-124568833cda\") " pod="openshift-must-gather-kgxsx/must-gather-ts2pp" Jun 09 10:10:23.429771 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.429668 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kgxsx/must-gather-ts2pp" Jun 09 10:10:23.550304 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.550270 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kgxsx/must-gather-ts2pp"] Jun 09 10:10:23.553454 ip-10-0-131-231 kubenswrapper[2571]: W0609 10:10:23.553420 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode57981b2_a279_4073_a222_124568833cda.slice/crio-fd79f18a4b7d046c6feb216d5c40cf443c55a292ba85a6cb1131847c3774e571 WatchSource:0}: Error finding container fd79f18a4b7d046c6feb216d5c40cf443c55a292ba85a6cb1131847c3774e571: Status 404 returned error can't find the container with id fd79f18a4b7d046c6feb216d5c40cf443c55a292ba85a6cb1131847c3774e571 Jun 09 10:10:23.555240 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:23.555225 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 10:10:24.033410 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:24.033375 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kgxsx/must-gather-ts2pp" event={"ID":"e57981b2-a279-4073-a222-124568833cda","Type":"ContainerStarted","Data":"fd79f18a4b7d046c6feb216d5c40cf443c55a292ba85a6cb1131847c3774e571"} Jun 09 10:10:25.038536 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:25.038504 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kgxsx/must-gather-ts2pp" event={"ID":"e57981b2-a279-4073-a222-124568833cda","Type":"ContainerStarted","Data":"b80aaf209a7dbececb2c928a898993737f281231fe44bec44af51347fbfd23f0"} Jun 09 10:10:25.038536 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:25.038545 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kgxsx/must-gather-ts2pp" event={"ID":"e57981b2-a279-4073-a222-124568833cda","Type":"ContainerStarted","Data":"68c5e9856d0f348aa8bd0966197a214af2cd7b7843430187ad5d950f2b238598"} Jun 09 10:10:25.944361 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:25.944331 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nmz6l_b1dc76fe-cb2a-41aa-b119-ae18f1d752b9/global-pull-secret-syncer/0.log" Jun 09 10:10:26.066895 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:26.066862 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dj8s5_fa08e0e3-2faa-497f-86f8-8418357d0a52/konnectivity-agent/0.log" Jun 09 10:10:26.111687 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:26.111657 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-231.ec2.internal_f568bfae37cdddb9b7965ef2ed23b8d3/haproxy/0.log" Jun 09 10:10:30.616162 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:30.616058 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9665_0d668cc5-78aa-4784-bd35-88d3a9d9cd25/node-exporter/0.log" Jun 09 10:10:30.642560 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:30.642528 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9665_0d668cc5-78aa-4784-bd35-88d3a9d9cd25/kube-rbac-proxy/0.log" Jun 09 10:10:30.666880 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:30.666853 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9665_0d668cc5-78aa-4784-bd35-88d3a9d9cd25/init-textfile/0.log" Jun 09 10:10:33.125990 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.125922 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kgxsx/must-gather-ts2pp" podStartSLOduration=9.088916719 podStartE2EDuration="10.125899423s" totalImagesPullingTime="1.036982704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:10:25.057131293 +0000 UTC m=+2231.932942234" watchObservedRunningTime="2026-06-09 10:10:33.125899423 +0000 UTC m=+2240.001710364" Jun 09 10:10:33.127458 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.127426 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2"] Jun 09 10:10:33.133107 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.133087 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.138487 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.138424 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2"] Jun 09 10:10:33.216090 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.216053 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-proc\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.216090 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.216098 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-podres\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.216396 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.216144 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-sys\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.216396 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.216171 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnzcx\" (UniqueName: \"kubernetes.io/projected/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-kube-api-access-cnzcx\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.216396 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.216226 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-lib-modules\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.297020 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.296988 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57c9b7d7d4-wh6fg_84b51541-60b8-4f92-b4c5-47fafe20714a/console/0.log" Jun 09 10:10:33.317235 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.317206 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-lib-modules\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.317414 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.317254 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-proc\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.317414 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.317278 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-podres\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.317414 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.317322 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-sys\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.317414 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.317346 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-proc\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.317414 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.317351 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnzcx\" (UniqueName: \"kubernetes.io/projected/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-kube-api-access-cnzcx\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.317648 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.317411 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-lib-modules\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.317648 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.317433 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-sys\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.317648 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.317554 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-podres\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.326131 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.326080 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnzcx\" (UniqueName: \"kubernetes.io/projected/4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae-kube-api-access-cnzcx\") pod \"perf-node-gather-daemonset-9jlt2\" (UID: \"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.446110 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.446033 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:33.595303 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:33.594577 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2"] Jun 09 10:10:34.076231 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:34.076150 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" event={"ID":"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae","Type":"ContainerStarted","Data":"1d838cc3b467b5f05f213905156fcdf1f3c16458cd13e76ce0392872a715c74c"} Jun 09 10:10:34.076231 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:34.076211 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" event={"ID":"4958b8cb-5a6b-4e1b-9022-80f2cf6d9cae","Type":"ContainerStarted","Data":"a97b01a2d501dd1c3516dc98a71d779cb07c9a2484853a2422e2e85a7e1b447d"} Jun 09 10:10:34.076448 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:34.076236 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:34.094710 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:34.094657 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" podStartSLOduration=1.094639894 podStartE2EDuration="1.094639894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:10:34.092776888 +0000 UTC m=+2240.968587828" watchObservedRunningTime="2026-06-09 10:10:34.094639894 +0000 UTC m=+2240.970450833" Jun 09 10:10:34.603970 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:34.603928 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g9ppj_c0742eb2-819f-4aac-8d8a-42243e17defa/dns/0.log" Jun 09 10:10:34.627171 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:34.627144 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g9ppj_c0742eb2-819f-4aac-8d8a-42243e17defa/kube-rbac-proxy/0.log" Jun 09 10:10:34.651143 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:34.651120 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-842b5_83a1a323-5119-46fd-b21d-4c51f9388560/dns-node-resolver/0.log" Jun 09 10:10:35.163520 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:35.163490 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vsldw_3a6da177-59ec-4e4e-9e71-aeb42d43ebd2/node-ca/0.log" Jun 09 10:10:36.341702 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:36.341671 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-spslk_0b3dc75d-cdfa-46de-8d82-76127095dd8f/serve-healthcheck-canary/0.log" Jun 09 10:10:36.882093 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:36.882064 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x5nlz_05a57b53-0a29-4c48-9f92-edb5d8dc919c/kube-rbac-proxy/0.log" Jun 09 10:10:36.903378 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:36.903352 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x5nlz_05a57b53-0a29-4c48-9f92-edb5d8dc919c/exporter/0.log" Jun 09 10:10:36.923817 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:36.923796 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x5nlz_05a57b53-0a29-4c48-9f92-edb5d8dc919c/extractor/0.log" Jun 09 10:10:40.090284 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:40.090257 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-9jlt2" Jun 09 10:10:42.626975 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:42.626900 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn2p_6435bafd-c764-4c92-9d5c-27c61fa62a59/kube-multus-additional-cni-plugins/0.log" Jun 09 10:10:42.653568 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:42.653543 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn2p_6435bafd-c764-4c92-9d5c-27c61fa62a59/egress-router-binary-copy/0.log" Jun 09 10:10:42.679262 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:42.679240 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn2p_6435bafd-c764-4c92-9d5c-27c61fa62a59/cni-plugins/0.log" Jun 09 10:10:42.709047 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:42.709028 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn2p_6435bafd-c764-4c92-9d5c-27c61fa62a59/bond-cni-plugin/0.log" Jun 09 10:10:42.737448 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:42.737424 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn2p_6435bafd-c764-4c92-9d5c-27c61fa62a59/routeoverride-cni/0.log" Jun 09 10:10:42.766663 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:42.766634 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn2p_6435bafd-c764-4c92-9d5c-27c61fa62a59/whereabouts-cni-bincopy/0.log" Jun 09 10:10:42.798778 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:42.798731 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn2p_6435bafd-c764-4c92-9d5c-27c61fa62a59/whereabouts-cni/0.log" Jun 09 10:10:43.045004 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:43.044976 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nq5mn_dd51b416-8c70-4dde-b6a1-4e0e013e7c16/kube-multus/0.log" Jun 09 10:10:43.209194 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:43.209171 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w4s2k_4ef2d0e0-e726-43ea-908e-d9636e26ecc2/network-metrics-daemon/0.log" Jun 09 10:10:43.235271 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:43.235232 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w4s2k_4ef2d0e0-e726-43ea-908e-d9636e26ecc2/kube-rbac-proxy/0.log" Jun 09 10:10:44.098964 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:44.098934 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-controller/0.log" Jun 09 10:10:44.121689 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:44.121660 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/1.log" Jun 09 10:10:44.121937 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:44.121767 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovn-acl-logging/0.log" Jun 09 10:10:44.146443 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:44.146412 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/kube-rbac-proxy-node/0.log" Jun 09 10:10:44.172210 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:44.172177 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 10:10:44.196967 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:44.196945 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/northd/0.log" Jun 09 10:10:44.227688 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:44.227663 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/nbdb/0.log" Jun 09 10:10:44.253328 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:44.253295 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/sbdb/0.log" Jun 09 10:10:44.297188 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:44.297157 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pllj_b84c1150-3f68-4d84-981a-71d6670d2146/ovnkube-controller/0.log" Jun 09 10:10:45.793879 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:45.793849 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rbd4m_a3f79f70-407f-4ba1-8284-e6baa6b290b4/network-check-target-container/0.log" Jun 09 10:10:46.760991 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:46.760969 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-86dsl_06cb33d2-8534-4a74-a85a-33796caba7a4/iptables-alerter/0.log" Jun 09 10:10:47.487065 ip-10-0-131-231 kubenswrapper[2571]: I0609 10:10:47.487042 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rx5m9_f00d1798-2dd5-4032-969f-3ab435d8cfa0/tuned/0.log"