Sep 15 09:13:29.218459 ip-10-0-132-158 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 15 09:13:29.218477 ip-10-0-132-158 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 15 09:13:29.218486 ip-10-0-132-158 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 15 09:13:29.218705 ip-10-0-132-158 systemd[1]: Failed to start Kubernetes Kubelet. Sep 15 09:13:40.710033 ip-10-0-132-158 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 15 09:13:40.710050 ip-10-0-132-158 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fb6a6cd4bd504000806494787c19e88a -- Sep 15 09:15:10.367729 ip-10-0-132-158 systemd[1]: Starting Kubernetes Kubelet... Sep 15 09:15:10.806316 ip-10-0-132-158 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 09:15:10.806316 ip-10-0-132-158 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 15 09:15:10.806316 ip-10-0-132-158 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 09:15:10.806316 ip-10-0-132-158 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 15 09:15:10.806316 ip-10-0-132-158 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 09:15:10.809232 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.809155 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 15 09:15:10.813119 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813106 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:10.813119 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813119 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813123 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813127 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813130 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813133 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813143 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813146 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813149 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813152 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813156 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813159 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813162 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813165 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813168 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813171 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813173 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813176 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813179 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813181 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813184 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:10.813183 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813187 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813190 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813193 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813196 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813198 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813201 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813204 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813206 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813209 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813211 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813216 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813220 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813223 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813226 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813229 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813231 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813235 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813238 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813240 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813243 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:10.813671 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813246 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813248 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813251 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813253 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813256 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813258 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813263 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813267 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813270 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813273 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813276 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813279 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813282 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813284 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813289 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813292 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813295 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813298 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813301 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813303 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:10.814191 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813306 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813308 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813311 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813314 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813317 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813319 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813322 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813324 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813327 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813330 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813332 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813335 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813339 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813342 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813345 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813347 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813350 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813353 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813355 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813358 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:10.814968 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813360 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813363 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813365 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813368 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813371 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813375 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813379 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813382 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813384 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813387 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813390 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813392 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813395 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813397 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813411 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813414 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813417 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:10.815528 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.813419 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:10.816357 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816341 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:10.816357 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816356 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816360 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816363 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816366 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816369 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816371 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816374 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816377 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816379 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816382 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816385 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816388 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816390 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816393 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816396 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816410 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816413 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816416 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816419 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816422 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:10.816446 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816424 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816427 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816429 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816432 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816435 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816437 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816440 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816443 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816446 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816448 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816451 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816454 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816457 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816460 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816462 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816465 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816469 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816471 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816474 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816477 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:10.816936 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816479 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816482 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816485 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816487 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816490 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816494 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816498 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816501 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816504 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816508 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816510 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816513 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816515 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816518 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816521 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816524 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816527 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816530 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816532 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:10.817423 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816535 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816537 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816540 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816543 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816545 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816548 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816550 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816553 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816556 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816558 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816561 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816563 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816566 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816569 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816571 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816574 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816576 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816579 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816581 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816584 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:10.817890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816587 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816591 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816595 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816599 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816603 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816606 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816609 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816612 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816615 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816618 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816620 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816623 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816625 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816628 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816630 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816633 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816636 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816638 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.816641 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:10.818382 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817006 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817011 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817014 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817016 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817019 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817023 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817026 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817028 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817031 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817034 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817037 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817039 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817043 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817046 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817048 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817051 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817055 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817059 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817063 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817066 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:10.818858 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817069 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817072 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817075 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817078 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817080 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817083 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817086 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817088 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817091 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817093 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817096 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817098 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817101 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817103 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817106 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817109 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817111 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817115 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817118 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:10.819342 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817120 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817123 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817126 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817129 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817132 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817135 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817137 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817140 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817143 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817145 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817148 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817151 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817153 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817156 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817158 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817161 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817164 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817166 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817169 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817171 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:10.819890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817174 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817176 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817179 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817181 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817184 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817189 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817192 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817194 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817197 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817200 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817203 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817205 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817208 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817210 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817213 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817216 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817218 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817221 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817223 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817225 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:10.820372 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817228 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817231 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817234 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817237 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817240 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817242 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817245 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817247 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817250 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817252 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817255 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817258 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817260 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817263 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817265 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817268 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817270 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817276 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817280 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:10.820907 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.817283 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817356 2566 flags.go:64] FLAG: --address="0.0.0.0" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817387 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817397 2566 flags.go:64] FLAG: --anonymous-auth="true" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817416 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817420 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817423 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817427 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817432 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817436 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817439 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817442 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817445 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817450 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817453 2566 flags.go:64] FLAG: --cgroup-root="" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817456 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817459 2566 flags.go:64] FLAG: --client-ca-file="" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817463 2566 flags.go:64] FLAG: --cloud-provider="external" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817466 2566 flags.go:64] FLAG: --cluster-dns="[]" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817470 2566 flags.go:64] FLAG: --cluster-domain="" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817473 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817476 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817479 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817483 2566 flags.go:64] FLAG: --container-log-max-files="5" Sep 15 09:15:10.821359 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817487 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817490 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817492 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817496 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817499 2566 flags.go:64] FLAG: --contention-profiling="false" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817502 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817505 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817508 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817511 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817515 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817518 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817523 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817526 2566 flags.go:64] FLAG: --enable-load-reader="false" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817529 2566 flags.go:64] FLAG: --enable-server="true" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817532 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817536 2566 flags.go:64] FLAG: --event-burst="100" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817539 2566 flags.go:64] FLAG: --event-qps="50" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817542 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817545 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817548 2566 flags.go:64] FLAG: --eviction-hard="" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817551 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817554 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817557 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817560 2566 flags.go:64] FLAG: --eviction-soft="" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817563 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 15 09:15:10.821952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817566 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817570 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817573 2566 flags.go:64] FLAG: --experimental-mounter-path="" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817575 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817578 2566 flags.go:64] FLAG: --fail-swap-on="true" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817581 2566 flags.go:64] FLAG: --feature-gates="" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817584 2566 flags.go:64] FLAG: --file-check-frequency="20s" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817587 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817590 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817593 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817596 2566 flags.go:64] FLAG: --healthz-port="10248" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817599 2566 flags.go:64] FLAG: --help="false" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817602 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-132-158.ec2.internal" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817605 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817608 2566 flags.go:64] FLAG: --http-check-frequency="20s" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817611 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817614 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817617 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817622 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817624 2566 flags.go:64] FLAG: --image-service-endpoint="" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817627 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817630 2566 flags.go:64] FLAG: --kube-api-burst="100" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817633 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817636 2566 flags.go:64] FLAG: --kube-api-qps="50" Sep 15 09:15:10.822588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817639 2566 flags.go:64] FLAG: --kube-reserved="" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817641 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817644 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817647 2566 flags.go:64] FLAG: --kubelet-cgroups="" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817650 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817653 2566 flags.go:64] FLAG: --lock-file="" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817655 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817658 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817661 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817667 2566 flags.go:64] FLAG: --log-json-split-stream="false" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817670 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817673 2566 flags.go:64] FLAG: --log-text-split-stream="false" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817676 2566 flags.go:64] FLAG: --logging-format="text" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817678 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817682 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817684 2566 flags.go:64] FLAG: --manifest-url="" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817687 2566 flags.go:64] FLAG: --manifest-url-header="" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817691 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817694 2566 flags.go:64] FLAG: --max-open-files="1000000" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817698 2566 flags.go:64] FLAG: --max-pods="110" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817701 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817704 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817707 2566 flags.go:64] FLAG: --memory-manager-policy="None" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817710 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817713 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 15 09:15:10.823174 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817716 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817720 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817727 2566 flags.go:64] FLAG: --node-status-max-images="50" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817731 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817734 2566 flags.go:64] FLAG: --oom-score-adj="-999" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817737 2566 flags.go:64] FLAG: --pod-cidr="" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817739 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817745 2566 flags.go:64] FLAG: --pod-manifest-path="" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817748 2566 flags.go:64] FLAG: --pod-max-pids="-1" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817751 2566 flags.go:64] FLAG: --pods-per-core="0" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817754 2566 flags.go:64] FLAG: --port="10250" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817757 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817760 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ddbe8eff430e914c" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817763 2566 flags.go:64] FLAG: --qos-reserved="" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817766 2566 flags.go:64] FLAG: --read-only-port="10255" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817770 2566 flags.go:64] FLAG: --register-node="true" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817773 2566 flags.go:64] FLAG: --register-with-taints="" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817776 2566 flags.go:64] FLAG: --registry-burst="10" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817779 2566 flags.go:64] FLAG: --registry-qps="5" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817782 2566 flags.go:64] FLAG: --reserved-cpus="" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817785 2566 flags.go:64] FLAG: --reserved-memory="" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817789 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817792 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817795 2566 flags.go:64] FLAG: --rotate-certificates="false" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817798 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 15 09:15:10.823814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817801 2566 flags.go:64] FLAG: --runonce="false" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817804 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817807 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817810 2566 flags.go:64] FLAG: --seccomp-default="false" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817813 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817816 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817818 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817821 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817824 2566 flags.go:64] FLAG: --storage-driver-password="root" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817828 2566 flags.go:64] FLAG: --storage-driver-secure="false" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817831 2566 flags.go:64] FLAG: --storage-driver-table="stats" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817834 2566 flags.go:64] FLAG: --storage-driver-user="root" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817837 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817840 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817843 2566 flags.go:64] FLAG: --system-cgroups="" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817845 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817851 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817853 2566 flags.go:64] FLAG: --tls-cert-file="" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817856 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817860 2566 flags.go:64] FLAG: --tls-min-version="" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817863 2566 flags.go:64] FLAG: --tls-private-key-file="" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817866 2566 flags.go:64] FLAG: --topology-manager-policy="none" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817869 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817871 2566 flags.go:64] FLAG: --topology-manager-scope="container" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817874 2566 flags.go:64] FLAG: --v="2" Sep 15 09:15:10.824475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817878 2566 flags.go:64] FLAG: --version="false" Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817885 2566 flags.go:64] FLAG: --vmodule="" Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817888 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.817891 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818002 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818006 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818009 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818012 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818015 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818018 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818022 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818033 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818037 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818039 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818042 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818045 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818049 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818053 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818057 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818060 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:10.825076 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818063 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818065 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818068 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818071 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818073 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818076 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818079 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818082 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818084 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818087 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818089 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818092 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818095 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818097 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818100 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818103 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818106 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818108 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818111 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818113 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:10.825608 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818116 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818118 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818122 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818125 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818128 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818131 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818140 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818144 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818149 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818152 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818155 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818158 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818161 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818163 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818166 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818169 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818171 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818174 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818177 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:10.826102 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818180 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818182 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818185 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818187 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818190 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818193 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818195 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818198 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818201 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818204 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818206 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818209 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818212 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818214 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818217 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818220 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818223 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818226 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818229 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818231 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:10.826584 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818234 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818238 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818241 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818243 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818246 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818249 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818251 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818254 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818256 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818259 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818262 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818265 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818267 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818270 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818273 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818275 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818278 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818280 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818283 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:10.827058 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818286 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818288 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818292 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818296 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.818299 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.819019 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.826610 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.826625 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.826644 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.826653 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826723 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826728 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826731 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826734 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826737 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:10.827544 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826741 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826744 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826747 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826749 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826752 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826755 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826758 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826760 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826763 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826766 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826768 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826771 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826774 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826776 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826779 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826782 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826784 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826787 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826789 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826793 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:10.827917 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826796 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826799 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826802 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826804 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826807 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826810 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826813 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826816 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826819 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826821 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826824 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826827 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826830 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826832 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826835 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826837 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826840 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826843 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826846 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826848 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:10.828477 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826851 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826855 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826858 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826860 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826863 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826865 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826868 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826871 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826873 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826876 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826878 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826881 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826887 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826890 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826893 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826896 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826900 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826902 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826905 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:10.828956 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826908 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826910 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826913 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826916 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826918 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826921 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826923 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826926 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826929 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826931 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826934 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826937 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826939 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826942 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826945 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826949 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826952 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826955 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826958 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826961 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:10.829425 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826964 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826968 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826971 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826974 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826977 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826980 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826984 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826988 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826991 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826994 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826996 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.826999 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827002 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827005 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:10.829902 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827008 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.827013 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827126 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827131 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827134 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827137 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827140 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827143 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827146 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827148 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827151 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827154 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827157 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827159 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827162 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:10.830248 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827165 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827167 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827170 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827173 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827176 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827180 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827183 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827186 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827189 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827192 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827196 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827199 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827202 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827204 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827207 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827210 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827213 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827216 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827219 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:10.830628 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827222 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827225 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827227 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827230 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827233 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827235 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827238 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827240 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827243 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827245 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827248 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827251 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827254 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827256 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827259 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827262 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827264 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827267 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827269 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827272 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:10.831082 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827275 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827278 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827280 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827284 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827287 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827289 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827292 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827295 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827297 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827300 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827304 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827307 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827310 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827313 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827316 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827319 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827321 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827324 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827327 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:10.831582 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827329 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827332 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827334 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827337 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827340 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827343 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827345 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827348 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827351 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827354 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827356 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827359 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827361 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827364 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827366 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827369 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827371 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827375 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827378 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827380 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:10.832048 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827383 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:10.832590 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827385 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:10.832590 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827388 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:10.832590 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827391 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:10.832590 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827393 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:10.832590 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827396 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:10.832590 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827414 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:10.832590 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:10.827418 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:10.832590 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.827424 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 09:15:10.832590 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.827523 2566 server.go:962] "Client rotation is on, will bootstrap in background" Sep 15 09:15:10.832590 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.832227 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 15 09:15:10.833336 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.833325 2566 server.go:1019] "Starting client certificate rotation" Sep 15 09:15:10.833466 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.833428 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 09:15:10.833466 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.833460 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 09:15:10.836107 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.836095 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 09:15:10.837201 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.837184 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 09:15:10.849900 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.849878 2566 log.go:25] "Validated CRI v1 runtime API" Sep 15 09:15:10.855492 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.855465 2566 log.go:25] "Validated CRI v1 image API" Sep 15 09:15:10.856309 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.856285 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 15 09:15:10.862841 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.862819 2566 fs.go:135] Filesystem UUIDs: map[163dcdf8-9b6b-4d2a-b5b4-08e3f8da55d7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7ca7fbd8-585e-4410-860f-50f48cab22f8:/dev/nvme0n1p4] Sep 15 09:15:10.862920 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.862838 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 15 09:15:10.865030 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.865009 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 09:15:10.867972 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.867865 2566 manager.go:216] Machine: {Timestamp:2026-09-15 09:15:10.866617165 +0000 UTC m=+0.373194593 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099037 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212457edeaa5d5686e5409d769410f SystemUUID:ec212457-edea-a5d5-686e-5409d769410f BootID:fb6a6cd4-bd50-4000-8064-94787c19e88a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f1:18:2f:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f1:18:2f:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:bc:3f:9f:ca:eb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 15 09:15:10.867972 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.867963 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 15 09:15:10.868091 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.868054 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 15 09:15:10.869229 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.869206 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 15 09:15:10.869361 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.869232 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 15 09:15:10.870786 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.870775 2566 topology_manager.go:138] "Creating topology manager with none policy" Sep 15 09:15:10.870819 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.870789 2566 container_manager_linux.go:309] "Creating device plugin manager" Sep 15 09:15:10.870819 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.870796 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 09:15:10.871633 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.871623 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 09:15:10.872891 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.872880 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 15 09:15:10.877623 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.877612 2566 state_mem.go:36] "Initialized new in-memory state store" Sep 15 09:15:10.877741 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.877731 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 15 09:15:10.877777 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.877758 2566 kubelet.go:486] "Attempting to sync node with API server" Sep 15 09:15:10.877777 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.877774 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 15 09:15:10.877830 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.877793 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 15 09:15:10.877830 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.877802 2566 kubelet.go:398] "Adding apiserver pod source" Sep 15 09:15:10.877830 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.877811 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 15 09:15:10.878153 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.878140 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 09:15:10.878203 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.878187 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 09:15:10.881225 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.881204 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 15 09:15:10.884238 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.884223 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 15 09:15:10.884295 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.884255 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 15 09:15:10.886170 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886157 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 15 09:15:10.886240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886174 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 15 09:15:10.886240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886180 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 15 09:15:10.886240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886185 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 15 09:15:10.886240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886194 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 15 09:15:10.886240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886200 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 15 09:15:10.886240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886212 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 15 09:15:10.886240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886218 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 15 09:15:10.886240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886225 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 15 09:15:10.886240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886231 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 15 09:15:10.886485 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886245 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 15 09:15:10.886485 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.886251 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 15 09:15:10.887132 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.887120 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 15 09:15:10.887169 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.887135 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 15 09:15:10.889955 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.889936 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-158.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 15 09:15:10.890684 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.890663 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 15 09:15:10.890758 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.890673 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 15 09:15:10.890890 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.890879 2566 server.go:1268] "Started kubelet" Sep 15 09:15:10.891018 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.890987 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 15 09:15:10.891114 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.890971 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 15 09:15:10.891172 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.891155 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 15 09:15:10.891740 ip-10-0-132-158 systemd[1]: Started Kubernetes Kubelet. Sep 15 09:15:10.893274 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.893256 2566 server.go:310] "Adding debug handlers to kubelet server" Sep 15 09:15:10.895484 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.895456 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 15 09:15:10.896883 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.896859 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 15 09:15:10.899607 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.898382 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-158.ec2.internal.18d573c39a1a09a6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-158.ec2.internal,UID:ip-10-0-132-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-158.ec2.internal,},FirstTimestamp:2026-09-15 09:15:10.890854822 +0000 UTC m=+0.397432250,LastTimestamp:2026-09-15 09:15:10.890854822 +0000 UTC m=+0.397432250,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-158.ec2.internal,}" Sep 15 09:15:10.902245 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.902224 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 15 09:15:10.902931 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.902915 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 15 09:15:10.903288 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.903269 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:10.903737 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.903724 2566 factory.go:55] Registering systemd factory Sep 15 09:15:10.903792 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.903757 2566 factory.go:223] Registration of the systemd container factory successfully Sep 15 09:15:10.903792 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.903774 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 15 09:15:10.903792 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.903784 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 15 09:15:10.903919 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.903802 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 15 09:15:10.903919 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.903871 2566 reconstruct.go:97] "Volume reconstruction finished" Sep 15 09:15:10.903919 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.903879 2566 reconciler.go:29] "Reconciler: start to sync state" Sep 15 09:15:10.904117 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.903972 2566 factory.go:153] Registering CRI-O factory Sep 15 09:15:10.904159 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.904120 2566 factory.go:223] Registration of the crio container factory successfully Sep 15 09:15:10.904201 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.904161 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 15 09:15:10.904201 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.904178 2566 factory.go:103] Registering Raw factory Sep 15 09:15:10.904201 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.904191 2566 manager.go:1196] Started watching for new ooms in manager Sep 15 09:15:10.904497 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.904483 2566 manager.go:349] Starting recovery of all containers Sep 15 09:15:10.904763 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.904738 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 15 09:15:10.904935 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.904904 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 15 09:15:10.911072 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.911032 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wvqbb" Sep 15 09:15:10.914940 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.914535 2566 manager.go:354] Recovery completed Sep 15 09:15:10.917843 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.917826 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wvqbb" Sep 15 09:15:10.919322 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.919311 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:10.921147 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.921131 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:10.921240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.921163 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:10.921240 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.921178 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:10.922482 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.922324 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 15 09:15:10.922482 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.922340 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 15 09:15:10.922482 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.922357 2566 state_mem.go:36] "Initialized new in-memory state store" Sep 15 09:15:10.923138 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.923122 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:10.923971 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.923956 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:10.924046 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.923985 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:10.924046 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.923998 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:10.924888 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.924871 2566 policy_none.go:49] "None policy: Start" Sep 15 09:15:10.924888 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.924891 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 15 09:15:10.924993 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.924901 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 15 09:15:10.926890 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.926878 2566 policy_none.go:47] "Start" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.961001 2566 manager.go:337] "Starting Device Plugin manager" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.961041 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.961054 2566 server.go:87] "Starting device plugin registration server" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.961393 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.961422 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.961537 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.961613 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.961622 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.962102 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.962153 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.967451 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.968594 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.968636 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.968655 2566 kubelet.go:2448] "Starting kubelet main sync loop" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:10.968691 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 15 09:15:10.978630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:10.970758 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:11.062295 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.062213 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:11.063101 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.063084 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:11.063190 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.063119 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:11.063190 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.063134 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:11.063190 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.063163 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.068741 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.068724 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal"] Sep 15 09:15:11.068814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.068793 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:11.069518 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.069504 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:11.069597 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.069531 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:11.069597 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.069545 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:11.071862 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.071847 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:11.071981 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.071964 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.072032 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.071995 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:11.072508 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.072495 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:11.072569 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.072513 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:11.072569 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.072538 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:11.072569 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.072549 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:11.072673 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.072521 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:11.072673 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.072579 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.072673 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.072602 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:11.072673 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.072601 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-158.ec2.internal\": node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:11.074796 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.074782 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.074865 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.074805 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:11.075448 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.075432 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:11.075515 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.075463 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:11.075515 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.075476 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:11.096641 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.096623 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:11.108011 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.107997 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-158.ec2.internal\" not found" node="ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.112442 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.112426 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-158.ec2.internal\" not found" node="ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.197545 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.197516 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:11.204841 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.204822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/887e7c7c9aa7907ed56753bebfb85efa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal\" (UID: \"887e7c7c9aa7907ed56753bebfb85efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.204841 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.204848 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/887e7c7c9aa7907ed56753bebfb85efa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal\" (UID: \"887e7c7c9aa7907ed56753bebfb85efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.204953 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.204865 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a44f61a74ce15f38275564d7d0ce773-config\") pod \"kube-apiserver-proxy-ip-10-0-132-158.ec2.internal\" (UID: \"3a44f61a74ce15f38275564d7d0ce773\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.297989 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.297949 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:11.305242 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.305215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/887e7c7c9aa7907ed56753bebfb85efa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal\" (UID: \"887e7c7c9aa7907ed56753bebfb85efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.305331 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.305251 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/887e7c7c9aa7907ed56753bebfb85efa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal\" (UID: \"887e7c7c9aa7907ed56753bebfb85efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.305331 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.305277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a44f61a74ce15f38275564d7d0ce773-config\") pod \"kube-apiserver-proxy-ip-10-0-132-158.ec2.internal\" (UID: \"3a44f61a74ce15f38275564d7d0ce773\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.305331 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.305325 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/887e7c7c9aa7907ed56753bebfb85efa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal\" (UID: \"887e7c7c9aa7907ed56753bebfb85efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.305481 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.305365 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a44f61a74ce15f38275564d7d0ce773-config\") pod \"kube-apiserver-proxy-ip-10-0-132-158.ec2.internal\" (UID: \"3a44f61a74ce15f38275564d7d0ce773\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.305481 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.305325 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/887e7c7c9aa7907ed56753bebfb85efa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal\" (UID: \"887e7c7c9aa7907ed56753bebfb85efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.398725 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.398652 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:11.412079 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.412056 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.416096 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.416080 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal" Sep 15 09:15:11.502660 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.502616 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:11.602826 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.602778 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:11.710465 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.710428 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:11.811452 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.811426 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:11.832604 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.832555 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 15 09:15:11.832778 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.832754 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 09:15:11.855463 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.855444 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:11.912436 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:11.912389 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-158.ec2.internal\" not found" Sep 15 09:15:11.925533 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.925488 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 09:10:11 +0000 UTC" deadline="2028-06-26 06:11:20.79144568 +0000 UTC" Sep 15 09:15:11.925606 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.925546 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15596h56m8.865902788s" Sep 15 09:15:11.969394 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:11.969316 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:12.005965 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.005931 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" Sep 15 09:15:12.019691 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.019669 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 09:15:12.021891 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.021877 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal" Sep 15 09:15:12.030225 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.030205 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 09:15:12.225631 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:12.225554 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887e7c7c9aa7907ed56753bebfb85efa.slice/crio-f4c513caceeebac022fc7fd1f01ddb199bbc33a23123e4cbe7fd6d7dcd780842 WatchSource:0}: Error finding container f4c513caceeebac022fc7fd1f01ddb199bbc33a23123e4cbe7fd6d7dcd780842: Status 404 returned error can't find the container with id f4c513caceeebac022fc7fd1f01ddb199bbc33a23123e4cbe7fd6d7dcd780842 Sep 15 09:15:12.236320 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.236302 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 09:15:12.243618 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.243596 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:12.879324 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.879288 2566 apiserver.go:52] "Watching apiserver" Sep 15 09:15:12.890802 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.890771 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 15 09:15:12.892258 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.892226 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv","openshift-cluster-node-tuning-operator/tuned-ncxjn","openshift-multus/multus-additional-cni-plugins-wqqj2","openshift-multus/multus-btkc9","openshift-multus/network-metrics-daemon-kl7xm","openshift-network-diagnostics/network-check-target-5qt48","kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal","openshift-dns/node-resolver-v4rkp","openshift-image-registry/node-ca-l8s2p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal","openshift-network-operator/iptables-alerter-g66b8","openshift-ovn-kubernetes/ovnkube-node-kzqrf","kube-system/global-pull-secret-syncer-4wbhf","kube-system/konnectivity-agent-xqg97"] Sep 15 09:15:12.894957 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.894932 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:12.895087 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:12.895060 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:12.898162 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.897498 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.900497 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.900297 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 15 09:15:12.901254 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.900890 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 15 09:15:12.901254 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.900940 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5c9d7\"" Sep 15 09:15:12.902268 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.902228 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:12.902999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.902975 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 15 09:15:12.905219 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.905198 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 15 09:15:12.905604 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.905584 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 15 09:15:12.905913 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.905893 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nmb6r\"" Sep 15 09:15:12.906071 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.906054 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 15 09:15:12.906578 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.906143 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 15 09:15:12.906851 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.906190 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 15 09:15:12.907032 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.906375 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.909702 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.908871 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:12.909702 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:12.908949 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:12.910667 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.910070 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jg6rn\"" Sep 15 09:15:12.910667 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.910070 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 15 09:15:12.911150 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.911128 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:12.911242 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:12.911212 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:12.913823 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.913720 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.916176 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.916525 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.916735 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.916740 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.916959 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9m5b7\"" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.916974 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-var-lib-cni-bin\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-daemon-config\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917029 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kh5c\" (UniqueName: \"kubernetes.io/projected/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-kube-api-access-7kh5c\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9e36a2a-23f0-4257-8685-1d9349789349-dbus\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-run\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.917139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917132 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-host\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-tmp\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917205 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x25wk\" (UniqueName: \"kubernetes.io/projected/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-kube-api-access-x25wk\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-cni-dir\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f03148de-9805-4f67-8fb7-2ba911accd06-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917291 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-var-lib-cni-multus\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917324 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-var-lib-kubelet\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-modprobe-d\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-run-netns\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917494 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917521 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-kubernetes\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917550 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-sys\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f03148de-9805-4f67-8fb7-2ba911accd06-system-cni-dir\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917603 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-sysconfig\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917643 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-systemd\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-tuned\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.918922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f03148de-9805-4f67-8fb7-2ba911accd06-cnibin\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f03148de-9805-4f67-8fb7-2ba911accd06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917758 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-cnibin\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-run-k8s-cni-cncf-io\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-sysctl-d\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917842 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-lib-modules\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-system-cni-dir\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-socket-dir-parent\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917943 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-var-lib-kubelet\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917967 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-hostroot\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.917992 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-run-multus-certs\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.918017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-etc-kubernetes\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.918041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9e36a2a-23f0-4257-8685-1d9349789349-kubelet-config\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.918088 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-sysctl-conf\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.918119 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-cni-binary-copy\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.918178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f03148de-9805-4f67-8fb7-2ba911accd06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:12.919869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.918197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f03148de-9805-4f67-8fb7-2ba911accd06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:12.920945 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.918284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh94l\" (UniqueName: \"kubernetes.io/projected/f03148de-9805-4f67-8fb7-2ba911accd06-kube-api-access-hh94l\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:12.920945 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.918308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-conf-dir\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:12.920945 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.918591 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:12.920945 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.919243 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bllqg\"" Sep 15 09:15:12.920945 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.919256 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 15 09:15:12.920945 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.919516 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 15 09:15:12.920945 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.920608 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 15 09:15:12.921590 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.921567 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 15 09:15:12.921741 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.921611 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ccgrx\"" Sep 15 09:15:12.921810 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.921781 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 15 09:15:12.924101 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.923736 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:12.926394 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.925965 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 15 09:15:12.926394 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.926228 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 15 09:15:12.926394 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.926383 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fx479\"" Sep 15 09:15:12.926618 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.926471 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:12.928771 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.928626 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 15 09:15:12.929185 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.929161 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 15 09:15:12.929301 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.929269 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b29wd\"" Sep 15 09:15:12.929937 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.929404 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 15 09:15:12.929937 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.929831 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:12.932286 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.932104 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 15 09:15:12.932286 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.932175 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 15 09:15:12.932930 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.932359 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-42566\"" Sep 15 09:15:12.932930 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.932730 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 15 09:15:12.932930 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.932838 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 15 09:15:12.933838 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.932929 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 15 09:15:12.933838 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.933329 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 15 09:15:12.946817 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.946754 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rtvmr" Sep 15 09:15:12.952288 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.952267 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rtvmr" Sep 15 09:15:12.985194 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.985056 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal" event={"ID":"3a44f61a74ce15f38275564d7d0ce773","Type":"ContainerStarted","Data":"91c7a1806fc52397c39051f249028147af2cac8835fa17a152d93d61b078ce1f"} Sep 15 09:15:12.986917 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:12.986886 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" event={"ID":"887e7c7c9aa7907ed56753bebfb85efa","Type":"ContainerStarted","Data":"f4c513caceeebac022fc7fd1f01ddb199bbc33a23123e4cbe7fd6d7dcd780842"} Sep 15 09:15:13.005231 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.005149 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.018873 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-cni-bin\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.018919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6wn4\" (UniqueName: \"kubernetes.io/projected/824cffcb-a109-4605-917b-4224320c952a-kube-api-access-w6wn4\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.018951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-tuned\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.018979 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-cnibin\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-run-k8s-cni-cncf-io\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-sysctl-d\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-systemd-units\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019077 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-run-netns\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019104 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-socket-dir-parent\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-sys-fs\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019152 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe08162-7133-43f5-b5d4-c4db416ecab3-host\") pod \"node-ca-l8s2p\" (UID: \"abe08162-7133-43f5-b5d4-c4db416ecab3\") " pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed9b06ef-3480-4265-8056-5d8c8ec1c4b5-iptables-alerter-script\") pod \"iptables-alerter-g66b8\" (UID: \"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5\") " pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019204 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-node-log\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019229 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-hostroot\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019255 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-etc-kubernetes\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019280 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-sysctl-conf\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.021548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019305 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f58ca49-d00b-4740-8ca4-96e5f1836bb0-hosts-file\") pod \"node-resolver-v4rkp\" (UID: \"0f58ca49-d00b-4740-8ca4-96e5f1836bb0\") " pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019333 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m79l5\" (UniqueName: \"kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5\") pod \"network-check-target-5qt48\" (UID: \"db4dddf9-4ec7-4b46-8f22-e508adeddc95\") " pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019388 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f03148de-9805-4f67-8fb7-2ba911accd06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019423 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f03148de-9805-4f67-8fb7-2ba911accd06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019450 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-conf-dir\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019493 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-daemon-config\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019520 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kh5c\" (UniqueName: \"kubernetes.io/projected/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-kube-api-access-7kh5c\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s4qq\" (UniqueName: \"kubernetes.io/projected/ed9b06ef-3480-4265-8056-5d8c8ec1c4b5-kube-api-access-7s4qq\") pod \"iptables-alerter-g66b8\" (UID: \"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5\") " pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9e36a2a-23f0-4257-8685-1d9349789349-dbus\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-tmp\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019633 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-run-openvswitch\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019661 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019688 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/824cffcb-a109-4605-917b-4224320c952a-ovnkube-script-lib\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019742 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-cni-dir\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.022443 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019768 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-var-lib-kubelet\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019801 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-registration-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-etc-selinux\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019859 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-run-netns\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019884 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-kubernetes\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019907 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-sys\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019931 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-cni-netd\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.019988 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/824cffcb-a109-4605-917b-4224320c952a-ovnkube-config\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f03148de-9805-4f67-8fb7-2ba911accd06-system-cni-dir\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-sysconfig\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-systemd\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020105 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bqnc\" (UniqueName: \"kubernetes.io/projected/0f58ca49-d00b-4740-8ca4-96e5f1836bb0-kube-api-access-2bqnc\") pod \"node-resolver-v4rkp\" (UID: \"0f58ca49-d00b-4740-8ca4-96e5f1836bb0\") " pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020155 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f03148de-9805-4f67-8fb7-2ba911accd06-cnibin\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020183 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f03148de-9805-4f67-8fb7-2ba911accd06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020211 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-lib-modules\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.023383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsbk6\" (UniqueName: \"kubernetes.io/projected/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-kube-api-access-rsbk6\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5pjx\" (UniqueName: \"kubernetes.io/projected/627bf239-bde8-4671-ae9c-3e59d0f8faa7-kube-api-access-d5pjx\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020294 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-system-cni-dir\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-var-lib-kubelet\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52e1c8dc-6067-4995-9433-c631cce937cc-agent-certs\") pod \"konnectivity-agent-xqg97\" (UID: \"52e1c8dc-6067-4995-9433-c631cce937cc\") " pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020375 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed9b06ef-3480-4265-8056-5d8c8ec1c4b5-host-slash\") pod \"iptables-alerter-g66b8\" (UID: \"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5\") " pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020417 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-run-multus-certs\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9e36a2a-23f0-4257-8685-1d9349789349-kubelet-config\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020497 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzn57\" (UniqueName: \"kubernetes.io/projected/abe08162-7133-43f5-b5d4-c4db416ecab3-kube-api-access-xzn57\") pod \"node-ca-l8s2p\" (UID: \"abe08162-7133-43f5-b5d4-c4db416ecab3\") " pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020576 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52e1c8dc-6067-4995-9433-c631cce937cc-konnectivity-ca\") pod \"konnectivity-agent-xqg97\" (UID: \"52e1c8dc-6067-4995-9433-c631cce937cc\") " pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-cni-binary-copy\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020645 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh94l\" (UniqueName: \"kubernetes.io/projected/f03148de-9805-4f67-8fb7-2ba911accd06-kube-api-access-hh94l\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020668 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f03148de-9805-4f67-8fb7-2ba911accd06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-run\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-host\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020727 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abe08162-7133-43f5-b5d4-c4db416ecab3-serviceca\") pod \"node-ca-l8s2p\" (UID: \"abe08162-7133-43f5-b5d4-c4db416ecab3\") " pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f58ca49-d00b-4740-8ca4-96e5f1836bb0-tmp-dir\") pod \"node-resolver-v4rkp\" (UID: \"0f58ca49-d00b-4740-8ca4-96e5f1836bb0\") " pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:13.024179 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-var-lib-cni-bin\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020819 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x25wk\" (UniqueName: \"kubernetes.io/projected/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-kube-api-access-x25wk\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020846 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-socket-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020873 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-kubelet\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-var-lib-openvswitch\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020934 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-etc-openvswitch\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.020989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-run-ovn\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f03148de-9805-4f67-8fb7-2ba911accd06-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021062 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-var-lib-cni-multus\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-modprobe-d\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021126 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-slash\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021156 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/824cffcb-a109-4605-917b-4224320c952a-env-overrides\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021170 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f03148de-9805-4f67-8fb7-2ba911accd06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/824cffcb-a109-4605-917b-4224320c952a-ovn-node-metrics-cert\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021228 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021245 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-conf-dir\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021257 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-device-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021312 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-run-systemd\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-log-socket\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.021987 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9e36a2a-23f0-4257-8685-1d9349789349-dbus\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022126 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022238 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-cni-dir\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022307 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-var-lib-kubelet\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022374 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-run-netns\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022493 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-kubernetes\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022503 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-sys\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022570 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-run-multus-certs\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022586 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-run-k8s-cni-cncf-io\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022625 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9e36a2a-23f0-4257-8685-1d9349789349-kubelet-config\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022685 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-socket-dir-parent\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022800 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-cnibin\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022842 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-hostroot\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.022927 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-sysctl-d\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023129 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-cni-binary-copy\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.025958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023137 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-etc-kubernetes\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023259 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-sysctl-conf\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023297 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f03148de-9805-4f67-8fb7-2ba911accd06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023301 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-var-lib-cni-bin\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023302 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-systemd\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023344 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-host-var-lib-cni-multus\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023356 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-system-cni-dir\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023379 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-var-lib-kubelet\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023449 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f03148de-9805-4f67-8fb7-2ba911accd06-cnibin\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023517 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-modprobe-d\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023537 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-lib-modules\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023535 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-multus-daemon-config\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023567 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f03148de-9805-4f67-8fb7-2ba911accd06-system-cni-dir\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023614 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-host\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023659 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f03148de-9805-4f67-8fb7-2ba911accd06-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023674 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-run\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.023848 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:13.026875 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.023934 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret podName:e9e36a2a-23f0-4257-8685-1d9349789349 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:13.523911378 +0000 UTC m=+3.030488813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret") pod "global-pull-secret-syncer-4wbhf" (UID: "e9e36a2a-23f0-4257-8685-1d9349789349") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:13.027795 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.023848 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-sysconfig\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.028449 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.028415 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-etc-tuned\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.030714 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.030689 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-tmp\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.032127 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.031676 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kh5c\" (UniqueName: \"kubernetes.io/projected/1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf-kube-api-access-7kh5c\") pod \"multus-btkc9\" (UID: \"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf\") " pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.035149 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.033851 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x25wk\" (UniqueName: \"kubernetes.io/projected/5d63bbad-f561-4ca9-88e8-cf715a6f0a03-kube-api-access-x25wk\") pod \"tuned-ncxjn\" (UID: \"5d63bbad-f561-4ca9-88e8-cf715a6f0a03\") " pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.036570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.036466 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh94l\" (UniqueName: \"kubernetes.io/projected/f03148de-9805-4f67-8fb7-2ba911accd06-kube-api-access-hh94l\") pod \"multus-additional-cni-plugins-wqqj2\" (UID: \"f03148de-9805-4f67-8fb7-2ba911accd06\") " pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.121760 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.121722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-systemd-units\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.121771 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-run-netns\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.121799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-sys-fs\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.121824 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe08162-7133-43f5-b5d4-c4db416ecab3-host\") pod \"node-ca-l8s2p\" (UID: \"abe08162-7133-43f5-b5d4-c4db416ecab3\") " pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.121851 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed9b06ef-3480-4265-8056-5d8c8ec1c4b5-iptables-alerter-script\") pod \"iptables-alerter-g66b8\" (UID: \"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5\") " pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.121875 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-node-log\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.121901 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f58ca49-d00b-4740-8ca4-96e5f1836bb0-hosts-file\") pod \"node-resolver-v4rkp\" (UID: \"0f58ca49-d00b-4740-8ca4-96e5f1836bb0\") " pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.121925 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.121952 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79l5\" (UniqueName: \"kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5\") pod \"network-check-target-5qt48\" (UID: \"db4dddf9-4ec7-4b46-8f22-e508adeddc95\") " pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.121984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s4qq\" (UniqueName: \"kubernetes.io/projected/ed9b06ef-3480-4265-8056-5d8c8ec1c4b5-kube-api-access-7s4qq\") pod \"iptables-alerter-g66b8\" (UID: \"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5\") " pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-run-openvswitch\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.122050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122061 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122094 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/824cffcb-a109-4605-917b-4224320c952a-ovnkube-script-lib\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-registration-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122146 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-etc-selinux\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122183 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-cni-netd\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122212 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/824cffcb-a109-4605-917b-4224320c952a-ovnkube-config\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122264 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bqnc\" (UniqueName: \"kubernetes.io/projected/0f58ca49-d00b-4740-8ca4-96e5f1836bb0-kube-api-access-2bqnc\") pod \"node-resolver-v4rkp\" (UID: \"0f58ca49-d00b-4740-8ca4-96e5f1836bb0\") " pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122297 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbk6\" (UniqueName: \"kubernetes.io/projected/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-kube-api-access-rsbk6\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5pjx\" (UniqueName: \"kubernetes.io/projected/627bf239-bde8-4671-ae9c-3e59d0f8faa7-kube-api-access-d5pjx\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122365 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52e1c8dc-6067-4995-9433-c631cce937cc-agent-certs\") pod \"konnectivity-agent-xqg97\" (UID: \"52e1c8dc-6067-4995-9433-c631cce937cc\") " pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed9b06ef-3480-4265-8056-5d8c8ec1c4b5-host-slash\") pod \"iptables-alerter-g66b8\" (UID: \"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5\") " pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122418 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzn57\" (UniqueName: \"kubernetes.io/projected/abe08162-7133-43f5-b5d4-c4db416ecab3-kube-api-access-xzn57\") pod \"node-ca-l8s2p\" (UID: \"abe08162-7133-43f5-b5d4-c4db416ecab3\") " pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52e1c8dc-6067-4995-9433-c631cce937cc-konnectivity-ca\") pod \"konnectivity-agent-xqg97\" (UID: \"52e1c8dc-6067-4995-9433-c631cce937cc\") " pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abe08162-7133-43f5-b5d4-c4db416ecab3-serviceca\") pod \"node-ca-l8s2p\" (UID: \"abe08162-7133-43f5-b5d4-c4db416ecab3\") " pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f58ca49-d00b-4740-8ca4-96e5f1836bb0-tmp-dir\") pod \"node-resolver-v4rkp\" (UID: \"0f58ca49-d00b-4740-8ca4-96e5f1836bb0\") " pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:13.122721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122554 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-socket-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-kubelet\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-var-lib-openvswitch\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122631 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-etc-openvswitch\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122657 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-run-ovn\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122686 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-slash\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122710 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/824cffcb-a109-4605-917b-4224320c952a-env-overrides\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122736 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/824cffcb-a109-4605-917b-4224320c952a-ovn-node-metrics-cert\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122779 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-device-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-run-systemd\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-log-socket\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-cni-bin\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.122879 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6wn4\" (UniqueName: \"kubernetes.io/projected/824cffcb-a109-4605-917b-4224320c952a-kube-api-access-w6wn4\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.123230 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-systemd-units\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.123314 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-run-netns\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.123372 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-sys-fs\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.123688 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.123410 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe08162-7133-43f5-b5d4-c4db416ecab3-host\") pod \"node-ca-l8s2p\" (UID: \"abe08162-7133-43f5-b5d4-c4db416ecab3\") " pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:13.124588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.124056 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed9b06ef-3480-4265-8056-5d8c8ec1c4b5-iptables-alerter-script\") pod \"iptables-alerter-g66b8\" (UID: \"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5\") " pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:13.124588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.124136 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed9b06ef-3480-4265-8056-5d8c8ec1c4b5-host-slash\") pod \"iptables-alerter-g66b8\" (UID: \"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5\") " pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:13.124588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.124402 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/824cffcb-a109-4605-917b-4224320c952a-ovnkube-script-lib\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.124588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.124500 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-node-log\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.124588 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.124559 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f58ca49-d00b-4740-8ca4-96e5f1836bb0-hosts-file\") pod \"node-resolver-v4rkp\" (UID: \"0f58ca49-d00b-4740-8ca4-96e5f1836bb0\") " pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:13.124877 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.124648 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:13.124877 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.124707 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs podName:e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:13.624687235 +0000 UTC m=+3.131264660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs") pod "network-metrics-daemon-kl7xm" (UID: "e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:13.125001 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.124901 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52e1c8dc-6067-4995-9433-c631cce937cc-konnectivity-ca\") pod \"konnectivity-agent-xqg97\" (UID: \"52e1c8dc-6067-4995-9433-c631cce937cc\") " pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:13.125277 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125252 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-run-openvswitch\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125348 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125310 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abe08162-7133-43f5-b5d4-c4db416ecab3-serviceca\") pod \"node-ca-l8s2p\" (UID: \"abe08162-7133-43f5-b5d4-c4db416ecab3\") " pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:13.125348 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125322 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125462 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125390 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-slash\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125540 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125471 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-device-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.125540 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125526 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-socket-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.125646 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125573 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-kubelet\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125646 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125619 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-var-lib-openvswitch\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125758 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125657 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f58ca49-d00b-4740-8ca4-96e5f1836bb0-tmp-dir\") pod \"node-resolver-v4rkp\" (UID: \"0f58ca49-d00b-4740-8ca4-96e5f1836bb0\") " pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:13.125758 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125659 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-etc-openvswitch\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125758 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125690 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-run-ovn\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125758 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125738 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-run-systemd\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125956 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125789 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-log-socket\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125956 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125798 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-etc-selinux\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.125956 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125837 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-cni-bin\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125956 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125848 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/824cffcb-a109-4605-917b-4224320c952a-env-overrides\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.125956 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125860 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-registration-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.125956 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125869 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/627bf239-bde8-4671-ae9c-3e59d0f8faa7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.125956 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125883 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.126299 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125960 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/824cffcb-a109-4605-917b-4224320c952a-host-cni-netd\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.126299 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.125981 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/824cffcb-a109-4605-917b-4224320c952a-ovnkube-config\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.129374 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.129282 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/824cffcb-a109-4605-917b-4224320c952a-ovn-node-metrics-cert\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.130642 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.129898 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52e1c8dc-6067-4995-9433-c631cce937cc-agent-certs\") pod \"konnectivity-agent-xqg97\" (UID: \"52e1c8dc-6067-4995-9433-c631cce937cc\") " pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:13.132387 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.131684 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:13.132387 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.131731 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:13.132387 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.131748 2566 projected.go:196] Error preparing data for projected volume kube-api-access-m79l5 for pod openshift-network-diagnostics/network-check-target-5qt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:13.132387 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.131821 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5 podName:db4dddf9-4ec7-4b46-8f22-e508adeddc95 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:13.631791357 +0000 UTC m=+3.138368791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m79l5" (UniqueName: "kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5") pod "network-check-target-5qt48" (UID: "db4dddf9-4ec7-4b46-8f22-e508adeddc95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:13.132387 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.131877 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6wn4\" (UniqueName: \"kubernetes.io/projected/824cffcb-a109-4605-917b-4224320c952a-kube-api-access-w6wn4\") pod \"ovnkube-node-kzqrf\" (UID: \"824cffcb-a109-4605-917b-4224320c952a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.135032 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.134985 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5pjx\" (UniqueName: \"kubernetes.io/projected/627bf239-bde8-4671-ae9c-3e59d0f8faa7-kube-api-access-d5pjx\") pod \"aws-ebs-csi-driver-node-wpmqv\" (UID: \"627bf239-bde8-4671-ae9c-3e59d0f8faa7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.138019 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.137973 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsbk6\" (UniqueName: \"kubernetes.io/projected/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-kube-api-access-rsbk6\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:13.141235 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.141208 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzn57\" (UniqueName: \"kubernetes.io/projected/abe08162-7133-43f5-b5d4-c4db416ecab3-kube-api-access-xzn57\") pod \"node-ca-l8s2p\" (UID: \"abe08162-7133-43f5-b5d4-c4db416ecab3\") " pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:13.141341 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.141208 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s4qq\" (UniqueName: \"kubernetes.io/projected/ed9b06ef-3480-4265-8056-5d8c8ec1c4b5-kube-api-access-7s4qq\") pod \"iptables-alerter-g66b8\" (UID: \"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5\") " pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:13.142930 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.142880 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bqnc\" (UniqueName: \"kubernetes.io/projected/0f58ca49-d00b-4740-8ca4-96e5f1836bb0-kube-api-access-2bqnc\") pod \"node-resolver-v4rkp\" (UID: \"0f58ca49-d00b-4740-8ca4-96e5f1836bb0\") " pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:13.214885 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.214842 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" Sep 15 09:15:13.226025 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.225707 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" Sep 15 09:15:13.226838 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.226741 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:13.239014 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.238960 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-btkc9" Sep 15 09:15:13.239167 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:13.239144 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03148de_9805_4f67_8fb7_2ba911accd06.slice/crio-b737ecc6b9e297ade2f07667aa837592be6271e314807a53403730eb34d54685 WatchSource:0}: Error finding container b737ecc6b9e297ade2f07667aa837592be6271e314807a53403730eb34d54685: Status 404 returned error can't find the container with id b737ecc6b9e297ade2f07667aa837592be6271e314807a53403730eb34d54685 Sep 15 09:15:13.246746 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.246558 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" Sep 15 09:15:13.250636 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:13.250607 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa7f2cf_bd36_4ef1_84a9_7dfda0d979cf.slice/crio-80b186823d06c1bcdaf0566ce0fcd51898fcf8267b0736ade2e341b98e34ee55 WatchSource:0}: Error finding container 80b186823d06c1bcdaf0566ce0fcd51898fcf8267b0736ade2e341b98e34ee55: Status 404 returned error can't find the container with id 80b186823d06c1bcdaf0566ce0fcd51898fcf8267b0736ade2e341b98e34ee55 Sep 15 09:15:13.253832 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.253627 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v4rkp" Sep 15 09:15:13.256686 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:13.256551 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627bf239_bde8_4671_ae9c_3e59d0f8faa7.slice/crio-a22d6fd1e594b7e32f40f12a65ba9f2b1d87f7499fae590fea231cf2dc149134 WatchSource:0}: Error finding container a22d6fd1e594b7e32f40f12a65ba9f2b1d87f7499fae590fea231cf2dc149134: Status 404 returned error can't find the container with id a22d6fd1e594b7e32f40f12a65ba9f2b1d87f7499fae590fea231cf2dc149134 Sep 15 09:15:13.263565 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.263537 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8s2p" Sep 15 09:15:13.265897 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:13.265871 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f58ca49_d00b_4740_8ca4_96e5f1836bb0.slice/crio-c1e666fb475beaa8a8d20548b53c8f1f8df94d908698cddcec43a13f3eea87c6 WatchSource:0}: Error finding container c1e666fb475beaa8a8d20548b53c8f1f8df94d908698cddcec43a13f3eea87c6: Status 404 returned error can't find the container with id c1e666fb475beaa8a8d20548b53c8f1f8df94d908698cddcec43a13f3eea87c6 Sep 15 09:15:13.275522 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:13.275496 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe08162_7133_43f5_b5d4_c4db416ecab3.slice/crio-3d5d500705e67c3a50657ae43174be6ffb18902b659245e047f2deefc5395c28 WatchSource:0}: Error finding container 3d5d500705e67c3a50657ae43174be6ffb18902b659245e047f2deefc5395c28: Status 404 returned error can't find the container with id 3d5d500705e67c3a50657ae43174be6ffb18902b659245e047f2deefc5395c28 Sep 15 09:15:13.280371 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.280350 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:13.290531 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:13.290503 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e1c8dc_6067_4995_9433_c631cce937cc.slice/crio-39cfa21456185a5ddeec2efd66890cb7069ca6055c02b06d0a6777c706c9c91e WatchSource:0}: Error finding container 39cfa21456185a5ddeec2efd66890cb7069ca6055c02b06d0a6777c706c9c91e: Status 404 returned error can't find the container with id 39cfa21456185a5ddeec2efd66890cb7069ca6055c02b06d0a6777c706c9c91e Sep 15 09:15:13.292976 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.292915 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g66b8" Sep 15 09:15:13.301650 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.301627 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:13.303280 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:13.303250 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded9b06ef_3480_4265_8056_5d8c8ec1c4b5.slice/crio-96982266b152c21f1a73bae3bb93654518e86538fc474ae98510170923b464ec WatchSource:0}: Error finding container 96982266b152c21f1a73bae3bb93654518e86538fc474ae98510170923b464ec: Status 404 returned error can't find the container with id 96982266b152c21f1a73bae3bb93654518e86538fc474ae98510170923b464ec Sep 15 09:15:13.313130 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:13.313100 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824cffcb_a109_4605_917b_4224320c952a.slice/crio-26e8da7c68f95442f6b55f3a6e0357116e5896419cc28e7fb8b8d65cdf1f2fc4 WatchSource:0}: Error finding container 26e8da7c68f95442f6b55f3a6e0357116e5896419cc28e7fb8b8d65cdf1f2fc4: Status 404 returned error can't find the container with id 26e8da7c68f95442f6b55f3a6e0357116e5896419cc28e7fb8b8d65cdf1f2fc4 Sep 15 09:15:13.526720 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.526679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:13.526928 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.526807 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:13.526928 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.526894 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret podName:e9e36a2a-23f0-4257-8685-1d9349789349 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:14.526870038 +0000 UTC m=+4.033447469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret") pod "global-pull-secret-syncer-4wbhf" (UID: "e9e36a2a-23f0-4257-8685-1d9349789349") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:13.627597 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.627554 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:13.627795 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.627713 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:13.627855 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.627829 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs podName:e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:14.627800879 +0000 UTC m=+4.134378297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs") pod "network-metrics-daemon-kl7xm" (UID: "e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:13.728706 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.728667 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79l5\" (UniqueName: \"kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5\") pod \"network-check-target-5qt48\" (UID: \"db4dddf9-4ec7-4b46-8f22-e508adeddc95\") " pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:13.728886 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.728827 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:13.728886 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.728852 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:13.728886 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.728863 2566 projected.go:196] Error preparing data for projected volume kube-api-access-m79l5 for pod openshift-network-diagnostics/network-check-target-5qt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:13.729060 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.728926 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5 podName:db4dddf9-4ec7-4b46-8f22-e508adeddc95 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:14.728909774 +0000 UTC m=+4.235487191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m79l5" (UniqueName: "kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5") pod "network-check-target-5qt48" (UID: "db4dddf9-4ec7-4b46-8f22-e508adeddc95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:13.956483 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.956419 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:10:13 +0000 UTC" deadline="2028-06-13 13:56:22.110743374 +0000 UTC" Sep 15 09:15:13.956483 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.956481 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15292h41m8.154266787s" Sep 15 09:15:13.969114 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.969082 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:13.969296 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:13.969216 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:13.989936 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.989894 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g66b8" event={"ID":"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5","Type":"ContainerStarted","Data":"96982266b152c21f1a73bae3bb93654518e86538fc474ae98510170923b464ec"} Sep 15 09:15:13.991503 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.991408 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xqg97" event={"ID":"52e1c8dc-6067-4995-9433-c631cce937cc","Type":"ContainerStarted","Data":"39cfa21456185a5ddeec2efd66890cb7069ca6055c02b06d0a6777c706c9c91e"} Sep 15 09:15:13.993084 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.993057 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" event={"ID":"627bf239-bde8-4671-ae9c-3e59d0f8faa7","Type":"ContainerStarted","Data":"a22d6fd1e594b7e32f40f12a65ba9f2b1d87f7499fae590fea231cf2dc149134"} Sep 15 09:15:13.994597 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.994555 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-btkc9" event={"ID":"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf","Type":"ContainerStarted","Data":"80b186823d06c1bcdaf0566ce0fcd51898fcf8267b0736ade2e341b98e34ee55"} Sep 15 09:15:13.996081 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.996056 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" event={"ID":"f03148de-9805-4f67-8fb7-2ba911accd06","Type":"ContainerStarted","Data":"b737ecc6b9e297ade2f07667aa837592be6271e314807a53403730eb34d54685"} Sep 15 09:15:13.997523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.997497 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8s2p" event={"ID":"abe08162-7133-43f5-b5d4-c4db416ecab3","Type":"ContainerStarted","Data":"3d5d500705e67c3a50657ae43174be6ffb18902b659245e047f2deefc5395c28"} Sep 15 09:15:13.999120 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:13.999068 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v4rkp" event={"ID":"0f58ca49-d00b-4740-8ca4-96e5f1836bb0","Type":"ContainerStarted","Data":"c1e666fb475beaa8a8d20548b53c8f1f8df94d908698cddcec43a13f3eea87c6"} Sep 15 09:15:14.001578 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:14.001511 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" event={"ID":"5d63bbad-f561-4ca9-88e8-cf715a6f0a03","Type":"ContainerStarted","Data":"7cf5a8cbd25e1ed93bd008a56f8b00922502bb51e477b23e49ce66187899d7c9"} Sep 15 09:15:14.003067 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:14.002978 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" event={"ID":"824cffcb-a109-4605-917b-4224320c952a","Type":"ContainerStarted","Data":"26e8da7c68f95442f6b55f3a6e0357116e5896419cc28e7fb8b8d65cdf1f2fc4"} Sep 15 09:15:14.536417 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:14.536365 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:14.536590 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:14.536545 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:14.536665 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:14.536612 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret podName:e9e36a2a-23f0-4257-8685-1d9349789349 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:16.536593585 +0000 UTC m=+6.043171019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret") pod "global-pull-secret-syncer-4wbhf" (UID: "e9e36a2a-23f0-4257-8685-1d9349789349") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:14.637176 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:14.637136 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:14.637344 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:14.637289 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:14.637447 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:14.637352 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs podName:e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:16.637335542 +0000 UTC m=+6.143912972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs") pod "network-metrics-daemon-kl7xm" (UID: "e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:14.738145 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:14.738108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79l5\" (UniqueName: \"kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5\") pod \"network-check-target-5qt48\" (UID: \"db4dddf9-4ec7-4b46-8f22-e508adeddc95\") " pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:14.738340 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:14.738309 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:14.738340 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:14.738331 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:14.738483 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:14.738343 2566 projected.go:196] Error preparing data for projected volume kube-api-access-m79l5 for pod openshift-network-diagnostics/network-check-target-5qt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:14.738483 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:14.738414 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5 podName:db4dddf9-4ec7-4b46-8f22-e508adeddc95 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:16.738383845 +0000 UTC m=+6.244961266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m79l5" (UniqueName: "kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5") pod "network-check-target-5qt48" (UID: "db4dddf9-4ec7-4b46-8f22-e508adeddc95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:14.957626 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:14.957554 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:10:13 +0000 UTC" deadline="2028-04-16 13:13:48.614361015 +0000 UTC" Sep 15 09:15:14.957626 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:14.957595 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13899h58m33.656771227s" Sep 15 09:15:14.971749 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:14.969204 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:14.971749 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:14.969325 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:14.971749 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:14.971588 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:14.971749 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:14.971685 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:15.970387 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:15.969635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:15.970387 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:15.969760 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:16.025893 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:16.025280 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal" event={"ID":"3a44f61a74ce15f38275564d7d0ce773","Type":"ContainerStarted","Data":"1755330dfef5cc14e93e977661a0108a7f3bfb560265d947eccf582382dc05c7"} Sep 15 09:15:16.554309 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:16.553752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:16.554309 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:16.553887 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:16.554309 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:16.553945 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret podName:e9e36a2a-23f0-4257-8685-1d9349789349 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:20.553926914 +0000 UTC m=+10.060504335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret") pod "global-pull-secret-syncer-4wbhf" (UID: "e9e36a2a-23f0-4257-8685-1d9349789349") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:16.655287 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:16.654713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:16.655287 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:16.654869 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:16.655287 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:16.654928 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs podName:e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:20.654909892 +0000 UTC m=+10.161487330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs") pod "network-metrics-daemon-kl7xm" (UID: "e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:16.755641 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:16.755606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79l5\" (UniqueName: \"kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5\") pod \"network-check-target-5qt48\" (UID: \"db4dddf9-4ec7-4b46-8f22-e508adeddc95\") " pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:16.755818 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:16.755788 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:16.755818 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:16.755807 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:16.755941 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:16.755820 2566 projected.go:196] Error preparing data for projected volume kube-api-access-m79l5 for pod openshift-network-diagnostics/network-check-target-5qt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:16.755941 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:16.755878 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5 podName:db4dddf9-4ec7-4b46-8f22-e508adeddc95 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:20.755859823 +0000 UTC m=+10.262437243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m79l5" (UniqueName: "kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5") pod "network-check-target-5qt48" (UID: "db4dddf9-4ec7-4b46-8f22-e508adeddc95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:16.971115 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:16.971085 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:16.971582 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:16.971215 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:16.971657 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:16.971592 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:16.971706 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:16.971680 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:17.035303 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:17.034391 2566 generic.go:356] "Generic (PLEG): container finished" podID="887e7c7c9aa7907ed56753bebfb85efa" containerID="c4a2fc28b22271238b73f98cee3776f9f5f1a7ce937f34a9c1a4944ef527af19" exitCode=0 Sep 15 09:15:17.035303 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:17.034497 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" event={"ID":"887e7c7c9aa7907ed56753bebfb85efa","Type":"ContainerDied","Data":"c4a2fc28b22271238b73f98cee3776f9f5f1a7ce937f34a9c1a4944ef527af19"} Sep 15 09:15:17.053051 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:17.051859 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-158.ec2.internal" podStartSLOduration=5.051838907 podStartE2EDuration="5.051838907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:16.040607853 +0000 UTC m=+5.547185292" watchObservedRunningTime="2026-09-15 09:15:17.051838907 +0000 UTC m=+6.558416346" Sep 15 09:15:17.969565 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:17.969532 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:17.969757 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:17.969652 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:18.973460 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:18.973435 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:18.973916 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:18.973436 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:18.973916 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:18.973551 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:18.973916 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:18.973647 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:19.969339 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:19.969285 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:19.969555 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:19.969452 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:20.589229 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:20.589032 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:20.589229 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:20.589190 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:20.589720 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:20.589260 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret podName:e9e36a2a-23f0-4257-8685-1d9349789349 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:28.589240913 +0000 UTC m=+18.095818331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret") pod "global-pull-secret-syncer-4wbhf" (UID: "e9e36a2a-23f0-4257-8685-1d9349789349") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:20.689990 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:20.689953 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:20.690144 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:20.690088 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:20.690207 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:20.690153 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs podName:e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:28.690135268 +0000 UTC m=+18.196712689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs") pod "network-metrics-daemon-kl7xm" (UID: "e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:20.790949 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:20.790890 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79l5\" (UniqueName: \"kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5\") pod \"network-check-target-5qt48\" (UID: \"db4dddf9-4ec7-4b46-8f22-e508adeddc95\") " pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:20.791145 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:20.791078 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:20.791145 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:20.791103 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:20.791145 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:20.791116 2566 projected.go:196] Error preparing data for projected volume kube-api-access-m79l5 for pod openshift-network-diagnostics/network-check-target-5qt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:20.791303 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:20.791185 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5 podName:db4dddf9-4ec7-4b46-8f22-e508adeddc95 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:28.791163039 +0000 UTC m=+18.297740473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m79l5" (UniqueName: "kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5") pod "network-check-target-5qt48" (UID: "db4dddf9-4ec7-4b46-8f22-e508adeddc95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:20.969126 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:20.968925 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:20.970094 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:20.970046 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:20.970423 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:20.970377 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:20.973238 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:20.973209 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:21.969552 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:21.969056 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:21.969552 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:21.969175 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:22.969212 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:22.969175 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:22.969441 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:22.969318 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:22.969605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:22.969576 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:22.969996 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:22.969712 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:23.969118 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:23.969084 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:23.969285 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:23.969209 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:24.969145 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:24.969109 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:24.969625 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:24.969109 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:24.969625 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:24.969263 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:24.969625 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:24.969380 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:25.969502 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:25.969461 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:25.969942 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:25.969584 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:26.969684 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:26.969651 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:26.970088 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:26.969784 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:26.970088 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:26.969845 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:26.970088 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:26.969957 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:27.969155 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:27.969043 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:27.969367 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:27.969176 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:28.646559 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:28.646521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:28.647039 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:28.646713 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:28.647039 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:28.646787 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret podName:e9e36a2a-23f0-4257-8685-1d9349789349 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:44.646765175 +0000 UTC m=+34.153342594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret") pod "global-pull-secret-syncer-4wbhf" (UID: "e9e36a2a-23f0-4257-8685-1d9349789349") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:28.747135 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:28.747100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:28.747292 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:28.747231 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:28.747351 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:28.747298 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs podName:e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:44.747280135 +0000 UTC m=+34.253857550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs") pod "network-metrics-daemon-kl7xm" (UID: "e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:28.848319 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:28.848282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79l5\" (UniqueName: \"kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5\") pod \"network-check-target-5qt48\" (UID: \"db4dddf9-4ec7-4b46-8f22-e508adeddc95\") " pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:28.848490 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:28.848417 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:28.848490 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:28.848434 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:28.848490 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:28.848444 2566 projected.go:196] Error preparing data for projected volume kube-api-access-m79l5 for pod openshift-network-diagnostics/network-check-target-5qt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:28.848618 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:28.848505 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5 podName:db4dddf9-4ec7-4b46-8f22-e508adeddc95 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:44.848487642 +0000 UTC m=+34.355065062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m79l5" (UniqueName: "kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5") pod "network-check-target-5qt48" (UID: "db4dddf9-4ec7-4b46-8f22-e508adeddc95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:28.969102 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:28.969068 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:28.969268 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:28.969196 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:28.969268 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:28.969249 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:28.969360 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:28.969308 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:29.968899 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:29.968867 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:29.969354 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:29.968990 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:30.969623 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:30.969595 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:30.969967 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:30.969685 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:30.969967 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:30.969772 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:30.969967 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:30.969862 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:31.969061 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:31.968909 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:31.969182 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:31.969151 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:32.067451 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.067347 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" event={"ID":"887e7c7c9aa7907ed56753bebfb85efa","Type":"ContainerStarted","Data":"846df717b5eb5807b75a60f54016b46439cd98128ae82ea17345560910653627"} Sep 15 09:15:32.070785 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.070742 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" event={"ID":"824cffcb-a109-4605-917b-4224320c952a","Type":"ContainerStarted","Data":"e7ae02b3df34c239bf1bdae95f86f2bca6a054f82a38a72ade9efdb2bc241301"} Sep 15 09:15:32.070896 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.070833 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" event={"ID":"824cffcb-a109-4605-917b-4224320c952a","Type":"ContainerStarted","Data":"676b063a460753108db497d6a2eaa282670be8c521d2bb9a4b5d100089666622"} Sep 15 09:15:32.070896 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.070885 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" event={"ID":"824cffcb-a109-4605-917b-4224320c952a","Type":"ContainerStarted","Data":"cd958d9e568e7f015572ac16ffecc274b1db9933621a4b9c6fb3ef97e76fe367"} Sep 15 09:15:32.070981 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.070936 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" event={"ID":"824cffcb-a109-4605-917b-4224320c952a","Type":"ContainerStarted","Data":"dec459ef33a2e6a62b62eefe222ad7c86de0543654f1e61e5e5b80e2d203b4c7"} Sep 15 09:15:32.071021 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.070983 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" event={"ID":"824cffcb-a109-4605-917b-4224320c952a","Type":"ContainerStarted","Data":"2f0123406370fcbce27ead2caa8fe48b7c5b268da1cc81c6ce3ce5cb2d175050"} Sep 15 09:15:32.071056 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.071034 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" event={"ID":"824cffcb-a109-4605-917b-4224320c952a","Type":"ContainerStarted","Data":"b90cc86b9c89ca005d5850b020ce208b9a7973b0638ae5d651977f12591009a4"} Sep 15 09:15:32.072472 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.072443 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xqg97" event={"ID":"52e1c8dc-6067-4995-9433-c631cce937cc","Type":"ContainerStarted","Data":"bdfeba909da41ffc876971ab1d7c3a3b9a933f3782d21b0527c7dac15c5d3c9a"} Sep 15 09:15:32.073888 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.073862 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" event={"ID":"627bf239-bde8-4671-ae9c-3e59d0f8faa7","Type":"ContainerStarted","Data":"fbdedba2e3cc22be65369a681acdecd9d73e613612eb21a7c2962afacc6fed94"} Sep 15 09:15:32.075471 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.075435 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-btkc9" event={"ID":"1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf","Type":"ContainerStarted","Data":"fcece8df9a4247cb4af7f49eba58f32b8d0be985088c39cffb8c688b33d61265"} Sep 15 09:15:32.077315 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.077293 2566 generic.go:356] "Generic (PLEG): container finished" podID="f03148de-9805-4f67-8fb7-2ba911accd06" containerID="9db5b2472f81eb66765be653b5f0fe0ede9d16c2c7f43c0956afc4c9dd061293" exitCode=0 Sep 15 09:15:32.077428 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.077368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" event={"ID":"f03148de-9805-4f67-8fb7-2ba911accd06","Type":"ContainerDied","Data":"9db5b2472f81eb66765be653b5f0fe0ede9d16c2c7f43c0956afc4c9dd061293"} Sep 15 09:15:32.079120 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.079095 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8s2p" event={"ID":"abe08162-7133-43f5-b5d4-c4db416ecab3","Type":"ContainerStarted","Data":"a4bd1866849a8464c88bed9dcf7280776d86dbbca22f91c09ee558c907a35ac7"} Sep 15 09:15:32.080799 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.080755 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v4rkp" event={"ID":"0f58ca49-d00b-4740-8ca4-96e5f1836bb0","Type":"ContainerStarted","Data":"2bfc4665b92341ea1d6c10cc792d1387e1083cc39cea7bd7fb9cd3e6a52701dc"} Sep 15 09:15:32.082707 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.082500 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" event={"ID":"5d63bbad-f561-4ca9-88e8-cf715a6f0a03","Type":"ContainerStarted","Data":"8f0826b127f7964777d4a896a8a28d3ae7592d0562373b3d8dcb5f2e0df185df"} Sep 15 09:15:32.098854 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.098811 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-btkc9" podStartSLOduration=3.074171787 podStartE2EDuration="21.098799344s" totalImagesPullingTime="18.024627557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:32.098373432 +0000 UTC m=+21.604950860" watchObservedRunningTime="2026-09-15 09:15:32.098799344 +0000 UTC m=+21.605376780" Sep 15 09:15:32.099036 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.099017 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-158.ec2.internal" podStartSLOduration=20.099011577 podStartE2EDuration="20.099011577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:32.082760705 +0000 UTC m=+21.589338146" watchObservedRunningTime="2026-09-15 09:15:32.099011577 +0000 UTC m=+21.605589014" Sep 15 09:15:32.116506 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.116473 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ncxjn" podStartSLOduration=3.091542061 podStartE2EDuration="21.116458302s" totalImagesPullingTime="18.024916241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:32.116430937 +0000 UTC m=+21.623008373" watchObservedRunningTime="2026-09-15 09:15:32.116458302 +0000 UTC m=+21.623035739" Sep 15 09:15:32.157071 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.157039 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v4rkp" podStartSLOduration=3.168932607 podStartE2EDuration="21.157028699s" totalImagesPullingTime="17.988096092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:32.156650928 +0000 UTC m=+21.663228364" watchObservedRunningTime="2026-09-15 09:15:32.157028699 +0000 UTC m=+21.663606135" Sep 15 09:15:32.193293 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.193260 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xqg97" podStartSLOduration=3.246954145 podStartE2EDuration="21.193249464s" totalImagesPullingTime="17.946295319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:32.19303592 +0000 UTC m=+21.699613356" watchObservedRunningTime="2026-09-15 09:15:32.193249464 +0000 UTC m=+21.699826903" Sep 15 09:15:32.193617 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.193597 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l8s2p" podStartSLOduration=6.985631684 podStartE2EDuration="21.19358997s" totalImagesPullingTime="14.207958286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:32.176537962 +0000 UTC m=+21.683115398" watchObservedRunningTime="2026-09-15 09:15:32.19358997 +0000 UTC m=+21.700167407" Sep 15 09:15:32.605151 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.605122 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 15 09:15:32.969352 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.969323 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:32.969540 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:32.969458 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:32.969607 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.969553 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:32.969683 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:32.969657 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:32.975093 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.975023 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T09:15:32.605142697Z","UUID":"a1d8ea27-7b3c-435d-a404-c323b6172af9","Handler":null,"Name":"","Endpoint":""} Sep 15 09:15:32.976306 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.976290 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 15 09:15:32.976392 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:32.976317 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 15 09:15:33.086376 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:33.086340 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g66b8" event={"ID":"ed9b06ef-3480-4265-8056-5d8c8ec1c4b5","Type":"ContainerStarted","Data":"45141e18443ca10c09c340f7835ab8fcbb94f3662a33e669d3cd1c5d00839f1a"} Sep 15 09:15:33.088457 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:33.088425 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" event={"ID":"627bf239-bde8-4671-ae9c-3e59d0f8faa7","Type":"ContainerStarted","Data":"ce38718c6fba7b587b96b223c39871740b2bcd0e4df243872260e13e366f5021"} Sep 15 09:15:33.101252 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:33.101206 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g66b8" podStartSLOduration=4.168190516 podStartE2EDuration="22.101192537s" totalImagesPullingTime="17.933002021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:33.100729033 +0000 UTC m=+22.607306471" watchObservedRunningTime="2026-09-15 09:15:33.101192537 +0000 UTC m=+22.607769973" Sep 15 09:15:33.969172 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:33.969140 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:33.969365 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:33.969263 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:34.095965 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:34.095724 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" event={"ID":"824cffcb-a109-4605-917b-4224320c952a","Type":"ContainerStarted","Data":"3fb2434df8a2d91f17e54ff21b48288a246be099285fb722c6023e4998df808a"} Sep 15 09:15:34.494038 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:34.494003 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:34.495108 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:34.495072 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:34.968908 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:34.968875 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:34.969091 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:34.968876 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:34.969091 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:34.969002 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:34.969204 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:34.969109 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:35.100231 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:35.100193 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" event={"ID":"627bf239-bde8-4671-ae9c-3e59d0f8faa7","Type":"ContainerStarted","Data":"8ff6a4ab35ff0d9fbc78da8f1e5f09d96a9e1723d0e9c890a5657224813f7a32"} Sep 15 09:15:35.100665 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:35.100475 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:35.100977 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:35.100950 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xqg97" Sep 15 09:15:35.118589 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:35.118547 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpmqv" podStartSLOduration=3.650659506 podStartE2EDuration="24.118534006s" totalImagesPullingTime="20.4678745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:35.118381302 +0000 UTC m=+24.624958740" watchObservedRunningTime="2026-09-15 09:15:35.118534006 +0000 UTC m=+24.625111442" Sep 15 09:15:35.969854 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:35.969826 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:35.970011 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:35.969925 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:36.969757 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:36.969588 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:36.970155 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:36.969590 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:36.970155 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:36.969836 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:36.970155 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:36.969924 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:37.106133 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:37.106098 2566 generic.go:356] "Generic (PLEG): container finished" podID="f03148de-9805-4f67-8fb7-2ba911accd06" containerID="890d9af40b1951d244507bd4d06e95ba97865cc142e724adb75dea4063fc3106" exitCode=0 Sep 15 09:15:37.106274 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:37.106183 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" event={"ID":"f03148de-9805-4f67-8fb7-2ba911accd06","Type":"ContainerDied","Data":"890d9af40b1951d244507bd4d06e95ba97865cc142e724adb75dea4063fc3106"} Sep 15 09:15:37.110014 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:37.109991 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" event={"ID":"824cffcb-a109-4605-917b-4224320c952a","Type":"ContainerStarted","Data":"0f1cbf494ce9c60dcc0cc9381d8eb4656923ed57bfbc6affc76bf91a1e17563c"} Sep 15 09:15:37.153859 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:37.153811 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" podStartSLOduration=7.873878528 podStartE2EDuration="26.153797613s" totalImagesPullingTime="18.279919085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:37.153253527 +0000 UTC m=+26.659830964" watchObservedRunningTime="2026-09-15 09:15:37.153797613 +0000 UTC m=+26.660375049" Sep 15 09:15:37.969839 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:37.969810 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:37.970380 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:37.969916 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:38.112693 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.112669 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:38.112799 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.112756 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:38.112852 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.112805 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:38.127828 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.127805 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:38.128021 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.128008 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:15:38.477876 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.477839 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4wbhf"] Sep 15 09:15:38.478014 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.477932 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:38.478062 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:38.478040 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:38.481346 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.481323 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5qt48"] Sep 15 09:15:38.481458 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.481442 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:38.481562 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:38.481536 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:38.481934 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.481913 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kl7xm"] Sep 15 09:15:38.482011 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:38.482000 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:38.482101 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:38.482086 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:39.116263 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:39.116226 2566 generic.go:356] "Generic (PLEG): container finished" podID="f03148de-9805-4f67-8fb7-2ba911accd06" containerID="6ce64bfaa78b3b4485eded51453f927d317d8d2f615007ccd0a663a64f5df1c3" exitCode=0 Sep 15 09:15:39.116904 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:39.116312 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" event={"ID":"f03148de-9805-4f67-8fb7-2ba911accd06","Type":"ContainerDied","Data":"6ce64bfaa78b3b4485eded51453f927d317d8d2f615007ccd0a663a64f5df1c3"} Sep 15 09:15:39.969072 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:39.969045 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:39.969168 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:39.969151 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:39.969225 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:39.969205 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:39.969311 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:39.969295 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:40.120663 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:40.120620 2566 generic.go:356] "Generic (PLEG): container finished" podID="f03148de-9805-4f67-8fb7-2ba911accd06" containerID="fe874878e97218e22b789407cd36fe08943133b67c2106366df1f64b7cc05749" exitCode=0 Sep 15 09:15:40.121108 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:40.120697 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" event={"ID":"f03148de-9805-4f67-8fb7-2ba911accd06","Type":"ContainerDied","Data":"fe874878e97218e22b789407cd36fe08943133b67c2106366df1f64b7cc05749"} Sep 15 09:15:40.970105 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:40.969906 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:40.970289 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:40.970210 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:41.968924 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:41.968893 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:41.969491 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:41.968901 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:41.969491 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:41.969021 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:41.969491 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:41.969062 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:42.969697 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:42.969667 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:42.970072 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:42.969778 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7xm" podUID="e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7" Sep 15 09:15:43.969335 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:43.969308 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:43.969505 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:43.969305 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:43.969505 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:43.969458 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wbhf" podUID="e9e36a2a-23f0-4257-8685-1d9349789349" Sep 15 09:15:43.969609 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:43.969510 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qt48" podUID="db4dddf9-4ec7-4b46-8f22-e508adeddc95" Sep 15 09:15:44.308285 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.308250 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-158.ec2.internal" event="NodeReady" Sep 15 09:15:44.308699 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.308394 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 15 09:15:44.343300 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.343267 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-759f8bb9f-69kv8"] Sep 15 09:15:44.371780 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.371744 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gvzkl"] Sep 15 09:15:44.371933 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.371867 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.374437 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.374014 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 15 09:15:44.374437 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.374148 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 15 09:15:44.374437 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.374263 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tcq7t\"" Sep 15 09:15:44.374437 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.374380 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 15 09:15:44.385298 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.385269 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6d885"] Sep 15 09:15:44.385447 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.385396 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.387644 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.387624 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 15 09:15:44.387750 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.387660 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 15 09:15:44.387750 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.387684 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s9fcs\"" Sep 15 09:15:44.393354 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.393332 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 15 09:15:44.403740 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.403709 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-759f8bb9f-69kv8"] Sep 15 09:15:44.403840 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.403745 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvzkl"] Sep 15 09:15:44.403840 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.403776 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6d885"] Sep 15 09:15:44.403929 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.403856 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6d885" Sep 15 09:15:44.406300 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.406173 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vp2jx\"" Sep 15 09:15:44.406300 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.406185 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 15 09:15:44.406507 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.406304 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 15 09:15:44.406507 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.406455 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 15 09:15:44.470003 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.469938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-image-registry-private-configuration\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.470003 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.469982 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d665a621-12af-4879-bd99-7778907928c7-ca-trust-extracted\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.470158 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.470010 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-installation-pull-secrets\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.470158 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.470069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ac81511-86aa-4d8d-a67b-683277287dfc-config-volume\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.470158 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.470098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.470158 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.470125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-registry-certificates\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.470328 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.470173 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.470328 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.470203 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-trusted-ca\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.470328 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.470239 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-bound-sa-token\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.470328 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.470274 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdbpc\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-kube-api-access-cdbpc\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.470328 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.470314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac81511-86aa-4d8d-a67b-683277287dfc-tmp-dir\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.470541 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.470339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggl2w\" (UniqueName: \"kubernetes.io/projected/1ac81511-86aa-4d8d-a67b-683277287dfc-kube-api-access-ggl2w\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.489569 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.489539 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xqg97_52e1c8dc-6067-4995-9433-c631cce937cc/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:44.571438 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ac81511-86aa-4d8d-a67b-683277287dfc-config-volume\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.571438 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571442 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.571657 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-registry-certificates\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.571657 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571531 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.571657 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-trusted-ca\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.571657 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.571565 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:15:44.571657 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.571648 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls podName:1ac81511-86aa-4d8d-a67b-683277287dfc nodeName:}" failed. No retries permitted until 2026-09-15 09:15:45.071625164 +0000 UTC m=+34.578202600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls") pod "dns-default-gvzkl" (UID: "1ac81511-86aa-4d8d-a67b-683277287dfc") : secret "dns-default-metrics-tls" not found Sep 15 09:15:44.571914 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.571686 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 09:15:44.571914 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.571705 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759f8bb9f-69kv8: secret "image-registry-tls" not found Sep 15 09:15:44.571914 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.571758 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls podName:d665a621-12af-4879-bd99-7778907928c7 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:45.071740137 +0000 UTC m=+34.578317574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls") pod "image-registry-759f8bb9f-69kv8" (UID: "d665a621-12af-4879-bd99-7778907928c7") : secret "image-registry-tls" not found Sep 15 09:15:44.571914 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-bound-sa-token\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.571914 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbpc\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-kube-api-access-cdbpc\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.571914 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571849 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac81511-86aa-4d8d-a67b-683277287dfc-tmp-dir\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.571914 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx2nh\" (UniqueName: \"kubernetes.io/projected/0e93a76c-8324-4681-8b94-a454ec734a22-kube-api-access-bx2nh\") pod \"ingress-canary-6d885\" (UID: \"0e93a76c-8324-4681-8b94-a454ec734a22\") " pod="openshift-ingress-canary/ingress-canary-6d885" Sep 15 09:15:44.571914 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571912 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggl2w\" (UniqueName: \"kubernetes.io/projected/1ac81511-86aa-4d8d-a67b-683277287dfc-kube-api-access-ggl2w\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.572293 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.571977 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-image-registry-private-configuration\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.572293 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.572004 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d665a621-12af-4879-bd99-7778907928c7-ca-trust-extracted\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.572293 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.572031 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-installation-pull-secrets\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.572293 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.572057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e93a76c-8324-4681-8b94-a454ec734a22-cert\") pod \"ingress-canary-6d885\" (UID: \"0e93a76c-8324-4681-8b94-a454ec734a22\") " pod="openshift-ingress-canary/ingress-canary-6d885" Sep 15 09:15:44.572293 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.572003 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ac81511-86aa-4d8d-a67b-683277287dfc-config-volume\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.572293 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.572172 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-registry-certificates\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.572293 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.572253 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac81511-86aa-4d8d-a67b-683277287dfc-tmp-dir\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.572601 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.572323 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d665a621-12af-4879-bd99-7778907928c7-ca-trust-extracted\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.572601 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.572482 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-trusted-ca\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.576180 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.576160 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-installation-pull-secrets\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.576313 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.576183 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-image-registry-private-configuration\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.581973 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.581948 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-bound-sa-token\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.582334 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.582309 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdbpc\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-kube-api-access-cdbpc\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:44.582763 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.582748 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggl2w\" (UniqueName: \"kubernetes.io/projected/1ac81511-86aa-4d8d-a67b-683277287dfc-kube-api-access-ggl2w\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:44.609521 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.609488 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xqg97_52e1c8dc-6067-4995-9433-c631cce937cc/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:44.673396 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.673365 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e93a76c-8324-4681-8b94-a454ec734a22-cert\") pod \"ingress-canary-6d885\" (UID: \"0e93a76c-8324-4681-8b94-a454ec734a22\") " pod="openshift-ingress-canary/ingress-canary-6d885" Sep 15 09:15:44.673548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.673501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx2nh\" (UniqueName: \"kubernetes.io/projected/0e93a76c-8324-4681-8b94-a454ec734a22-kube-api-access-bx2nh\") pod \"ingress-canary-6d885\" (UID: \"0e93a76c-8324-4681-8b94-a454ec734a22\") " pod="openshift-ingress-canary/ingress-canary-6d885" Sep 15 09:15:44.673548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.673540 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:44.673635 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.673622 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:44.673708 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.673696 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret podName:e9e36a2a-23f0-4257-8685-1d9349789349 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:16.673678823 +0000 UTC m=+66.180256256 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret") pod "global-pull-secret-syncer-4wbhf" (UID: "e9e36a2a-23f0-4257-8685-1d9349789349") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:44.675887 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.675866 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e93a76c-8324-4681-8b94-a454ec734a22-cert\") pod \"ingress-canary-6d885\" (UID: \"0e93a76c-8324-4681-8b94-a454ec734a22\") " pod="openshift-ingress-canary/ingress-canary-6d885" Sep 15 09:15:44.681432 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.681379 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx2nh\" (UniqueName: \"kubernetes.io/projected/0e93a76c-8324-4681-8b94-a454ec734a22-kube-api-access-bx2nh\") pod \"ingress-canary-6d885\" (UID: \"0e93a76c-8324-4681-8b94-a454ec734a22\") " pod="openshift-ingress-canary/ingress-canary-6d885" Sep 15 09:15:44.713557 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.713535 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6d885" Sep 15 09:15:44.774131 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.774096 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:44.774266 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.774247 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:44.774334 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.774316 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs podName:e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:16.774300964 +0000 UTC m=+66.280878382 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs") pod "network-metrics-daemon-kl7xm" (UID: "e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:44.874945 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.874856 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79l5\" (UniqueName: \"kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5\") pod \"network-check-target-5qt48\" (UID: \"db4dddf9-4ec7-4b46-8f22-e508adeddc95\") " pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:44.875129 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.875008 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:44.875129 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.875035 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:44.875129 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.875049 2566 projected.go:196] Error preparing data for projected volume kube-api-access-m79l5 for pod openshift-network-diagnostics/network-check-target-5qt48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:44.875287 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:44.875141 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5 podName:db4dddf9-4ec7-4b46-8f22-e508adeddc95 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:16.875125158 +0000 UTC m=+66.381702592 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m79l5" (UniqueName: "kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5") pod "network-check-target-5qt48" (UID: "db4dddf9-4ec7-4b46-8f22-e508adeddc95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:44.969455 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.969418 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:15:44.972153 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.972122 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 09:15:44.972153 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:44.972137 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g6g5g\"" Sep 15 09:15:45.076959 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:45.076882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:45.076959 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:45.076943 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:45.077166 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:45.077035 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 09:15:45.077166 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:45.077043 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:15:45.077166 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:45.077105 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls podName:1ac81511-86aa-4d8d-a67b-683277287dfc nodeName:}" failed. No retries permitted until 2026-09-15 09:15:46.077090593 +0000 UTC m=+35.583668008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls") pod "dns-default-gvzkl" (UID: "1ac81511-86aa-4d8d-a67b-683277287dfc") : secret "dns-default-metrics-tls" not found Sep 15 09:15:45.077166 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:45.077046 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759f8bb9f-69kv8: secret "image-registry-tls" not found Sep 15 09:15:45.077293 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:45.077170 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls podName:d665a621-12af-4879-bd99-7778907928c7 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:46.077157489 +0000 UTC m=+35.583734903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls") pod "image-registry-759f8bb9f-69kv8" (UID: "d665a621-12af-4879-bd99-7778907928c7") : secret "image-registry-tls" not found Sep 15 09:15:45.397297 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:45.397228 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6d885"] Sep 15 09:15:45.432539 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:15:45.432512 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e93a76c_8324_4681_8b94_a454ec734a22.slice/crio-5f52a937839be727bba91e848137cd7bf6c9e193df31800bb02c3aae24e5c26c WatchSource:0}: Error finding container 5f52a937839be727bba91e848137cd7bf6c9e193df31800bb02c3aae24e5c26c: Status 404 returned error can't find the container with id 5f52a937839be727bba91e848137cd7bf6c9e193df31800bb02c3aae24e5c26c Sep 15 09:15:45.969245 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:45.969038 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:15:45.969482 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:45.969038 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:15:45.971570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:45.971543 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 09:15:45.971570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:45.971556 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 09:15:45.971731 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:45.971597 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 09:15:45.971731 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:45.971692 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wk2jz\"" Sep 15 09:15:46.083099 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:46.083078 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:46.083223 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:46.083124 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:46.083264 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:46.083230 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:15:46.083332 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:46.083318 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls podName:1ac81511-86aa-4d8d-a67b-683277287dfc nodeName:}" failed. No retries permitted until 2026-09-15 09:15:48.08330263 +0000 UTC m=+37.589880049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls") pod "dns-default-gvzkl" (UID: "1ac81511-86aa-4d8d-a67b-683277287dfc") : secret "dns-default-metrics-tls" not found Sep 15 09:15:46.083332 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:46.083230 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 09:15:46.083440 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:46.083340 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759f8bb9f-69kv8: secret "image-registry-tls" not found Sep 15 09:15:46.083440 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:46.083368 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls podName:d665a621-12af-4879-bd99-7778907928c7 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:48.083360972 +0000 UTC m=+37.589938387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls") pod "image-registry-759f8bb9f-69kv8" (UID: "d665a621-12af-4879-bd99-7778907928c7") : secret "image-registry-tls" not found Sep 15 09:15:46.138226 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:46.138202 2566 generic.go:356] "Generic (PLEG): container finished" podID="f03148de-9805-4f67-8fb7-2ba911accd06" containerID="e94fdf4725e7c2e8ce6cde102f2045ff60e90ed5403f62e6a4d893f64f0c60f7" exitCode=0 Sep 15 09:15:46.138367 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:46.138279 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" event={"ID":"f03148de-9805-4f67-8fb7-2ba911accd06","Type":"ContainerDied","Data":"e94fdf4725e7c2e8ce6cde102f2045ff60e90ed5403f62e6a4d893f64f0c60f7"} Sep 15 09:15:46.139729 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:46.139706 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6d885" event={"ID":"0e93a76c-8324-4681-8b94-a454ec734a22","Type":"ContainerStarted","Data":"5f52a937839be727bba91e848137cd7bf6c9e193df31800bb02c3aae24e5c26c"} Sep 15 09:15:47.144908 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:47.144874 2566 generic.go:356] "Generic (PLEG): container finished" podID="f03148de-9805-4f67-8fb7-2ba911accd06" containerID="6a16fb640e89cc5192fb14097536b9f991f248c29b1ebd64405ed4b21eb4658d" exitCode=0 Sep 15 09:15:47.145440 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:47.144925 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" event={"ID":"f03148de-9805-4f67-8fb7-2ba911accd06","Type":"ContainerDied","Data":"6a16fb640e89cc5192fb14097536b9f991f248c29b1ebd64405ed4b21eb4658d"} Sep 15 09:15:48.099948 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:48.099907 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:48.100111 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:48.100003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:48.100111 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:48.100056 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:15:48.100193 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:48.100120 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls podName:1ac81511-86aa-4d8d-a67b-683277287dfc nodeName:}" failed. No retries permitted until 2026-09-15 09:15:52.100106288 +0000 UTC m=+41.606683702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls") pod "dns-default-gvzkl" (UID: "1ac81511-86aa-4d8d-a67b-683277287dfc") : secret "dns-default-metrics-tls" not found Sep 15 09:15:48.100193 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:48.100138 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 09:15:48.100193 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:48.100153 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759f8bb9f-69kv8: secret "image-registry-tls" not found Sep 15 09:15:48.100300 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:48.100218 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls podName:d665a621-12af-4879-bd99-7778907928c7 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:52.10020219 +0000 UTC m=+41.606779610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls") pod "image-registry-759f8bb9f-69kv8" (UID: "d665a621-12af-4879-bd99-7778907928c7") : secret "image-registry-tls" not found Sep 15 09:15:48.150467 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:48.150438 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" event={"ID":"f03148de-9805-4f67-8fb7-2ba911accd06","Type":"ContainerStarted","Data":"60b6ea2d5274ba4c137b8e8fed2e987baf71502f7b7b1c7f8157ad0c6a7b7f49"} Sep 15 09:15:48.173191 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:48.173145 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wqqj2" podStartSLOduration=7.60136263 podStartE2EDuration="37.173130579s" totalImagesPullingTime="29.571767949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:48.17178872 +0000 UTC m=+37.678366157" watchObservedRunningTime="2026-09-15 09:15:48.173130579 +0000 UTC m=+37.679708017" Sep 15 09:15:49.154257 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:49.154219 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6d885" event={"ID":"0e93a76c-8324-4681-8b94-a454ec734a22","Type":"ContainerStarted","Data":"6bd6e9939459d21c8adf0c8c5c03827bd5f563c1b70fc6f76b73337b032b7ce2"} Sep 15 09:15:49.170785 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:49.170742 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6d885" podStartSLOduration=2.270868269 podStartE2EDuration="5.170726599s" totalImagesPullingTime="2.89985833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:49.170268059 +0000 UTC m=+38.676845497" watchObservedRunningTime="2026-09-15 09:15:49.170726599 +0000 UTC m=+38.677304035" Sep 15 09:15:52.131395 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:52.131347 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:15:52.131762 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:15:52.131433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:15:52.131762 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:52.131505 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:15:52.131762 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:52.131551 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 09:15:52.131762 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:52.131564 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759f8bb9f-69kv8: secret "image-registry-tls" not found Sep 15 09:15:52.131762 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:52.131569 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls podName:1ac81511-86aa-4d8d-a67b-683277287dfc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:00.131552802 +0000 UTC m=+49.638130218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls") pod "dns-default-gvzkl" (UID: "1ac81511-86aa-4d8d-a67b-683277287dfc") : secret "dns-default-metrics-tls" not found Sep 15 09:15:52.131762 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:15:52.131604 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls podName:d665a621-12af-4879-bd99-7778907928c7 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:00.131591922 +0000 UTC m=+49.638169337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls") pod "image-registry-759f8bb9f-69kv8" (UID: "d665a621-12af-4879-bd99-7778907928c7") : secret "image-registry-tls" not found Sep 15 09:16:00.186373 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:00.186334 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:16:00.186765 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:00.186389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:16:00.186765 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:00.186496 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:16:00.186765 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:00.186524 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 09:16:00.186765 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:00.186535 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759f8bb9f-69kv8: secret "image-registry-tls" not found Sep 15 09:16:00.186765 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:00.186554 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls podName:1ac81511-86aa-4d8d-a67b-683277287dfc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:16.18653879 +0000 UTC m=+65.693116206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls") pod "dns-default-gvzkl" (UID: "1ac81511-86aa-4d8d-a67b-683277287dfc") : secret "dns-default-metrics-tls" not found Sep 15 09:16:00.186765 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:00.186572 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls podName:d665a621-12af-4879-bd99-7778907928c7 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:16.186561392 +0000 UTC m=+65.693138808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls") pod "image-registry-759f8bb9f-69kv8" (UID: "d665a621-12af-4879-bd99-7778907928c7") : secret "image-registry-tls" not found Sep 15 09:16:10.131055 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:10.131022 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzqrf" Sep 15 09:16:16.198412 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.198368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:16:16.198810 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.198468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:16:16.198810 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:16.198545 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 09:16:16.198810 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:16.198571 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759f8bb9f-69kv8: secret "image-registry-tls" not found Sep 15 09:16:16.198810 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:16.198547 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:16:16.198810 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:16.198629 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls podName:1ac81511-86aa-4d8d-a67b-683277287dfc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:48.198610553 +0000 UTC m=+97.705187967 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls") pod "dns-default-gvzkl" (UID: "1ac81511-86aa-4d8d-a67b-683277287dfc") : secret "dns-default-metrics-tls" not found Sep 15 09:16:16.198810 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:16.198664 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls podName:d665a621-12af-4879-bd99-7778907928c7 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:48.198638204 +0000 UTC m=+97.705215619 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls") pod "image-registry-759f8bb9f-69kv8" (UID: "d665a621-12af-4879-bd99-7778907928c7") : secret "image-registry-tls" not found Sep 15 09:16:16.701149 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.701120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:16:16.703792 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.703775 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 09:16:16.714613 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.714587 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9e36a2a-23f0-4257-8685-1d9349789349-original-pull-secret\") pod \"global-pull-secret-syncer-4wbhf\" (UID: \"e9e36a2a-23f0-4257-8685-1d9349789349\") " pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:16:16.801810 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.801781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:16:16.804131 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.804113 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 09:16:16.812895 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:16.812877 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 15 09:16:16.812951 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:16.812934 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs podName:e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:17:20.812918231 +0000 UTC m=+130.319495647 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs") pod "network-metrics-daemon-kl7xm" (UID: "e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7") : secret "metrics-daemon-secret" not found Sep 15 09:16:16.879137 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.879107 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wbhf" Sep 15 09:16:16.902964 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.902940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79l5\" (UniqueName: \"kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5\") pod \"network-check-target-5qt48\" (UID: \"db4dddf9-4ec7-4b46-8f22-e508adeddc95\") " pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:16:16.905300 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.905282 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 09:16:16.916724 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.916699 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 09:16:16.928124 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:16.928067 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m79l5\" (UniqueName: \"kubernetes.io/projected/db4dddf9-4ec7-4b46-8f22-e508adeddc95-kube-api-access-m79l5\") pod \"network-check-target-5qt48\" (UID: \"db4dddf9-4ec7-4b46-8f22-e508adeddc95\") " pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:16:17.149331 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:17.149245 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4wbhf"] Sep 15 09:16:17.154792 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:16:17.154766 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e36a2a_23f0_4257_8685_1d9349789349.slice/crio-0e7adab3e25add7e84f079f59ffda2c7261623eeea547879007b17f2c5ba20a8 WatchSource:0}: Error finding container 0e7adab3e25add7e84f079f59ffda2c7261623eeea547879007b17f2c5ba20a8: Status 404 returned error can't find the container with id 0e7adab3e25add7e84f079f59ffda2c7261623eeea547879007b17f2c5ba20a8 Sep 15 09:16:17.185349 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:17.185330 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wk2jz\"" Sep 15 09:16:17.193151 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:17.193128 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:16:17.223999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:17.223965 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4wbhf" event={"ID":"e9e36a2a-23f0-4257-8685-1d9349789349","Type":"ContainerStarted","Data":"0e7adab3e25add7e84f079f59ffda2c7261623eeea547879007b17f2c5ba20a8"} Sep 15 09:16:17.459998 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:17.459969 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5qt48"] Sep 15 09:16:17.462798 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:16:17.462765 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4dddf9_4ec7_4b46_8f22_e508adeddc95.slice/crio-31e5a97f2e49947c7e6e7914879da1ea813b93860eb815c59d4006700f3ac830 WatchSource:0}: Error finding container 31e5a97f2e49947c7e6e7914879da1ea813b93860eb815c59d4006700f3ac830: Status 404 returned error can't find the container with id 31e5a97f2e49947c7e6e7914879da1ea813b93860eb815c59d4006700f3ac830 Sep 15 09:16:18.228538 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:18.228493 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5qt48" event={"ID":"db4dddf9-4ec7-4b46-8f22-e508adeddc95","Type":"ContainerStarted","Data":"31e5a97f2e49947c7e6e7914879da1ea813b93860eb815c59d4006700f3ac830"} Sep 15 09:16:22.240845 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:22.240808 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4wbhf" event={"ID":"e9e36a2a-23f0-4257-8685-1d9349789349","Type":"ContainerStarted","Data":"1790ada02d62ccc5ee32890398669dae41ba9cc30fbde82b5ff0001a088ca6b4"} Sep 15 09:16:22.242412 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:22.242380 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5qt48" event={"ID":"db4dddf9-4ec7-4b46-8f22-e508adeddc95","Type":"ContainerStarted","Data":"84c8e758ef3c012a41e875f00148c8bd057180a8a201e2d57676000687fcb6da"} Sep 15 09:16:22.242523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:22.242446 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:16:22.256281 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:22.256240 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4wbhf" podStartSLOduration=66.652083263 podStartE2EDuration="1m11.256226531s" totalImagesPullingTime="4.604143268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:22.2550188 +0000 UTC m=+71.761596234" watchObservedRunningTime="2026-09-15 09:16:22.256226531 +0000 UTC m=+71.762804015" Sep 15 09:16:22.268587 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:22.268546 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5qt48" podStartSLOduration=66.976694081 podStartE2EDuration="1m11.268529214s" totalImagesPullingTime="4.291835133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:22.268389581 +0000 UTC m=+71.774967020" watchObservedRunningTime="2026-09-15 09:16:22.268529214 +0000 UTC m=+71.775106653" Sep 15 09:16:27.034314 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.034277 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-7fpdd"] Sep 15 09:16:27.037768 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.037751 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.040937 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.040913 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 15 09:16:27.041432 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.041395 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 15 09:16:27.041817 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.041800 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9ggk8\"" Sep 15 09:16:27.041918 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.041814 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 15 09:16:27.041918 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.041814 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 15 09:16:27.045903 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.045864 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 15 09:16:27.049478 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.049451 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-7fpdd"] Sep 15 09:16:27.075201 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.075167 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49187d15-474b-4a73-86ba-8803028dc6a8-trusted-ca\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.075366 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.075217 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wqkw\" (UniqueName: \"kubernetes.io/projected/49187d15-474b-4a73-86ba-8803028dc6a8-kube-api-access-4wqkw\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.075366 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.075236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49187d15-474b-4a73-86ba-8803028dc6a8-config\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.075366 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.075342 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49187d15-474b-4a73-86ba-8803028dc6a8-serving-cert\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.121070 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.121031 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-5v5xq"] Sep 15 09:16:27.124516 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.124492 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq"] Sep 15 09:16:27.124637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.124587 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.127660 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.127009 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6xv7h\"" Sep 15 09:16:27.127660 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.127334 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 15 09:16:27.127660 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.127366 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 15 09:16:27.127660 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.127652 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 15 09:16:27.127919 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.127774 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 15 09:16:27.130365 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.130341 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:27.132721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.132701 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 15 09:16:27.140916 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.140890 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-s7rxl\"" Sep 15 09:16:27.141125 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.140963 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 15 09:16:27.141125 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.140985 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 15 09:16:27.142266 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.142243 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-5v5xq"] Sep 15 09:16:27.143070 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.143050 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 15 09:16:27.155372 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.155349 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq"] Sep 15 09:16:27.176530 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176496 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-trusted-ca-bundle\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.176530 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176526 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:27.176693 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49187d15-474b-4a73-86ba-8803028dc6a8-trusted-ca\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.176693 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176592 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6t4d\" (UniqueName: \"kubernetes.io/projected/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-kube-api-access-s6t4d\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.176693 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176642 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xxrn\" (UniqueName: \"kubernetes.io/projected/034dc83c-508d-4905-a35c-4ee9fc41ca8f-kube-api-access-5xxrn\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:27.176693 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wqkw\" (UniqueName: \"kubernetes.io/projected/49187d15-474b-4a73-86ba-8803028dc6a8-kube-api-access-4wqkw\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.176693 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-snapshots\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.176874 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176720 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49187d15-474b-4a73-86ba-8803028dc6a8-config\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.176874 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176735 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-serving-cert\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.176874 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49187d15-474b-4a73-86ba-8803028dc6a8-serving-cert\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.176874 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-tmp\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.176874 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.176821 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-service-ca-bundle\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.177686 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.177665 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49187d15-474b-4a73-86ba-8803028dc6a8-config\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.177829 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.177714 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49187d15-474b-4a73-86ba-8803028dc6a8-trusted-ca\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.179607 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.179564 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49187d15-474b-4a73-86ba-8803028dc6a8-serving-cert\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.185190 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.185170 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wqkw\" (UniqueName: \"kubernetes.io/projected/49187d15-474b-4a73-86ba-8803028dc6a8-kube-api-access-4wqkw\") pod \"console-operator-696884fb9c-7fpdd\" (UID: \"49187d15-474b-4a73-86ba-8803028dc6a8\") " pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.217320 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.217288 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-swmmq"] Sep 15 09:16:27.220714 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.220698 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-swmmq" Sep 15 09:16:27.223056 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.223030 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-x9wwt\"" Sep 15 09:16:27.226986 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.226963 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-swmmq"] Sep 15 09:16:27.277447 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.277381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58cl8\" (UniqueName: \"kubernetes.io/projected/2c5284d5-5fca-4c6c-b37f-33b04532d494-kube-api-access-58cl8\") pod \"network-check-source-6f8b768455-swmmq\" (UID: \"2c5284d5-5fca-4c6c-b37f-33b04532d494\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-swmmq" Sep 15 09:16:27.277447 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.277444 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-tmp\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.277697 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.277460 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-service-ca-bundle\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.277697 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.277489 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-trusted-ca-bundle\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.277697 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.277507 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:27.277697 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:27.277594 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 09:16:27.277697 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:27.277639 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls podName:034dc83c-508d-4905-a35c-4ee9fc41ca8f nodeName:}" failed. No retries permitted until 2026-09-15 09:16:27.777627033 +0000 UTC m=+77.284204448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2ncsq" (UID: "034dc83c-508d-4905-a35c-4ee9fc41ca8f") : secret "samples-operator-tls" not found Sep 15 09:16:27.277697 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.277641 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6t4d\" (UniqueName: \"kubernetes.io/projected/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-kube-api-access-s6t4d\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.277697 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.277692 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xxrn\" (UniqueName: \"kubernetes.io/projected/034dc83c-508d-4905-a35c-4ee9fc41ca8f-kube-api-access-5xxrn\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:27.278090 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.277720 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-snapshots\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.278090 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.277846 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-tmp\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.278090 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.277848 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-serving-cert\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.278244 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.278128 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-service-ca-bundle\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.278300 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.278251 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-snapshots\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.278508 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.278482 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-trusted-ca-bundle\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.280225 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.280204 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-serving-cert\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.286387 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.286336 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6t4d\" (UniqueName: \"kubernetes.io/projected/4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae-kube-api-access-s6t4d\") pod \"insights-operator-5844b856db-5v5xq\" (UID: \"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae\") " pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.286504 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.286479 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xxrn\" (UniqueName: \"kubernetes.io/projected/034dc83c-508d-4905-a35c-4ee9fc41ca8f-kube-api-access-5xxrn\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:27.347260 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.347219 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:27.379006 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.378972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58cl8\" (UniqueName: \"kubernetes.io/projected/2c5284d5-5fca-4c6c-b37f-33b04532d494-kube-api-access-58cl8\") pod \"network-check-source-6f8b768455-swmmq\" (UID: \"2c5284d5-5fca-4c6c-b37f-33b04532d494\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-swmmq" Sep 15 09:16:27.386353 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.386325 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58cl8\" (UniqueName: \"kubernetes.io/projected/2c5284d5-5fca-4c6c-b37f-33b04532d494-kube-api-access-58cl8\") pod \"network-check-source-6f8b768455-swmmq\" (UID: \"2c5284d5-5fca-4c6c-b37f-33b04532d494\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-swmmq" Sep 15 09:16:27.436727 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.436685 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-5v5xq" Sep 15 09:16:27.529761 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.529725 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-swmmq" Sep 15 09:16:27.613686 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.613654 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-7fpdd"] Sep 15 09:16:27.617762 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:16:27.617737 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49187d15_474b_4a73_86ba_8803028dc6a8.slice/crio-c5324623a7ef3dfc506e36d346cd066df9a092d27b23bd605de20e02a2baebf5 WatchSource:0}: Error finding container c5324623a7ef3dfc506e36d346cd066df9a092d27b23bd605de20e02a2baebf5: Status 404 returned error can't find the container with id c5324623a7ef3dfc506e36d346cd066df9a092d27b23bd605de20e02a2baebf5 Sep 15 09:16:27.703073 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.703042 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-5v5xq"] Sep 15 09:16:27.705649 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:16:27.705622 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4196ebe8_dcfa_4f70_ad84_2b8d0888f2ae.slice/crio-8f62c342ed96ffe9e1217430999be86cf9b2ee503f14e0681ebde3b6c8be3f7b WatchSource:0}: Error finding container 8f62c342ed96ffe9e1217430999be86cf9b2ee503f14e0681ebde3b6c8be3f7b: Status 404 returned error can't find the container with id 8f62c342ed96ffe9e1217430999be86cf9b2ee503f14e0681ebde3b6c8be3f7b Sep 15 09:16:27.781725 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.781694 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:27.781891 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:27.781815 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 09:16:27.781891 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:27.781880 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls podName:034dc83c-508d-4905-a35c-4ee9fc41ca8f nodeName:}" failed. No retries permitted until 2026-09-15 09:16:28.781862484 +0000 UTC m=+78.288439899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2ncsq" (UID: "034dc83c-508d-4905-a35c-4ee9fc41ca8f") : secret "samples-operator-tls" not found Sep 15 09:16:27.798664 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:27.798591 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-swmmq"] Sep 15 09:16:27.801780 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:16:27.801750 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5284d5_5fca_4c6c_b37f_33b04532d494.slice/crio-cb41b354c8c3712a2ff95e5a68233877f7874518ef4d849fd9bbc7b866fd1c49 WatchSource:0}: Error finding container cb41b354c8c3712a2ff95e5a68233877f7874518ef4d849fd9bbc7b866fd1c49: Status 404 returned error can't find the container with id cb41b354c8c3712a2ff95e5a68233877f7874518ef4d849fd9bbc7b866fd1c49 Sep 15 09:16:28.259028 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:28.258991 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-swmmq" event={"ID":"2c5284d5-5fca-4c6c-b37f-33b04532d494","Type":"ContainerStarted","Data":"1cdedc4a66e52d4b9c43417d2f7ad5e7af1143ccda814de2f859546a7525c239"} Sep 15 09:16:28.259502 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:28.259051 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-swmmq" event={"ID":"2c5284d5-5fca-4c6c-b37f-33b04532d494","Type":"ContainerStarted","Data":"cb41b354c8c3712a2ff95e5a68233877f7874518ef4d849fd9bbc7b866fd1c49"} Sep 15 09:16:28.260423 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:28.260377 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" event={"ID":"49187d15-474b-4a73-86ba-8803028dc6a8","Type":"ContainerStarted","Data":"c5324623a7ef3dfc506e36d346cd066df9a092d27b23bd605de20e02a2baebf5"} Sep 15 09:16:28.261729 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:28.261693 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5v5xq" event={"ID":"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae","Type":"ContainerStarted","Data":"8f62c342ed96ffe9e1217430999be86cf9b2ee503f14e0681ebde3b6c8be3f7b"} Sep 15 09:16:28.273895 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:28.273848 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-swmmq" podStartSLOduration=1.273834011 podStartE2EDuration="1.273834011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:28.273216822 +0000 UTC m=+77.779794264" watchObservedRunningTime="2026-09-15 09:16:28.273834011 +0000 UTC m=+77.780411447" Sep 15 09:16:28.789623 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:28.789578 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:28.789838 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:28.789727 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 09:16:28.789838 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:28.789793 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls podName:034dc83c-508d-4905-a35c-4ee9fc41ca8f nodeName:}" failed. No retries permitted until 2026-09-15 09:16:30.789775073 +0000 UTC m=+80.296352491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2ncsq" (UID: "034dc83c-508d-4905-a35c-4ee9fc41ca8f") : secret "samples-operator-tls" not found Sep 15 09:16:30.271163 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:30.271119 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5v5xq" event={"ID":"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae","Type":"ContainerStarted","Data":"6a3420a0535594f1f848f2271d3000f77394ffba642e2aa504c5c836780c3f16"} Sep 15 09:16:30.272985 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:30.272948 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" event={"ID":"49187d15-474b-4a73-86ba-8803028dc6a8","Type":"ContainerStarted","Data":"ae10a749095486717ac071d38993932d8fd8827768271958749b1fc5afa9ece9"} Sep 15 09:16:30.273127 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:30.273107 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:30.274536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:30.274509 2566 patch_prober.go:28] interesting pod/console-operator-696884fb9c-7fpdd container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body= Sep 15 09:16:30.274649 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:30.274557 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" podUID="49187d15-474b-4a73-86ba-8803028dc6a8" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" Sep 15 09:16:30.289397 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:30.289356 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-5v5xq" podStartSLOduration=0.838438344 podStartE2EDuration="3.289341748s" totalImagesPullingTime="2.450903404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:30.288257431 +0000 UTC m=+79.794834870" watchObservedRunningTime="2026-09-15 09:16:30.289341748 +0000 UTC m=+79.795919184" Sep 15 09:16:30.302329 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:30.302286 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" podStartSLOduration=0.76538841 podStartE2EDuration="3.302272368s" totalImagesPullingTime="2.536883958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:30.302151167 +0000 UTC m=+79.808728603" watchObservedRunningTime="2026-09-15 09:16:30.302272368 +0000 UTC m=+79.808849804" Sep 15 09:16:30.804700 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:30.804665 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:30.804885 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:30.804835 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 09:16:30.804954 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:30.804916 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls podName:034dc83c-508d-4905-a35c-4ee9fc41ca8f nodeName:}" failed. No retries permitted until 2026-09-15 09:16:34.804896288 +0000 UTC m=+84.311473718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2ncsq" (UID: "034dc83c-508d-4905-a35c-4ee9fc41ca8f") : secret "samples-operator-tls" not found Sep 15 09:16:31.277608 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:31.277580 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/0.log" Sep 15 09:16:31.277999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:31.277618 2566 generic.go:356] "Generic (PLEG): container finished" podID="49187d15-474b-4a73-86ba-8803028dc6a8" containerID="ae10a749095486717ac071d38993932d8fd8827768271958749b1fc5afa9ece9" exitCode=255 Sep 15 09:16:31.277999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:31.277716 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" event={"ID":"49187d15-474b-4a73-86ba-8803028dc6a8","Type":"ContainerDied","Data":"ae10a749095486717ac071d38993932d8fd8827768271958749b1fc5afa9ece9"} Sep 15 09:16:31.277999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:31.277945 2566 scope.go:117] "RemoveContainer" containerID="ae10a749095486717ac071d38993932d8fd8827768271958749b1fc5afa9ece9" Sep 15 09:16:31.969994 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:31.969952 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tlzjp"] Sep 15 09:16:31.974904 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:31.974879 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:31.977341 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:31.977320 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 15 09:16:31.977475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:31.977359 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 15 09:16:31.977475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:31.977390 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7n7bt\"" Sep 15 09:16:31.985198 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:31.985175 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tlzjp"] Sep 15 09:16:32.014203 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.014177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.014321 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.014209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af705269-bc07-422f-aed7-a411b8954c6d-data-volume\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.014321 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.014231 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.014321 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.014261 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af705269-bc07-422f-aed7-a411b8954c6d-crio-socket\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.014498 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.014343 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbh7p\" (UniqueName: \"kubernetes.io/projected/af705269-bc07-422f-aed7-a411b8954c6d-kube-api-access-hbh7p\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.114953 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.114919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.114953 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.114952 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af705269-bc07-422f-aed7-a411b8954c6d-data-volume\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.115156 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.114974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.115156 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:32.115067 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:32.115156 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.115098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af705269-bc07-422f-aed7-a411b8954c6d-crio-socket\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.115156 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:32.115125 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:32.615110147 +0000 UTC m=+82.121687562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:32.115156 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.115154 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af705269-bc07-422f-aed7-a411b8954c6d-crio-socket\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.115367 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.115156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbh7p\" (UniqueName: \"kubernetes.io/projected/af705269-bc07-422f-aed7-a411b8954c6d-kube-api-access-hbh7p\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.115367 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:32.115203 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 09:16:32.115367 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.115229 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af705269-bc07-422f-aed7-a411b8954c6d-data-volume\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.115367 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:32.115276 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:32.615258606 +0000 UTC m=+82.121836037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : configmap "kube-rbac-proxy" not found Sep 15 09:16:32.123054 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.123029 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbh7p\" (UniqueName: \"kubernetes.io/projected/af705269-bc07-422f-aed7-a411b8954c6d-kube-api-access-hbh7p\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.282867 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.282788 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/1.log" Sep 15 09:16:32.283224 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.283215 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/0.log" Sep 15 09:16:32.283261 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.283246 2566 generic.go:356] "Generic (PLEG): container finished" podID="49187d15-474b-4a73-86ba-8803028dc6a8" containerID="d74503b3f70eff1af65a5e214e811ad96c88f11c1495bfe5c0570d6e5d3c431a" exitCode=255 Sep 15 09:16:32.283310 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.283296 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" event={"ID":"49187d15-474b-4a73-86ba-8803028dc6a8","Type":"ContainerDied","Data":"d74503b3f70eff1af65a5e214e811ad96c88f11c1495bfe5c0570d6e5d3c431a"} Sep 15 09:16:32.283351 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.283339 2566 scope.go:117] "RemoveContainer" containerID="ae10a749095486717ac071d38993932d8fd8827768271958749b1fc5afa9ece9" Sep 15 09:16:32.283601 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.283581 2566 scope.go:117] "RemoveContainer" containerID="d74503b3f70eff1af65a5e214e811ad96c88f11c1495bfe5c0570d6e5d3c431a" Sep 15 09:16:32.283786 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:32.283766 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-7fpdd_openshift-console-operator(49187d15-474b-4a73-86ba-8803028dc6a8)\"" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" podUID="49187d15-474b-4a73-86ba-8803028dc6a8" Sep 15 09:16:32.618881 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.618795 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.619029 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:32.618891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:32.619029 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:32.618927 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 09:16:32.619029 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:32.618982 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:32.619029 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:32.618995 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:33.61897847 +0000 UTC m=+83.125555900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : configmap "kube-rbac-proxy" not found Sep 15 09:16:32.619029 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:32.619022 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:33.619011152 +0000 UTC m=+83.125588567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:33.287296 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:33.287192 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/1.log" Sep 15 09:16:33.287650 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:33.287508 2566 scope.go:117] "RemoveContainer" containerID="d74503b3f70eff1af65a5e214e811ad96c88f11c1495bfe5c0570d6e5d3c431a" Sep 15 09:16:33.287686 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:33.287645 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-7fpdd_openshift-console-operator(49187d15-474b-4a73-86ba-8803028dc6a8)\"" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" podUID="49187d15-474b-4a73-86ba-8803028dc6a8" Sep 15 09:16:33.627184 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:33.627104 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:33.627184 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:33.627152 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:33.627363 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:33.627241 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 09:16:33.627363 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:33.627251 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:33.627363 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:33.627302 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:35.627288901 +0000 UTC m=+85.133866329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : configmap "kube-rbac-proxy" not found Sep 15 09:16:33.627363 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:33.627315 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:35.627309361 +0000 UTC m=+85.133886776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:34.836495 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:34.836461 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:34.836868 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:34.836604 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 09:16:34.836868 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:34.836670 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls podName:034dc83c-508d-4905-a35c-4ee9fc41ca8f nodeName:}" failed. No retries permitted until 2026-09-15 09:16:42.836655403 +0000 UTC m=+92.343232819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2ncsq" (UID: "034dc83c-508d-4905-a35c-4ee9fc41ca8f") : secret "samples-operator-tls" not found Sep 15 09:16:34.948208 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:34.948183 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v4rkp_0f58ca49-d00b-4740-8ca4-96e5f1836bb0/dns-node-resolver/0.log" Sep 15 09:16:35.643490 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:35.643433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:35.643490 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:35.643500 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:35.643824 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:35.643590 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 09:16:35.643824 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:35.643605 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:35.643824 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:35.643661 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:39.64364521 +0000 UTC m=+89.150222641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : configmap "kube-rbac-proxy" not found Sep 15 09:16:35.643824 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:35.643675 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:39.643668887 +0000 UTC m=+89.150246302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:35.747832 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:35.747807 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8s2p_abe08162-7133-43f5-b5d4-c4db416ecab3/node-ca/0.log" Sep 15 09:16:36.351988 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:36.351959 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6d885_0e93a76c-8324-4681-8b94-a454ec734a22/serve-healthcheck-canary/0.log" Sep 15 09:16:37.347663 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:37.347629 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:37.348014 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:37.347999 2566 scope.go:117] "RemoveContainer" containerID="d74503b3f70eff1af65a5e214e811ad96c88f11c1495bfe5c0570d6e5d3c431a" Sep 15 09:16:37.348160 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:37.348144 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-7fpdd_openshift-console-operator(49187d15-474b-4a73-86ba-8803028dc6a8)\"" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" podUID="49187d15-474b-4a73-86ba-8803028dc6a8" Sep 15 09:16:39.676615 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:39.676581 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:39.677009 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:39.676621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:39.677009 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:39.676694 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 09:16:39.677009 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:39.676727 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:39.677009 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:39.676749 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:47.676734454 +0000 UTC m=+97.183311887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : configmap "kube-rbac-proxy" not found Sep 15 09:16:39.677009 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:39.676780 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:47.676766439 +0000 UTC m=+97.183343855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:40.273876 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:40.273838 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:40.274239 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:40.274211 2566 scope.go:117] "RemoveContainer" containerID="d74503b3f70eff1af65a5e214e811ad96c88f11c1495bfe5c0570d6e5d3c431a" Sep 15 09:16:40.274377 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:40.274358 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-7fpdd_openshift-console-operator(49187d15-474b-4a73-86ba-8803028dc6a8)\"" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" podUID="49187d15-474b-4a73-86ba-8803028dc6a8" Sep 15 09:16:42.902682 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:42.902642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:42.904987 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:42.904961 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/034dc83c-508d-4905-a35c-4ee9fc41ca8f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2ncsq\" (UID: \"034dc83c-508d-4905-a35c-4ee9fc41ca8f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:43.042854 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:43.042822 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" Sep 15 09:16:43.310156 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:43.310087 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq"] Sep 15 09:16:44.323339 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:44.323302 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" event={"ID":"034dc83c-508d-4905-a35c-4ee9fc41ca8f","Type":"ContainerStarted","Data":"cb573034a3882f79e484992339b14e10517a390a628970d598ada49dbd13ff05"} Sep 15 09:16:45.328999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:45.328962 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" event={"ID":"034dc83c-508d-4905-a35c-4ee9fc41ca8f","Type":"ContainerStarted","Data":"4aff4646992727771d018b0c06f0d2049f3cc6715f1e29384d7fc12a8135de81"} Sep 15 09:16:45.329493 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:45.329021 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" event={"ID":"034dc83c-508d-4905-a35c-4ee9fc41ca8f","Type":"ContainerStarted","Data":"350f031780e9438018cfbc6a3e824176c61481480a6cfb19acc8c1885526d7d5"} Sep 15 09:16:45.345546 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:45.345495 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2ncsq" podStartSLOduration=16.794925142 podStartE2EDuration="18.345481155s" totalImagesPullingTime="1.550556013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:45.344351399 +0000 UTC m=+94.850928847" watchObservedRunningTime="2026-09-15 09:16:45.345481155 +0000 UTC m=+94.852058617" Sep 15 09:16:47.739399 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:47.739360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:47.739774 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:47.739427 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:47.739774 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:47.739512 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:47.739774 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:47.739571 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls podName:af705269-bc07-422f-aed7-a411b8954c6d nodeName:}" failed. No retries permitted until 2026-09-15 09:17:03.739557009 +0000 UTC m=+113.246134443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tlzjp" (UID: "af705269-bc07-422f-aed7-a411b8954c6d") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:47.739885 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:47.739840 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af705269-bc07-422f-aed7-a411b8954c6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:16:48.244027 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:48.243989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:16:48.244211 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:48.244058 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:16:48.246358 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:48.246327 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac81511-86aa-4d8d-a67b-683277287dfc-metrics-tls\") pod \"dns-default-gvzkl\" (UID: \"1ac81511-86aa-4d8d-a67b-683277287dfc\") " pod="openshift-dns/dns-default-gvzkl" Sep 15 09:16:48.246499 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:48.246441 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"image-registry-759f8bb9f-69kv8\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:16:48.286742 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:48.286681 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tcq7t\"" Sep 15 09:16:48.294557 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:48.294543 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:16:48.297576 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:48.297561 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s9fcs\"" Sep 15 09:16:48.305783 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:48.305755 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvzkl" Sep 15 09:16:48.568950 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:48.568872 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-759f8bb9f-69kv8"] Sep 15 09:16:48.571564 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:16:48.571535 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd665a621_12af_4879_bd99_7778907928c7.slice/crio-3397b3656c0587321a179bceb7fb4e02091603e0057880ac041ac948b3637313 WatchSource:0}: Error finding container 3397b3656c0587321a179bceb7fb4e02091603e0057880ac041ac948b3637313: Status 404 returned error can't find the container with id 3397b3656c0587321a179bceb7fb4e02091603e0057880ac041ac948b3637313 Sep 15 09:16:48.592336 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:48.592316 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvzkl"] Sep 15 09:16:48.597345 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:16:48.597319 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac81511_86aa_4d8d_a67b_683277287dfc.slice/crio-9e03296b2e7145b8a88f22e15c5b9b42c0f9316729d5a0fdaaf604ab42e422d6 WatchSource:0}: Error finding container 9e03296b2e7145b8a88f22e15c5b9b42c0f9316729d5a0fdaaf604ab42e422d6: Status 404 returned error can't find the container with id 9e03296b2e7145b8a88f22e15c5b9b42c0f9316729d5a0fdaaf604ab42e422d6 Sep 15 09:16:49.341779 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:49.341743 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvzkl" event={"ID":"1ac81511-86aa-4d8d-a67b-683277287dfc","Type":"ContainerStarted","Data":"9e03296b2e7145b8a88f22e15c5b9b42c0f9316729d5a0fdaaf604ab42e422d6"} Sep 15 09:16:49.343104 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:49.343081 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" event={"ID":"d665a621-12af-4879-bd99-7778907928c7","Type":"ContainerStarted","Data":"9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a"} Sep 15 09:16:49.343218 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:49.343121 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" event={"ID":"d665a621-12af-4879-bd99-7778907928c7","Type":"ContainerStarted","Data":"3397b3656c0587321a179bceb7fb4e02091603e0057880ac041ac948b3637313"} Sep 15 09:16:49.343278 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:49.343224 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:16:49.363069 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:49.363027 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" podStartSLOduration=98.363013636 podStartE2EDuration="1m38.363013636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:49.361745456 +0000 UTC m=+98.868322894" watchObservedRunningTime="2026-09-15 09:16:49.363013636 +0000 UTC m=+98.869591073" Sep 15 09:16:51.351475 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:51.351434 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvzkl" event={"ID":"1ac81511-86aa-4d8d-a67b-683277287dfc","Type":"ContainerStarted","Data":"6d456178a0e4d934b7a093908e5c5cf73f3ba09a57ecf94eb3d340a4fe8e0df6"} Sep 15 09:16:51.351966 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:51.351497 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvzkl" event={"ID":"1ac81511-86aa-4d8d-a67b-683277287dfc","Type":"ContainerStarted","Data":"6b83e9353d8437ddf962e92319893c4308bb76500e54c805aed46acf471768db"} Sep 15 09:16:51.351966 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:51.351525 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gvzkl" Sep 15 09:16:51.368589 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:51.368541 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gvzkl" podStartSLOduration=65.507764671 podStartE2EDuration="1m7.368524934s" totalImagesPullingTime="1.860760263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:51.366566846 +0000 UTC m=+100.873144285" watchObservedRunningTime="2026-09-15 09:16:51.368524934 +0000 UTC m=+100.875102371" Sep 15 09:16:51.969525 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:51.969491 2566 scope.go:117] "RemoveContainer" containerID="d74503b3f70eff1af65a5e214e811ad96c88f11c1495bfe5c0570d6e5d3c431a" Sep 15 09:16:52.356238 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:52.356156 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:16:52.356610 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:52.356586 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/1.log" Sep 15 09:16:52.356662 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:52.356618 2566 generic.go:356] "Generic (PLEG): container finished" podID="49187d15-474b-4a73-86ba-8803028dc6a8" containerID="3fb8b2ec37f20c3c751ac42d13a0b628a92fbe260bd1db779a922fd4840f37e9" exitCode=255 Sep 15 09:16:52.356719 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:52.356695 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" event={"ID":"49187d15-474b-4a73-86ba-8803028dc6a8","Type":"ContainerDied","Data":"3fb8b2ec37f20c3c751ac42d13a0b628a92fbe260bd1db779a922fd4840f37e9"} Sep 15 09:16:52.356765 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:52.356755 2566 scope.go:117] "RemoveContainer" containerID="d74503b3f70eff1af65a5e214e811ad96c88f11c1495bfe5c0570d6e5d3c431a" Sep 15 09:16:52.357125 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:52.357091 2566 scope.go:117] "RemoveContainer" containerID="3fb8b2ec37f20c3c751ac42d13a0b628a92fbe260bd1db779a922fd4840f37e9" Sep 15 09:16:52.357258 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:52.357239 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-7fpdd_openshift-console-operator(49187d15-474b-4a73-86ba-8803028dc6a8)\"" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" podUID="49187d15-474b-4a73-86ba-8803028dc6a8" Sep 15 09:16:53.246969 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.246935 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5qt48" Sep 15 09:16:53.361658 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.361632 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:16:53.824687 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.824657 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp"] Sep 15 09:16:53.851617 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.851543 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp"] Sep 15 09:16:53.851759 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.851618 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:53.855130 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.855108 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 15 09:16:53.855987 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.855965 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 15 09:16:53.856087 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.855992 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 15 09:16:53.859164 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.859145 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 15 09:16:53.991461 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.991428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9a497f2c-2965-4efc-b7f4-085db8303047-klusterlet-config\") pod \"klusterlet-addon-workmgr-6854cf8d8f-99vfp\" (UID: \"9a497f2c-2965-4efc-b7f4-085db8303047\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:53.991461 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.991463 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a497f2c-2965-4efc-b7f4-085db8303047-tmp\") pod \"klusterlet-addon-workmgr-6854cf8d8f-99vfp\" (UID: \"9a497f2c-2965-4efc-b7f4-085db8303047\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:53.991656 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:53.991591 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4s5n\" (UniqueName: \"kubernetes.io/projected/9a497f2c-2965-4efc-b7f4-085db8303047-kube-api-access-m4s5n\") pod \"klusterlet-addon-workmgr-6854cf8d8f-99vfp\" (UID: \"9a497f2c-2965-4efc-b7f4-085db8303047\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:54.091977 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:54.091898 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4s5n\" (UniqueName: \"kubernetes.io/projected/9a497f2c-2965-4efc-b7f4-085db8303047-kube-api-access-m4s5n\") pod \"klusterlet-addon-workmgr-6854cf8d8f-99vfp\" (UID: \"9a497f2c-2965-4efc-b7f4-085db8303047\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:54.091977 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:54.091940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9a497f2c-2965-4efc-b7f4-085db8303047-klusterlet-config\") pod \"klusterlet-addon-workmgr-6854cf8d8f-99vfp\" (UID: \"9a497f2c-2965-4efc-b7f4-085db8303047\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:54.091977 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:54.091964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a497f2c-2965-4efc-b7f4-085db8303047-tmp\") pod \"klusterlet-addon-workmgr-6854cf8d8f-99vfp\" (UID: \"9a497f2c-2965-4efc-b7f4-085db8303047\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:54.092482 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:54.092457 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a497f2c-2965-4efc-b7f4-085db8303047-tmp\") pod \"klusterlet-addon-workmgr-6854cf8d8f-99vfp\" (UID: \"9a497f2c-2965-4efc-b7f4-085db8303047\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:54.094379 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:54.094353 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9a497f2c-2965-4efc-b7f4-085db8303047-klusterlet-config\") pod \"klusterlet-addon-workmgr-6854cf8d8f-99vfp\" (UID: \"9a497f2c-2965-4efc-b7f4-085db8303047\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:54.103967 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:54.103947 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4s5n\" (UniqueName: \"kubernetes.io/projected/9a497f2c-2965-4efc-b7f4-085db8303047-kube-api-access-m4s5n\") pod \"klusterlet-addon-workmgr-6854cf8d8f-99vfp\" (UID: \"9a497f2c-2965-4efc-b7f4-085db8303047\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:54.160810 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:54.160787 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:54.458155 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:54.458125 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp"] Sep 15 09:16:54.460883 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:16:54.460853 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a497f2c_2965_4efc_b7f4_085db8303047.slice/crio-6e0ac27a890abf08b0fa7d465ba7b74fef4dd7ff0a7f7d77f52c62f7ca5fbbd2 WatchSource:0}: Error finding container 6e0ac27a890abf08b0fa7d465ba7b74fef4dd7ff0a7f7d77f52c62f7ca5fbbd2: Status 404 returned error can't find the container with id 6e0ac27a890abf08b0fa7d465ba7b74fef4dd7ff0a7f7d77f52c62f7ca5fbbd2 Sep 15 09:16:55.369521 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:55.369486 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" event={"ID":"9a497f2c-2965-4efc-b7f4-085db8303047","Type":"ContainerStarted","Data":"6e0ac27a890abf08b0fa7d465ba7b74fef4dd7ff0a7f7d77f52c62f7ca5fbbd2"} Sep 15 09:16:57.347823 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:57.347786 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:16:57.348293 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:57.348191 2566 scope.go:117] "RemoveContainer" containerID="3fb8b2ec37f20c3c751ac42d13a0b628a92fbe260bd1db779a922fd4840f37e9" Sep 15 09:16:57.348372 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:16:57.348351 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-7fpdd_openshift-console-operator(49187d15-474b-4a73-86ba-8803028dc6a8)\"" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" podUID="49187d15-474b-4a73-86ba-8803028dc6a8" Sep 15 09:16:58.381418 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:58.381368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" event={"ID":"9a497f2c-2965-4efc-b7f4-085db8303047","Type":"ContainerStarted","Data":"dc6dfd1dd4f77f99155a1d80e3a892e4056b7b2ce89f4387ed84d5b0098436b7"} Sep 15 09:16:58.381795 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:58.381609 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:58.383968 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:58.383946 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" Sep 15 09:16:58.398322 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:16:58.398264 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6854cf8d8f-99vfp" podStartSLOduration=1.55956369 podStartE2EDuration="5.398248075s" totalImagesPullingTime="3.838684385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:58.397560013 +0000 UTC m=+107.904137450" watchObservedRunningTime="2026-09-15 09:16:58.398248075 +0000 UTC m=+107.904825508" Sep 15 09:17:00.273506 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:00.273468 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:17:00.273868 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:00.273838 2566 scope.go:117] "RemoveContainer" containerID="3fb8b2ec37f20c3c751ac42d13a0b628a92fbe260bd1db779a922fd4840f37e9" Sep 15 09:17:00.274006 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:17:00.273986 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-7fpdd_openshift-console-operator(49187d15-474b-4a73-86ba-8803028dc6a8)\"" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" podUID="49187d15-474b-4a73-86ba-8803028dc6a8" Sep 15 09:17:01.359421 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:01.359371 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gvzkl" Sep 15 09:17:01.961018 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:01.960989 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9"] Sep 15 09:17:01.963857 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:01.963841 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" Sep 15 09:17:01.965831 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:01.965806 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qkwl2\"" Sep 15 09:17:01.965963 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:01.965808 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 15 09:17:01.971500 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:01.971479 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9"] Sep 15 09:17:02.051718 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:02.051675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9970a3de-f057-4369-97a9-c8ec1ca73aea-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-lwnk9\" (UID: \"9970a3de-f057-4369-97a9-c8ec1ca73aea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" Sep 15 09:17:02.152843 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:02.152809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9970a3de-f057-4369-97a9-c8ec1ca73aea-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-lwnk9\" (UID: \"9970a3de-f057-4369-97a9-c8ec1ca73aea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" Sep 15 09:17:02.153015 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:17:02.152952 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 15 09:17:02.153056 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:17:02.153026 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9970a3de-f057-4369-97a9-c8ec1ca73aea-tls-certificates podName:9970a3de-f057-4369-97a9-c8ec1ca73aea nodeName:}" failed. No retries permitted until 2026-09-15 09:17:02.653010104 +0000 UTC m=+112.159587519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/9970a3de-f057-4369-97a9-c8ec1ca73aea-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-lwnk9" (UID: "9970a3de-f057-4369-97a9-c8ec1ca73aea") : secret "prometheus-operator-admission-webhook-tls" not found Sep 15 09:17:02.657711 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:02.657662 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9970a3de-f057-4369-97a9-c8ec1ca73aea-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-lwnk9\" (UID: \"9970a3de-f057-4369-97a9-c8ec1ca73aea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" Sep 15 09:17:02.660229 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:02.660204 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9970a3de-f057-4369-97a9-c8ec1ca73aea-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-lwnk9\" (UID: \"9970a3de-f057-4369-97a9-c8ec1ca73aea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" Sep 15 09:17:02.873150 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:02.873107 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" Sep 15 09:17:03.174708 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:03.174627 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9"] Sep 15 09:17:03.177509 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:03.177483 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9970a3de_f057_4369_97a9_c8ec1ca73aea.slice/crio-99a9d70bb9b33499092faacb7aac6de50a24370c2f6042660f33eb85edc73805 WatchSource:0}: Error finding container 99a9d70bb9b33499092faacb7aac6de50a24370c2f6042660f33eb85edc73805: Status 404 returned error can't find the container with id 99a9d70bb9b33499092faacb7aac6de50a24370c2f6042660f33eb85edc73805 Sep 15 09:17:03.397988 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:03.397957 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" event={"ID":"9970a3de-f057-4369-97a9-c8ec1ca73aea","Type":"ContainerStarted","Data":"99a9d70bb9b33499092faacb7aac6de50a24370c2f6042660f33eb85edc73805"} Sep 15 09:17:03.767252 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:03.767201 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:17:03.770181 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:03.770143 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af705269-bc07-422f-aed7-a411b8954c6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlzjp\" (UID: \"af705269-bc07-422f-aed7-a411b8954c6d\") " pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:17:03.784042 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:03.784008 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tlzjp" Sep 15 09:17:04.062473 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:04.062241 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tlzjp"] Sep 15 09:17:04.238526 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:04.238492 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf705269_bc07_422f_aed7_a411b8954c6d.slice/crio-5c7d7064d856e4c27ac2f210d271d2850941ccb9d9fd7bdac7077667c82fed00 WatchSource:0}: Error finding container 5c7d7064d856e4c27ac2f210d271d2850941ccb9d9fd7bdac7077667c82fed00: Status 404 returned error can't find the container with id 5c7d7064d856e4c27ac2f210d271d2850941ccb9d9fd7bdac7077667c82fed00 Sep 15 09:17:04.403127 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:04.403098 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlzjp" event={"ID":"af705269-bc07-422f-aed7-a411b8954c6d","Type":"ContainerStarted","Data":"228d7237f0d2ed81e1a9ef15310b5e145e73c3f67307749bde872879a58d7cf4"} Sep 15 09:17:04.403271 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:04.403185 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlzjp" event={"ID":"af705269-bc07-422f-aed7-a411b8954c6d","Type":"ContainerStarted","Data":"5c7d7064d856e4c27ac2f210d271d2850941ccb9d9fd7bdac7077667c82fed00"} Sep 15 09:17:04.404500 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:04.404475 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" event={"ID":"9970a3de-f057-4369-97a9-c8ec1ca73aea","Type":"ContainerStarted","Data":"2ac1eac412d7ac437af5f994938be5559d8bef124ff9716847aca7b4ee0c2a93"} Sep 15 09:17:04.404692 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:04.404669 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" Sep 15 09:17:04.409144 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:04.409125 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" Sep 15 09:17:04.420324 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:04.420285 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-lwnk9" podStartSLOduration=2.316189081 podStartE2EDuration="3.420273711s" totalImagesPullingTime="1.10408463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:04.419896288 +0000 UTC m=+113.926473726" watchObservedRunningTime="2026-09-15 09:17:04.420273711 +0000 UTC m=+113.926851147" Sep 15 09:17:05.027436 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.027392 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d"] Sep 15 09:17:05.030538 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.030512 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.032671 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.032646 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 15 09:17:05.032791 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.032656 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 15 09:17:05.032791 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.032687 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 15 09:17:05.032898 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.032820 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 15 09:17:05.033560 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.033542 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 15 09:17:05.033640 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.033595 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h6mn9\"" Sep 15 09:17:05.040614 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.040596 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d"] Sep 15 09:17:05.177368 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.177342 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.177510 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.177476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.177570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.177522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjz2p\" (UniqueName: \"kubernetes.io/projected/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-kube-api-access-gjz2p\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.177570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.177548 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.278471 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.278378 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjz2p\" (UniqueName: \"kubernetes.io/projected/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-kube-api-access-gjz2p\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.278471 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.278434 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.278704 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:17:05.278523 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 15 09:17:05.278704 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:17:05.278585 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-tls podName:5d6a9e70-250b-4fcf-bee2-2429f7bc67e4 nodeName:}" failed. No retries permitted until 2026-09-15 09:17:05.778569615 +0000 UTC m=+115.285147030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-d2t6d" (UID: "5d6a9e70-250b-4fcf-bee2-2429f7bc67e4") : secret "prometheus-operator-tls" not found Sep 15 09:17:05.278704 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.278579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.278704 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.278686 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.279345 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.279328 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.280907 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.280880 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.288684 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.288662 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjz2p\" (UniqueName: \"kubernetes.io/projected/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-kube-api-access-gjz2p\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.410025 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.409988 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlzjp" event={"ID":"af705269-bc07-422f-aed7-a411b8954c6d","Type":"ContainerStarted","Data":"4a54a5c86bfc374492d7207ebf8bdabb35d7949b979504174d6c52d63cd388fa"} Sep 15 09:17:05.781530 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:05.781494 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:05.781680 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:17:05.781641 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 15 09:17:05.781727 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:17:05.781709 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-tls podName:5d6a9e70-250b-4fcf-bee2-2429f7bc67e4 nodeName:}" failed. No retries permitted until 2026-09-15 09:17:06.781690996 +0000 UTC m=+116.288268410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-d2t6d" (UID: "5d6a9e70-250b-4fcf-bee2-2429f7bc67e4") : secret "prometheus-operator-tls" not found Sep 15 09:17:06.790426 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:06.790379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:06.793160 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:06.793134 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d6a9e70-250b-4fcf-bee2-2429f7bc67e4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-d2t6d\" (UID: \"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:06.841214 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:06.841181 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" Sep 15 09:17:07.133278 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:07.133199 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d"] Sep 15 09:17:07.136188 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:07.136159 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6a9e70_250b_4fcf_bee2_2429f7bc67e4.slice/crio-64a537c87db67f8a3581d75fd1c49b06211cf53c2681e5dbcaa60da385130e2e WatchSource:0}: Error finding container 64a537c87db67f8a3581d75fd1c49b06211cf53c2681e5dbcaa60da385130e2e: Status 404 returned error can't find the container with id 64a537c87db67f8a3581d75fd1c49b06211cf53c2681e5dbcaa60da385130e2e Sep 15 09:17:07.418748 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:07.418716 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" event={"ID":"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4","Type":"ContainerStarted","Data":"64a537c87db67f8a3581d75fd1c49b06211cf53c2681e5dbcaa60da385130e2e"} Sep 15 09:17:07.420772 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:07.420746 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlzjp" event={"ID":"af705269-bc07-422f-aed7-a411b8954c6d","Type":"ContainerStarted","Data":"2801947cd838480b884ecc274eab38c2f097163a25f2015c31be73b1dc20e444"} Sep 15 09:17:07.440231 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:07.440187 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tlzjp" podStartSLOduration=33.921855809 podStartE2EDuration="36.440170574s" totalImagesPullingTime="2.518314765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:16:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:07.439321406 +0000 UTC m=+116.945898843" watchObservedRunningTime="2026-09-15 09:17:07.440170574 +0000 UTC m=+116.946748032" Sep 15 09:17:08.299975 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:08.299940 2566 patch_prober.go:28] interesting pod/image-registry-759f8bb9f-69kv8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 15 09:17:08.300323 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:08.300010 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" podUID="d665a621-12af-4879-bd99-7778907928c7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 15 09:17:09.429785 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:09.429747 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" event={"ID":"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4","Type":"ContainerStarted","Data":"5fe8cb8a918e6802917feeecd8432a76f85cf656edb6a8cfbdea7edf673ad74b"} Sep 15 09:17:09.430156 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:09.429807 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" event={"ID":"5d6a9e70-250b-4fcf-bee2-2429f7bc67e4","Type":"ContainerStarted","Data":"450f7d13ea97ccab9308510b5e68c3b6fb88f78d5656c12aa90cc73034836fc2"} Sep 15 09:17:09.446958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:09.446908 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-d2t6d" podStartSLOduration=2.9462060389999998 podStartE2EDuration="4.446893596s" totalImagesPullingTime="1.500687557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:09.445629706 +0000 UTC m=+118.952207143" watchObservedRunningTime="2026-09-15 09:17:09.446893596 +0000 UTC m=+118.953471090" Sep 15 09:17:10.351009 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:10.350981 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:17:11.414070 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.414038 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wk8kb"] Sep 15 09:17:11.418449 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.418427 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.420701 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.420673 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 15 09:17:11.420814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.420707 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 15 09:17:11.420814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.420712 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tnhnm\"" Sep 15 09:17:11.420814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.420782 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 15 09:17:11.525843 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.525814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01dff57b-579d-457b-8d75-3012ddd4f3d1-sys\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.526017 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.525856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-wtmp\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.526017 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.525914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-tls\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.526017 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.525977 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.526017 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.526001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-textfile\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.526017 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.526017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01dff57b-579d-457b-8d75-3012ddd4f3d1-metrics-client-ca\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.526225 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.526040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01dff57b-579d-457b-8d75-3012ddd4f3d1-root\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.526225 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.526069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlx9h\" (UniqueName: \"kubernetes.io/projected/01dff57b-579d-457b-8d75-3012ddd4f3d1-kube-api-access-wlx9h\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.526225 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.526088 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627463 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627429 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlx9h\" (UniqueName: \"kubernetes.io/projected/01dff57b-579d-457b-8d75-3012ddd4f3d1-kube-api-access-wlx9h\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627463 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627467 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627659 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01dff57b-579d-457b-8d75-3012ddd4f3d1-sys\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627659 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627552 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01dff57b-579d-457b-8d75-3012ddd4f3d1-sys\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627725 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627661 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-wtmp\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627725 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627710 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-tls\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627785 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627818 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627802 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-textfile\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627818 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627805 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-wtmp\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627889 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627822 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01dff57b-579d-457b-8d75-3012ddd4f3d1-metrics-client-ca\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627889 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627848 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01dff57b-579d-457b-8d75-3012ddd4f3d1-root\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.627990 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.627919 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01dff57b-579d-457b-8d75-3012ddd4f3d1-root\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.628166 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.628146 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-textfile\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.628392 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.628372 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.628509 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.628423 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01dff57b-579d-457b-8d75-3012ddd4f3d1-metrics-client-ca\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.629891 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.629870 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-tls\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.629997 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.629978 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01dff57b-579d-457b-8d75-3012ddd4f3d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.637771 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.637741 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlx9h\" (UniqueName: \"kubernetes.io/projected/01dff57b-579d-457b-8d75-3012ddd4f3d1-kube-api-access-wlx9h\") pod \"node-exporter-wk8kb\" (UID: \"01dff57b-579d-457b-8d75-3012ddd4f3d1\") " pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.727905 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:11.727834 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wk8kb" Sep 15 09:17:11.739928 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:11.739903 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01dff57b_579d_457b_8d75_3012ddd4f3d1.slice/crio-f55441bacb0eb6cf2781551962494348af2be8529d47fb05accbecc98b2a3cf9 WatchSource:0}: Error finding container f55441bacb0eb6cf2781551962494348af2be8529d47fb05accbecc98b2a3cf9: Status 404 returned error can't find the container with id f55441bacb0eb6cf2781551962494348af2be8529d47fb05accbecc98b2a3cf9 Sep 15 09:17:12.441737 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.441701 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk8kb" event={"ID":"01dff57b-579d-457b-8d75-3012ddd4f3d1","Type":"ContainerStarted","Data":"f55441bacb0eb6cf2781551962494348af2be8529d47fb05accbecc98b2a3cf9"} Sep 15 09:17:12.517162 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.517125 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 09:17:12.520852 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.520828 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.523022 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.523001 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 15 09:17:12.523133 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.523098 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-776q8\"" Sep 15 09:17:12.523205 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.523103 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 15 09:17:12.523351 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.523329 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 15 09:17:12.523500 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.523437 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 15 09:17:12.523500 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.523451 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 15 09:17:12.523618 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.523439 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 15 09:17:12.523618 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.523589 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 15 09:17:12.524259 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.524240 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 15 09:17:12.529767 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.529746 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 15 09:17:12.537923 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.537901 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 09:17:12.636428 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636368 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.636600 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636500 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.636600 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.636736 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636626 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-web-config\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.636736 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636712 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.636832 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636756 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.636832 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636806 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-out\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.636915 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636829 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.636915 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636872 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.637004 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.637004 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.636950 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.637105 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.637002 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.637105 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.637039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc9f5\" (UniqueName: \"kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-kube-api-access-cc9f5\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737662 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737588 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-out\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737662 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737662 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737650 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737926 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737926 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737694 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737926 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737926 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737737 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc9f5\" (UniqueName: \"kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-kube-api-access-cc9f5\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737926 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737783 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737926 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737823 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737926 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737872 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.737926 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-web-config\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.738308 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737943 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.738308 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.737979 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.739523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.739148 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.739523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.739151 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.739523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.739461 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.740845 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.740815 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.744566 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.744497 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.744566 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.744503 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.744735 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.744579 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.744735 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.744622 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-web-config\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.744839 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.744793 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.744892 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.744838 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-out\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.744978 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.744959 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.744978 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.744967 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.746639 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.746618 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc9f5\" (UniqueName: \"kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-kube-api-access-cc9f5\") pod \"alertmanager-main-0\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.832335 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.832308 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:17:12.969486 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:12.969456 2566 scope.go:117] "RemoveContainer" containerID="3fb8b2ec37f20c3c751ac42d13a0b628a92fbe260bd1db779a922fd4840f37e9" Sep 15 09:17:13.117494 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.117451 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 09:17:13.121843 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:13.121815 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec47666_4a74_447a_ba5f_04d4ee9eeb2b.slice/crio-91349aafbc5f10c01d33fa9faf9defbc32fbad845de10cebae163bfdb73b0036 WatchSource:0}: Error finding container 91349aafbc5f10c01d33fa9faf9defbc32fbad845de10cebae163bfdb73b0036: Status 404 returned error can't find the container with id 91349aafbc5f10c01d33fa9faf9defbc32fbad845de10cebae163bfdb73b0036 Sep 15 09:17:13.447204 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.447170 2566 generic.go:356] "Generic (PLEG): container finished" podID="01dff57b-579d-457b-8d75-3012ddd4f3d1" containerID="41b9727c02b46923c861683e6b6c2c182240ab6a140d77c5626cc8503a50f5b7" exitCode=0 Sep 15 09:17:13.447715 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.447276 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk8kb" event={"ID":"01dff57b-579d-457b-8d75-3012ddd4f3d1","Type":"ContainerDied","Data":"41b9727c02b46923c861683e6b6c2c182240ab6a140d77c5626cc8503a50f5b7"} Sep 15 09:17:13.448556 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.448530 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerStarted","Data":"91349aafbc5f10c01d33fa9faf9defbc32fbad845de10cebae163bfdb73b0036"} Sep 15 09:17:13.450784 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.450761 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:17:13.450894 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.450842 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" event={"ID":"49187d15-474b-4a73-86ba-8803028dc6a8","Type":"ContainerStarted","Data":"5e8eb50d4d7305a8d41002924e82f47662ad5b15ae96270c807418d965705419"} Sep 15 09:17:13.451364 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.451339 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:17:13.455967 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.455945 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-7fpdd" Sep 15 09:17:13.554365 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.554337 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-ht9s8"] Sep 15 09:17:13.558915 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.558892 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-ht9s8" Sep 15 09:17:13.561133 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.561112 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 15 09:17:13.561387 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.561370 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 15 09:17:13.561596 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.561575 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pdrvw\"" Sep 15 09:17:13.565486 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.565419 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-ht9s8"] Sep 15 09:17:13.746094 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.746008 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w86d\" (UniqueName: \"kubernetes.io/projected/37c4b1d9-4f93-4b64-9178-32c707e3ffd9-kube-api-access-4w86d\") pod \"downloads-76f99584f4-ht9s8\" (UID: \"37c4b1d9-4f93-4b64-9178-32c707e3ffd9\") " pod="openshift-console/downloads-76f99584f4-ht9s8" Sep 15 09:17:13.846758 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.846724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w86d\" (UniqueName: \"kubernetes.io/projected/37c4b1d9-4f93-4b64-9178-32c707e3ffd9-kube-api-access-4w86d\") pod \"downloads-76f99584f4-ht9s8\" (UID: \"37c4b1d9-4f93-4b64-9178-32c707e3ffd9\") " pod="openshift-console/downloads-76f99584f4-ht9s8" Sep 15 09:17:13.854870 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.854835 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w86d\" (UniqueName: \"kubernetes.io/projected/37c4b1d9-4f93-4b64-9178-32c707e3ffd9-kube-api-access-4w86d\") pod \"downloads-76f99584f4-ht9s8\" (UID: \"37c4b1d9-4f93-4b64-9178-32c707e3ffd9\") " pod="openshift-console/downloads-76f99584f4-ht9s8" Sep 15 09:17:13.879723 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:13.879691 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-ht9s8" Sep 15 09:17:14.164982 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:14.164851 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-ht9s8"] Sep 15 09:17:14.168003 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:14.167969 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c4b1d9_4f93_4b64_9178_32c707e3ffd9.slice/crio-4a5efe421cd803fad21c8fcec69e14e53d45fec6c7237e1d53176f14f5f79648 WatchSource:0}: Error finding container 4a5efe421cd803fad21c8fcec69e14e53d45fec6c7237e1d53176f14f5f79648: Status 404 returned error can't find the container with id 4a5efe421cd803fad21c8fcec69e14e53d45fec6c7237e1d53176f14f5f79648 Sep 15 09:17:14.456963 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:14.456896 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk8kb" event={"ID":"01dff57b-579d-457b-8d75-3012ddd4f3d1","Type":"ContainerStarted","Data":"07dfe657280db6e30c5b5b037d146c80ab10c3dcbdd9d25f28539748d0c3bfd0"} Sep 15 09:17:14.456963 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:14.456952 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk8kb" event={"ID":"01dff57b-579d-457b-8d75-3012ddd4f3d1","Type":"ContainerStarted","Data":"8c63162a321b0f8f172120f3dcd006b29a3e785241484f1fc0a39cc53f7c6977"} Sep 15 09:17:14.458086 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:14.458059 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-ht9s8" event={"ID":"37c4b1d9-4f93-4b64-9178-32c707e3ffd9","Type":"ContainerStarted","Data":"4a5efe421cd803fad21c8fcec69e14e53d45fec6c7237e1d53176f14f5f79648"} Sep 15 09:17:15.465210 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:15.464990 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerID="d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb" exitCode=0 Sep 15 09:17:15.466291 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:15.466255 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerDied","Data":"d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb"} Sep 15 09:17:15.497337 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:15.497287 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wk8kb" podStartSLOduration=3.401004892 podStartE2EDuration="4.497271534s" totalImagesPullingTime="1.021163669s" totalInitContainerRuntime="75.102973ms" isStatefulPod=true podCreationTimestamp="2026-09-15 09:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:14.473627109 +0000 UTC m=+123.980204547" watchObservedRunningTime="2026-09-15 09:17:15.497271534 +0000 UTC m=+125.003848971" Sep 15 09:17:16.088358 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.088321 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-759f8bb9f-69kv8"] Sep 15 09:17:16.174164 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.174127 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf"] Sep 15 09:17:16.179120 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.178445 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" Sep 15 09:17:16.181021 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.180942 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vv85x\"" Sep 15 09:17:16.181151 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.181018 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 15 09:17:16.184354 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.184325 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf"] Sep 15 09:17:16.371806 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.371724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-77rnf\" (UID: \"bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" Sep 15 09:17:16.371960 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.371868 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxspk\" (UniqueName: \"kubernetes.io/projected/bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b-kube-api-access-sxspk\") pod \"monitoring-plugin-5d85778b9d-77rnf\" (UID: \"bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" Sep 15 09:17:16.472864 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.472820 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxspk\" (UniqueName: \"kubernetes.io/projected/bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b-kube-api-access-sxspk\") pod \"monitoring-plugin-5d85778b9d-77rnf\" (UID: \"bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" Sep 15 09:17:16.473301 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.472927 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-77rnf\" (UID: \"bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" Sep 15 09:17:16.475878 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.475847 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-77rnf\" (UID: \"bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" Sep 15 09:17:16.480652 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.480617 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxspk\" (UniqueName: \"kubernetes.io/projected/bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b-kube-api-access-sxspk\") pod \"monitoring-plugin-5d85778b9d-77rnf\" (UID: \"bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" Sep 15 09:17:16.492262 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.492236 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" Sep 15 09:17:16.669423 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.669372 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-566d69fc7f-5pfl9"] Sep 15 09:17:16.674097 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.674074 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.677334 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.676638 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 15 09:17:16.677334 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.676736 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 15 09:17:16.677334 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.676738 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 15 09:17:16.677334 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.677082 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 15 09:17:16.678246 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.677889 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 15 09:17:16.678246 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.677926 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gcjxv\"" Sep 15 09:17:16.684007 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.683986 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 15 09:17:16.686097 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.686034 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-566d69fc7f-5pfl9"] Sep 15 09:17:16.774959 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.774894 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf"] Sep 15 09:17:16.775262 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.775239 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.775336 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.775284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-telemeter-client-tls\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.775382 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.775350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.775474 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.775453 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-secret-telemeter-client\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.775539 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.775509 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-serving-certs-ca-bundle\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.775597 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.775562 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-metrics-client-ca\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.775656 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.775598 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4h58\" (UniqueName: \"kubernetes.io/projected/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-kube-api-access-m4h58\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.775709 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.775693 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-federate-client-tls\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.777701 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:16.777669 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1a5e48_cbaf_4fac_90c5_a09e4b36b12b.slice/crio-0d2c2db25764891e2133e29d9cd5ad260f8ec281b6615ad3e58bb7a52a8e3923 WatchSource:0}: Error finding container 0d2c2db25764891e2133e29d9cd5ad260f8ec281b6615ad3e58bb7a52a8e3923: Status 404 returned error can't find the container with id 0d2c2db25764891e2133e29d9cd5ad260f8ec281b6615ad3e58bb7a52a8e3923 Sep 15 09:17:16.876660 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.876596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-secret-telemeter-client\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.876660 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.876651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-serving-certs-ca-bundle\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.876952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.876707 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-metrics-client-ca\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.876952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.876749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4h58\" (UniqueName: \"kubernetes.io/projected/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-kube-api-access-m4h58\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.876952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.876876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-federate-client-tls\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.877098 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.876972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.877098 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.877007 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-telemeter-client-tls\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.877098 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.877038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.878160 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.878064 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-serving-certs-ca-bundle\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.878353 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.878293 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.879504 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.879435 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-metrics-client-ca\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.879972 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.879899 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.880379 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.880353 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-secret-telemeter-client\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.881423 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.881370 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-federate-client-tls\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.881699 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.881679 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-telemeter-client-tls\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.885262 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.885231 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4h58\" (UniqueName: \"kubernetes.io/projected/6f46c5aa-f2ce-480f-a803-e4dcac0a5fef-kube-api-access-m4h58\") pod \"telemeter-client-566d69fc7f-5pfl9\" (UID: \"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef\") " pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:16.988091 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:16.987985 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" Sep 15 09:17:17.478024 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:17.477991 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" event={"ID":"bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b","Type":"ContainerStarted","Data":"0d2c2db25764891e2133e29d9cd5ad260f8ec281b6615ad3e58bb7a52a8e3923"} Sep 15 09:17:17.641537 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:17.641438 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-566d69fc7f-5pfl9"] Sep 15 09:17:17.653890 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:17.653861 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f46c5aa_f2ce_480f_a803_e4dcac0a5fef.slice/crio-cf24ca957f10026865d32a102ea22e274a1c880bbf37ff087e758c6711ae6a58 WatchSource:0}: Error finding container cf24ca957f10026865d32a102ea22e274a1c880bbf37ff087e758c6711ae6a58: Status 404 returned error can't find the container with id cf24ca957f10026865d32a102ea22e274a1c880bbf37ff087e758c6711ae6a58 Sep 15 09:17:18.488929 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:18.488834 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerStarted","Data":"276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d"} Sep 15 09:17:18.489386 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:18.488966 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerStarted","Data":"effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae"} Sep 15 09:17:18.489386 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:18.489011 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerStarted","Data":"7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f"} Sep 15 09:17:18.489386 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:18.489055 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerStarted","Data":"e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb"} Sep 15 09:17:18.489386 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:18.489099 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerStarted","Data":"0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902"} Sep 15 09:17:18.490625 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:18.490552 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" event={"ID":"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef","Type":"ContainerStarted","Data":"cf24ca957f10026865d32a102ea22e274a1c880bbf37ff087e758c6711ae6a58"} Sep 15 09:17:19.497440 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:19.497378 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" event={"ID":"bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b","Type":"ContainerStarted","Data":"29ade36a938b899bc9f81cffefce87791fadac9dd33573032560d26c73e46b7c"} Sep 15 09:17:19.497962 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:19.497872 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" Sep 15 09:17:19.504136 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:19.504108 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" Sep 15 09:17:19.513814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:19.513760 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-77rnf" podStartSLOduration=1.626698599 podStartE2EDuration="3.513745258s" totalImagesPullingTime="1.887046659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:19.512660844 +0000 UTC m=+129.019238280" watchObservedRunningTime="2026-09-15 09:17:19.513745258 +0000 UTC m=+129.020322695" Sep 15 09:17:20.508753 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:20.508711 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" event={"ID":"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef","Type":"ContainerStarted","Data":"1746e933a5004d211fc6f3296c63183511b2ac302691d18d890dbb9a8d185f56"} Sep 15 09:17:20.509206 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:20.508810 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" event={"ID":"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef","Type":"ContainerStarted","Data":"6b81171eff75545c35aa005877057191595da6a5043303f191361c7e1ac7fcdb"} Sep 15 09:17:20.509206 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:20.508837 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" event={"ID":"6f46c5aa-f2ce-480f-a803-e4dcac0a5fef","Type":"ContainerStarted","Data":"943bb875aa71339876a71e716f94d54e6a272d6006cf5adf1672eb812a07f279"} Sep 15 09:17:20.512550 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:20.512521 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerStarted","Data":"d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862"} Sep 15 09:17:20.536158 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:20.536102 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-566d69fc7f-5pfl9" podStartSLOduration=2.572657132 podStartE2EDuration="4.536084888s" totalImagesPullingTime="1.963427756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:20.533824033 +0000 UTC m=+130.040401471" watchObservedRunningTime="2026-09-15 09:17:20.536084888 +0000 UTC m=+130.042662325" Sep 15 09:17:20.562183 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:20.562132 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.47454136 podStartE2EDuration="8.562113312s" totalImagesPullingTime="5.070942538s" totalInitContainerRuntime="16.629414ms" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:20.560790281 +0000 UTC m=+130.067367720" watchObservedRunningTime="2026-09-15 09:17:20.562113312 +0000 UTC m=+130.068690751" Sep 15 09:17:20.816054 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:20.814695 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:17:20.818500 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:20.818467 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7-metrics-certs\") pod \"network-metrics-daemon-kl7xm\" (UID: \"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7\") " pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:17:20.982082 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:20.982053 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g6g5g\"" Sep 15 09:17:20.989842 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:20.989810 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7xm" Sep 15 09:17:21.278810 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:21.278773 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kl7xm"] Sep 15 09:17:21.282317 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:21.282287 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29f40c9_7bc4_4b1d_bbf2_0fac5ac735e7.slice/crio-615be9ed77f66b1a628941d1bec9d90f75adacd8d2956095a9704dbfc38f99b5 WatchSource:0}: Error finding container 615be9ed77f66b1a628941d1bec9d90f75adacd8d2956095a9704dbfc38f99b5: Status 404 returned error can't find the container with id 615be9ed77f66b1a628941d1bec9d90f75adacd8d2956095a9704dbfc38f99b5 Sep 15 09:17:21.518387 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:21.518328 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kl7xm" event={"ID":"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7","Type":"ContainerStarted","Data":"615be9ed77f66b1a628941d1bec9d90f75adacd8d2956095a9704dbfc38f99b5"} Sep 15 09:17:23.529679 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:23.529633 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kl7xm" event={"ID":"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7","Type":"ContainerStarted","Data":"634307d54d710bcab3af26726a70ccf1b57a27858fb3d5a88f9af6ee23fe858a"} Sep 15 09:17:23.530127 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:23.529797 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kl7xm" event={"ID":"e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7","Type":"ContainerStarted","Data":"04c053998e636d016802948cf8da48a39cff070d0422754474c2c2c3e23d3b87"} Sep 15 09:17:23.545634 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:23.545583 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kl7xm" podStartSLOduration=131.383241823 podStartE2EDuration="2m12.545564252s" totalImagesPullingTime="1.162322429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:23.544148689 +0000 UTC m=+133.050726127" watchObservedRunningTime="2026-09-15 09:17:23.545564252 +0000 UTC m=+133.052141689" Sep 15 09:17:24.390087 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.390052 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d8bd46986-8sqvm"] Sep 15 09:17:24.394613 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.394591 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.397840 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.397816 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 15 09:17:24.398339 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.398317 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-smjm5\"" Sep 15 09:17:24.398476 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.398320 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 15 09:17:24.398916 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.398897 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 15 09:17:24.399012 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.398896 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 15 09:17:24.399183 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.399168 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 15 09:17:24.411741 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.411722 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d8bd46986-8sqvm"] Sep 15 09:17:24.446883 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.446848 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-oauth-config\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.447021 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.446889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-console-config\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.447021 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.446960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-oauth-serving-cert\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.447125 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.447040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-serving-cert\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.447125 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.447110 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzp97\" (UniqueName: \"kubernetes.io/projected/6dcec993-9fbd-470e-adbe-2b8604976b66-kube-api-access-lzp97\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.447221 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.447143 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-service-ca\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.548098 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.548060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-oauth-serving-cert\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.548581 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.548107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-serving-cert\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.548581 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.548157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzp97\" (UniqueName: \"kubernetes.io/projected/6dcec993-9fbd-470e-adbe-2b8604976b66-kube-api-access-lzp97\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.548581 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.548185 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-service-ca\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.548581 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.548229 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-oauth-config\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.548581 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.548259 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-console-config\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.548954 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.548923 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-oauth-serving-cert\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.548954 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.548943 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-console-config\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.549145 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.548984 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-service-ca\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.551153 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.551104 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-serving-cert\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.551830 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.551806 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-oauth-config\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.555638 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.555612 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzp97\" (UniqueName: \"kubernetes.io/projected/6dcec993-9fbd-470e-adbe-2b8604976b66-kube-api-access-lzp97\") pod \"console-6d8bd46986-8sqvm\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.707086 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.707042 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:24.992727 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:24.992647 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d8bd46986-8sqvm"] Sep 15 09:17:24.995269 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:24.995236 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dcec993_9fbd_470e_adbe_2b8604976b66.slice/crio-3ae673cb2fbfd14bbc97ee8d787132219e59a51a72bb5a89df11445c892df5cf WatchSource:0}: Error finding container 3ae673cb2fbfd14bbc97ee8d787132219e59a51a72bb5a89df11445c892df5cf: Status 404 returned error can't find the container with id 3ae673cb2fbfd14bbc97ee8d787132219e59a51a72bb5a89df11445c892df5cf Sep 15 09:17:25.540013 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:25.539963 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8bd46986-8sqvm" event={"ID":"6dcec993-9fbd-470e-adbe-2b8604976b66","Type":"ContainerStarted","Data":"3ae673cb2fbfd14bbc97ee8d787132219e59a51a72bb5a89df11445c892df5cf"} Sep 15 09:17:32.573547 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:32.573446 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-ht9s8" event={"ID":"37c4b1d9-4f93-4b64-9178-32c707e3ffd9","Type":"ContainerStarted","Data":"2c6fd4d1fdd7ad537571cbe515c3ee3c397c0edaec6a0b27601f44d1a59f5adb"} Sep 15 09:17:32.574050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:32.573898 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-ht9s8" Sep 15 09:17:32.579622 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:32.579570 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-ht9s8" Sep 15 09:17:32.592079 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:32.591702 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-ht9s8" podStartSLOduration=1.466419388 podStartE2EDuration="19.59168195s" totalImagesPullingTime="18.125262562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:32.590604282 +0000 UTC m=+142.097181722" watchObservedRunningTime="2026-09-15 09:17:32.59168195 +0000 UTC m=+142.098259591" Sep 15 09:17:33.048758 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.048711 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7f5bf8c7-zb5m9"] Sep 15 09:17:33.053620 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.053593 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.066015 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.065328 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7f5bf8c7-zb5m9"] Sep 15 09:17:33.069770 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.069745 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 15 09:17:33.126569 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.126518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-service-ca\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.126799 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.126581 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-oauth-config\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.126799 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.126608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-trusted-ca-bundle\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.126799 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.126652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-oauth-serving-cert\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.126971 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.126833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-serving-cert\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.126971 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.126873 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69ms2\" (UniqueName: \"kubernetes.io/projected/6216b95d-0977-4757-a074-231b7cfe8fc6-kube-api-access-69ms2\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.126971 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.126933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-console-config\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.228472 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.228424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-console-config\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.228651 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.228484 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-service-ca\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.228651 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.228511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-oauth-config\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.228651 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.228534 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-trusted-ca-bundle\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.228651 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.228572 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-oauth-serving-cert\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.228846 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.228664 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-serving-cert\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.228846 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.228689 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69ms2\" (UniqueName: \"kubernetes.io/projected/6216b95d-0977-4757-a074-231b7cfe8fc6-kube-api-access-69ms2\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.229933 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.229881 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-console-config\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.230535 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.230500 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-trusted-ca-bundle\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.231057 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.230573 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-oauth-serving-cert\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.231057 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.230975 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-service-ca\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.233062 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.233012 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-oauth-config\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.233279 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.233232 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-serving-cert\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.238387 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.238344 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69ms2\" (UniqueName: \"kubernetes.io/projected/6216b95d-0977-4757-a074-231b7cfe8fc6-kube-api-access-69ms2\") pod \"console-7d7f5bf8c7-zb5m9\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.369485 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.369167 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:33.662308 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:33.662273 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7f5bf8c7-zb5m9"] Sep 15 09:17:33.665099 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:17:33.665066 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6216b95d_0977_4757_a074_231b7cfe8fc6.slice/crio-deec92d50c55cdf6b3255077c61a968882d119305872718589180281d1e332a2 WatchSource:0}: Error finding container deec92d50c55cdf6b3255077c61a968882d119305872718589180281d1e332a2: Status 404 returned error can't find the container with id deec92d50c55cdf6b3255077c61a968882d119305872718589180281d1e332a2 Sep 15 09:17:34.587049 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:34.586986 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7f5bf8c7-zb5m9" event={"ID":"6216b95d-0977-4757-a074-231b7cfe8fc6","Type":"ContainerStarted","Data":"deec92d50c55cdf6b3255077c61a968882d119305872718589180281d1e332a2"} Sep 15 09:17:36.598134 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:36.598089 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8bd46986-8sqvm" event={"ID":"6dcec993-9fbd-470e-adbe-2b8604976b66","Type":"ContainerStarted","Data":"63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811"} Sep 15 09:17:36.600680 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:36.600647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7f5bf8c7-zb5m9" event={"ID":"6216b95d-0977-4757-a074-231b7cfe8fc6","Type":"ContainerStarted","Data":"920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823"} Sep 15 09:17:36.620696 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:36.620640 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d8bd46986-8sqvm" podStartSLOduration=1.8830110279999999 podStartE2EDuration="12.620624699s" totalImagesPullingTime="10.737613671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:36.618443738 +0000 UTC m=+146.125021176" watchObservedRunningTime="2026-09-15 09:17:36.620624699 +0000 UTC m=+146.127202135" Sep 15 09:17:36.637990 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:36.637945 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d7f5bf8c7-zb5m9" podStartSLOduration=1.571084583 podStartE2EDuration="3.637935575s" totalImagesPullingTime="2.066850992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:36.637231081 +0000 UTC m=+146.143808520" watchObservedRunningTime="2026-09-15 09:17:36.637935575 +0000 UTC m=+146.144513012" Sep 15 09:17:41.111009 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.110945 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" podUID="d665a621-12af-4879-bd99-7778907928c7" containerName="registry" containerID="cri-o://9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a" gracePeriod=30 Sep 15 09:17:41.437980 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.437945 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:17:41.508765 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.508731 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-trusted-ca\") pod \"d665a621-12af-4879-bd99-7778907928c7\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " Sep 15 09:17:41.508942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.508773 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdbpc\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-kube-api-access-cdbpc\") pod \"d665a621-12af-4879-bd99-7778907928c7\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " Sep 15 09:17:41.508942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.508799 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d665a621-12af-4879-bd99-7778907928c7-ca-trust-extracted\") pod \"d665a621-12af-4879-bd99-7778907928c7\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " Sep 15 09:17:41.508942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.508835 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-image-registry-private-configuration\") pod \"d665a621-12af-4879-bd99-7778907928c7\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " Sep 15 09:17:41.508942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.508858 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-registry-certificates\") pod \"d665a621-12af-4879-bd99-7778907928c7\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " Sep 15 09:17:41.508942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.508874 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-bound-sa-token\") pod \"d665a621-12af-4879-bd99-7778907928c7\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " Sep 15 09:17:41.508942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.508899 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-installation-pull-secrets\") pod \"d665a621-12af-4879-bd99-7778907928c7\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " Sep 15 09:17:41.509239 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.509124 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") pod \"d665a621-12af-4879-bd99-7778907928c7\" (UID: \"d665a621-12af-4879-bd99-7778907928c7\") " Sep 15 09:17:41.509386 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.509353 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d665a621-12af-4879-bd99-7778907928c7" (UID: "d665a621-12af-4879-bd99-7778907928c7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:17:41.509602 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.509434 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d665a621-12af-4879-bd99-7778907928c7" (UID: "d665a621-12af-4879-bd99-7778907928c7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:17:41.511521 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.511492 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d665a621-12af-4879-bd99-7778907928c7" (UID: "d665a621-12af-4879-bd99-7778907928c7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:17:41.511633 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.511498 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-kube-api-access-cdbpc" (OuterVolumeSpecName: "kube-api-access-cdbpc") pod "d665a621-12af-4879-bd99-7778907928c7" (UID: "d665a621-12af-4879-bd99-7778907928c7"). InnerVolumeSpecName "kube-api-access-cdbpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:17:41.511683 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.511652 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d665a621-12af-4879-bd99-7778907928c7" (UID: "d665a621-12af-4879-bd99-7778907928c7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:17:41.511806 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.511778 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d665a621-12af-4879-bd99-7778907928c7" (UID: "d665a621-12af-4879-bd99-7778907928c7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:17:41.511898 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.511814 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d665a621-12af-4879-bd99-7778907928c7" (UID: "d665a621-12af-4879-bd99-7778907928c7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:17:41.517705 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.517681 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d665a621-12af-4879-bd99-7778907928c7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d665a621-12af-4879-bd99-7778907928c7" (UID: "d665a621-12af-4879-bd99-7778907928c7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:17:41.610769 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.610737 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-trusted-ca\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:17:41.610769 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.610766 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdbpc\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-kube-api-access-cdbpc\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:17:41.610942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.610780 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d665a621-12af-4879-bd99-7778907928c7-ca-trust-extracted\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:17:41.610942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.610794 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-image-registry-private-configuration\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:17:41.610942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.610806 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d665a621-12af-4879-bd99-7778907928c7-registry-certificates\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:17:41.610942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.610817 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-bound-sa-token\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:17:41.610942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.610829 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d665a621-12af-4879-bd99-7778907928c7-installation-pull-secrets\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:17:41.610942 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.610840 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d665a621-12af-4879-bd99-7778907928c7-registry-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:17:41.625270 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.625239 2566 generic.go:356] "Generic (PLEG): container finished" podID="d665a621-12af-4879-bd99-7778907928c7" containerID="9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a" exitCode=0 Sep 15 09:17:41.625373 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.625283 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" Sep 15 09:17:41.625373 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.625290 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" event={"ID":"d665a621-12af-4879-bd99-7778907928c7","Type":"ContainerDied","Data":"9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a"} Sep 15 09:17:41.625518 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.625377 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-759f8bb9f-69kv8" event={"ID":"d665a621-12af-4879-bd99-7778907928c7","Type":"ContainerDied","Data":"3397b3656c0587321a179bceb7fb4e02091603e0057880ac041ac948b3637313"} Sep 15 09:17:41.625518 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.625422 2566 scope.go:117] "RemoveContainer" containerID="9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a" Sep 15 09:17:41.633774 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.633761 2566 scope.go:117] "RemoveContainer" containerID="9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a" Sep 15 09:17:41.634056 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:17:41.634037 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a\": container with ID starting with 9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a not found: ID does not exist" containerID="9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a" Sep 15 09:17:41.634096 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.634066 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a"} err="failed to get container status \"9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a\": rpc error: code = NotFound desc = could not find container \"9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a\": container with ID starting with 9e0d98c24241ee49d258f7469c808086667520313d79a592ccccae2e1830767a not found: ID does not exist" Sep 15 09:17:41.644317 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.644289 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-759f8bb9f-69kv8"] Sep 15 09:17:41.648168 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:41.648146 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-759f8bb9f-69kv8"] Sep 15 09:17:42.975197 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:42.975159 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d665a621-12af-4879-bd99-7778907928c7" path="/var/lib/kubelet/pods/d665a621-12af-4879-bd99-7778907928c7/volumes" Sep 15 09:17:43.369586 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:43.369519 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:43.369586 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:43.369574 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:43.373963 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:43.373939 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:43.638707 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:43.638628 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:17:43.681019 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:43.680990 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d8bd46986-8sqvm"] Sep 15 09:17:44.707212 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:44.707177 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:17:51.666550 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:51.666516 2566 generic.go:356] "Generic (PLEG): container finished" podID="4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae" containerID="6a3420a0535594f1f848f2271d3000f77394ffba642e2aa504c5c836780c3f16" exitCode=0 Sep 15 09:17:51.667128 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:51.666587 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5v5xq" event={"ID":"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae","Type":"ContainerDied","Data":"6a3420a0535594f1f848f2271d3000f77394ffba642e2aa504c5c836780c3f16"} Sep 15 09:17:51.667128 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:51.667069 2566 scope.go:117] "RemoveContainer" containerID="6a3420a0535594f1f848f2271d3000f77394ffba642e2aa504c5c836780c3f16" Sep 15 09:17:52.672548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:17:52.672514 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5v5xq" event={"ID":"4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae","Type":"ContainerStarted","Data":"d8b067a59a993e75c17addb01afd0325e67dd99151ef360337980a4d854074cf"} Sep 15 09:18:08.700456 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:08.700353 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d8bd46986-8sqvm" podUID="6dcec993-9fbd-470e-adbe-2b8604976b66" containerName="console" containerID="cri-o://63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811" gracePeriod=15 Sep 15 09:18:08.984695 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:08.984632 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:18:09.036678 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.036639 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-oauth-config\") pod \"6dcec993-9fbd-470e-adbe-2b8604976b66\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " Sep 15 09:18:09.036678 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.036679 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-serving-cert\") pod \"6dcec993-9fbd-470e-adbe-2b8604976b66\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " Sep 15 09:18:09.036889 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.036720 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-service-ca\") pod \"6dcec993-9fbd-470e-adbe-2b8604976b66\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " Sep 15 09:18:09.036889 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.036742 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-console-config\") pod \"6dcec993-9fbd-470e-adbe-2b8604976b66\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " Sep 15 09:18:09.036889 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.036772 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-oauth-serving-cert\") pod \"6dcec993-9fbd-470e-adbe-2b8604976b66\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " Sep 15 09:18:09.036889 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.036809 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzp97\" (UniqueName: \"kubernetes.io/projected/6dcec993-9fbd-470e-adbe-2b8604976b66-kube-api-access-lzp97\") pod \"6dcec993-9fbd-470e-adbe-2b8604976b66\" (UID: \"6dcec993-9fbd-470e-adbe-2b8604976b66\") " Sep 15 09:18:09.037203 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.037171 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-service-ca" (OuterVolumeSpecName: "service-ca") pod "6dcec993-9fbd-470e-adbe-2b8604976b66" (UID: "6dcec993-9fbd-470e-adbe-2b8604976b66"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:18:09.037203 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.037162 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-console-config" (OuterVolumeSpecName: "console-config") pod "6dcec993-9fbd-470e-adbe-2b8604976b66" (UID: "6dcec993-9fbd-470e-adbe-2b8604976b66"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:18:09.037341 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.037178 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6dcec993-9fbd-470e-adbe-2b8604976b66" (UID: "6dcec993-9fbd-470e-adbe-2b8604976b66"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:18:09.038949 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.038929 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6dcec993-9fbd-470e-adbe-2b8604976b66" (UID: "6dcec993-9fbd-470e-adbe-2b8604976b66"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:18:09.039034 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.038972 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6dcec993-9fbd-470e-adbe-2b8604976b66" (UID: "6dcec993-9fbd-470e-adbe-2b8604976b66"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:18:09.039034 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.039019 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dcec993-9fbd-470e-adbe-2b8604976b66-kube-api-access-lzp97" (OuterVolumeSpecName: "kube-api-access-lzp97") pod "6dcec993-9fbd-470e-adbe-2b8604976b66" (UID: "6dcec993-9fbd-470e-adbe-2b8604976b66"). InnerVolumeSpecName "kube-api-access-lzp97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:18:09.138065 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.138031 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-oauth-config\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:09.138065 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.138059 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dcec993-9fbd-470e-adbe-2b8604976b66-console-serving-cert\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:09.138065 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.138070 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-service-ca\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:09.138284 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.138078 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-console-config\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:09.138284 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.138088 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dcec993-9fbd-470e-adbe-2b8604976b66-oauth-serving-cert\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:09.138284 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.138097 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzp97\" (UniqueName: \"kubernetes.io/projected/6dcec993-9fbd-470e-adbe-2b8604976b66-kube-api-access-lzp97\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:09.740825 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.740788 2566 generic.go:356] "Generic (PLEG): container finished" podID="6dcec993-9fbd-470e-adbe-2b8604976b66" containerID="63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811" exitCode=0 Sep 15 09:18:09.741226 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.740839 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8bd46986-8sqvm" Sep 15 09:18:09.741226 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.740878 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8bd46986-8sqvm" event={"ID":"6dcec993-9fbd-470e-adbe-2b8604976b66","Type":"ContainerDied","Data":"63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811"} Sep 15 09:18:09.741226 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.740928 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8bd46986-8sqvm" event={"ID":"6dcec993-9fbd-470e-adbe-2b8604976b66","Type":"ContainerDied","Data":"3ae673cb2fbfd14bbc97ee8d787132219e59a51a72bb5a89df11445c892df5cf"} Sep 15 09:18:09.741226 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.740947 2566 scope.go:117] "RemoveContainer" containerID="63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811" Sep 15 09:18:09.749723 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.749700 2566 scope.go:117] "RemoveContainer" containerID="63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811" Sep 15 09:18:09.750020 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:18:09.750002 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811\": container with ID starting with 63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811 not found: ID does not exist" containerID="63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811" Sep 15 09:18:09.750083 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.750032 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811"} err="failed to get container status \"63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811\": rpc error: code = NotFound desc = could not find container \"63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811\": container with ID starting with 63467e196d76614e2a3ce0fc2318bb6081d97e69bb2205a704189dd31611b811 not found: ID does not exist" Sep 15 09:18:09.762076 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.762034 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d8bd46986-8sqvm"] Sep 15 09:18:09.763616 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:09.763597 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d8bd46986-8sqvm"] Sep 15 09:18:10.973635 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:10.973600 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dcec993-9fbd-470e-adbe-2b8604976b66" path="/var/lib/kubelet/pods/6dcec993-9fbd-470e-adbe-2b8604976b66/volumes" Sep 15 09:18:31.933288 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:31.933256 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 09:18:31.933812 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:31.933549 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="alertmanager" containerID="cri-o://0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902" gracePeriod=120 Sep 15 09:18:31.933812 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:31.933613 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy-metric" containerID="cri-o://276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d" gracePeriod=120 Sep 15 09:18:31.933812 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:31.933658 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy-web" containerID="cri-o://7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f" gracePeriod=120 Sep 15 09:18:31.933812 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:31.933674 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="prom-label-proxy" containerID="cri-o://d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862" gracePeriod=120 Sep 15 09:18:31.933812 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:31.933709 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy" containerID="cri-o://effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae" gracePeriod=120 Sep 15 09:18:31.933812 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:31.933705 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="config-reloader" containerID="cri-o://e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb" gracePeriod=120 Sep 15 09:18:32.835249 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:32.835216 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerID="d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862" exitCode=0 Sep 15 09:18:32.835249 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:32.835241 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerID="effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae" exitCode=0 Sep 15 09:18:32.835249 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:32.835248 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerID="e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb" exitCode=0 Sep 15 09:18:32.835249 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:32.835254 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerID="0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902" exitCode=0 Sep 15 09:18:32.835548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:32.835284 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerDied","Data":"d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862"} Sep 15 09:18:32.835548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:32.835376 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerDied","Data":"effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae"} Sep 15 09:18:32.835548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:32.835420 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerDied","Data":"e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb"} Sep 15 09:18:32.835548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:32.835449 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerDied","Data":"0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902"} Sep 15 09:18:33.174197 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.174173 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:33.238216 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238184 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-main-db\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238426 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238225 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-web-config\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238426 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238251 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238426 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238293 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-tls-assets\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238426 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238327 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-cluster-tls-config\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238426 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238350 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc9f5\" (UniqueName: \"kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-kube-api-access-cc9f5\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238426 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238416 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-out\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238752 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238442 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238752 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238501 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-web\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238752 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238524 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:18:33.238752 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238532 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-volume\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238752 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238588 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-main-tls\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238752 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238635 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-trusted-ca-bundle\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.238752 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238673 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-metrics-client-ca\") pod \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\" (UID: \"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b\") " Sep 15 09:18:33.239091 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.238952 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-main-db\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.239291 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.239265 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:18:33.239619 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.239592 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:18:33.241268 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.241226 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-volume" (OuterVolumeSpecName: "config-volume") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:18:33.242707 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.242679 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:18:33.242807 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.242708 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:18:33.243330 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.243294 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-out" (OuterVolumeSpecName: "config-out") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:18:33.243548 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.243346 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:18:33.244001 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.243960 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:18:33.244105 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.244033 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:18:33.244478 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.244445 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-kube-api-access-cc9f5" (OuterVolumeSpecName: "kube-api-access-cc9f5") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "kube-api-access-cc9f5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:18:33.246747 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.246549 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:18:33.253047 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.253021 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-web-config" (OuterVolumeSpecName: "web-config") pod "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" (UID: "4ec47666-4a74-447a-ba5f-04d4ee9eeb2b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:18:33.339340 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339300 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-out\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339340 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339333 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339340 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339346 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339356 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-config-volume\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339366 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-main-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339375 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339383 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-metrics-client-ca\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339392 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-web-config\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339443 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339457 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-tls-assets\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339466 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-cluster-tls-config\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.339605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.339474 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc9f5\" (UniqueName: \"kubernetes.io/projected/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b-kube-api-access-cc9f5\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:18:33.842290 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.842259 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerID="276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d" exitCode=0 Sep 15 09:18:33.842290 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.842284 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerID="7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f" exitCode=0 Sep 15 09:18:33.842570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.842333 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerDied","Data":"276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d"} Sep 15 09:18:33.842570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.842348 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:33.842570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.842423 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerDied","Data":"7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f"} Sep 15 09:18:33.842570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.842427 2566 scope.go:117] "RemoveContainer" containerID="d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862" Sep 15 09:18:33.842570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.842456 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ec47666-4a74-447a-ba5f-04d4ee9eeb2b","Type":"ContainerDied","Data":"91349aafbc5f10c01d33fa9faf9defbc32fbad845de10cebae163bfdb73b0036"} Sep 15 09:18:33.850456 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.850435 2566 scope.go:117] "RemoveContainer" containerID="276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d" Sep 15 09:18:33.858246 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.858228 2566 scope.go:117] "RemoveContainer" containerID="effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae" Sep 15 09:18:33.865639 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.865616 2566 scope.go:117] "RemoveContainer" containerID="7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f" Sep 15 09:18:33.870016 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.869992 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 09:18:33.873183 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.873159 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 09:18:33.873939 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.873924 2566 scope.go:117] "RemoveContainer" containerID="e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb" Sep 15 09:18:33.881337 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.881321 2566 scope.go:117] "RemoveContainer" containerID="0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902" Sep 15 09:18:33.888699 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.888682 2566 scope.go:117] "RemoveContainer" containerID="d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb" Sep 15 09:18:33.895895 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.895876 2566 scope.go:117] "RemoveContainer" containerID="d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862" Sep 15 09:18:33.896197 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:18:33.896176 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862\": container with ID starting with d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862 not found: ID does not exist" containerID="d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862" Sep 15 09:18:33.896244 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.896209 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862"} err="failed to get container status \"d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862\": rpc error: code = NotFound desc = could not find container \"d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862\": container with ID starting with d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862 not found: ID does not exist" Sep 15 09:18:33.896244 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.896231 2566 scope.go:117] "RemoveContainer" containerID="276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d" Sep 15 09:18:33.896506 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:18:33.896487 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d\": container with ID starting with 276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d not found: ID does not exist" containerID="276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d" Sep 15 09:18:33.896555 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.896512 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d"} err="failed to get container status \"276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d\": rpc error: code = NotFound desc = could not find container \"276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d\": container with ID starting with 276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d not found: ID does not exist" Sep 15 09:18:33.896555 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.896531 2566 scope.go:117] "RemoveContainer" containerID="effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae" Sep 15 09:18:33.896807 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:18:33.896785 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae\": container with ID starting with effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae not found: ID does not exist" containerID="effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae" Sep 15 09:18:33.896872 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.896816 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae"} err="failed to get container status \"effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae\": rpc error: code = NotFound desc = could not find container \"effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae\": container with ID starting with effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae not found: ID does not exist" Sep 15 09:18:33.896872 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.896841 2566 scope.go:117] "RemoveContainer" containerID="7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f" Sep 15 09:18:33.897089 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:18:33.897074 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f\": container with ID starting with 7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f not found: ID does not exist" containerID="7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f" Sep 15 09:18:33.897150 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.897095 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f"} err="failed to get container status \"7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f\": rpc error: code = NotFound desc = could not find container \"7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f\": container with ID starting with 7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f not found: ID does not exist" Sep 15 09:18:33.897150 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.897114 2566 scope.go:117] "RemoveContainer" containerID="e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb" Sep 15 09:18:33.897380 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:18:33.897363 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb\": container with ID starting with e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb not found: ID does not exist" containerID="e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb" Sep 15 09:18:33.897457 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.897382 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb"} err="failed to get container status \"e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb\": rpc error: code = NotFound desc = could not find container \"e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb\": container with ID starting with e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb not found: ID does not exist" Sep 15 09:18:33.897457 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.897395 2566 scope.go:117] "RemoveContainer" containerID="0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902" Sep 15 09:18:33.897611 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:18:33.897597 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902\": container with ID starting with 0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902 not found: ID does not exist" containerID="0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902" Sep 15 09:18:33.897656 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.897613 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902"} err="failed to get container status \"0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902\": rpc error: code = NotFound desc = could not find container \"0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902\": container with ID starting with 0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902 not found: ID does not exist" Sep 15 09:18:33.897656 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.897624 2566 scope.go:117] "RemoveContainer" containerID="d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb" Sep 15 09:18:33.897859 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:18:33.897842 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb\": container with ID starting with d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb not found: ID does not exist" containerID="d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb" Sep 15 09:18:33.897899 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.897862 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb"} err="failed to get container status \"d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb\": rpc error: code = NotFound desc = could not find container \"d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb\": container with ID starting with d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb not found: ID does not exist" Sep 15 09:18:33.897899 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.897877 2566 scope.go:117] "RemoveContainer" containerID="d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862" Sep 15 09:18:33.898073 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.898058 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862"} err="failed to get container status \"d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862\": rpc error: code = NotFound desc = could not find container \"d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862\": container with ID starting with d9a6a248aa8cc0676c61d589b4f8fb4b30e942d872418ce7edf9c134aa470862 not found: ID does not exist" Sep 15 09:18:33.898119 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.898072 2566 scope.go:117] "RemoveContainer" containerID="276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d" Sep 15 09:18:33.898287 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.898271 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d"} err="failed to get container status \"276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d\": rpc error: code = NotFound desc = could not find container \"276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d\": container with ID starting with 276e882fbcff4edb87e5883b0d48848e6f1f1e5bfd8d1852e16ff79fcf31b58d not found: ID does not exist" Sep 15 09:18:33.898287 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.898286 2566 scope.go:117] "RemoveContainer" containerID="effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae" Sep 15 09:18:33.898501 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.898481 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae"} err="failed to get container status \"effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae\": rpc error: code = NotFound desc = could not find container \"effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae\": container with ID starting with effc3de162542f6cfdf6165bbd0eae16f1b4bf5164c8e970beaffa7390a9c3ae not found: ID does not exist" Sep 15 09:18:33.898569 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.898503 2566 scope.go:117] "RemoveContainer" containerID="7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f" Sep 15 09:18:33.898737 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.898721 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f"} err="failed to get container status \"7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f\": rpc error: code = NotFound desc = could not find container \"7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f\": container with ID starting with 7a7dd040fe0fdeefd7cd0d5b9c36bbbfb79e7633bdb7f5104c2106949f95053f not found: ID does not exist" Sep 15 09:18:33.898798 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.898738 2566 scope.go:117] "RemoveContainer" containerID="e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb" Sep 15 09:18:33.898986 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.898966 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb"} err="failed to get container status \"e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb\": rpc error: code = NotFound desc = could not find container \"e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb\": container with ID starting with e47746db93aa65b6f64f6eeb2e05fbc722c8c88a82ca02027c2588d5c8672bcb not found: ID does not exist" Sep 15 09:18:33.899022 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.898986 2566 scope.go:117] "RemoveContainer" containerID="0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902" Sep 15 09:18:33.899209 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.899193 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902"} err="failed to get container status \"0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902\": rpc error: code = NotFound desc = could not find container \"0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902\": container with ID starting with 0eb1d84dd00507effd50976ceb8f26e5ec4ad5f508c52112482cd728532d2902 not found: ID does not exist" Sep 15 09:18:33.899252 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.899209 2566 scope.go:117] "RemoveContainer" containerID="d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb" Sep 15 09:18:33.899391 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.899376 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb"} err="failed to get container status \"d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb\": rpc error: code = NotFound desc = could not find container \"d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb\": container with ID starting with d2f412896f1dc3bcffa8b62fb67c6cde822292544e46c78b0ba235c2aaf3b7bb not found: ID does not exist" Sep 15 09:18:33.905009 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.904988 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 09:18:33.905272 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905260 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="config-reloader" Sep 15 09:18:33.905325 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905273 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="config-reloader" Sep 15 09:18:33.905325 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905286 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d665a621-12af-4879-bd99-7778907928c7" containerName="registry" Sep 15 09:18:33.905325 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905291 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d665a621-12af-4879-bd99-7778907928c7" containerName="registry" Sep 15 09:18:33.905325 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905299 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="init-config-reloader" Sep 15 09:18:33.905325 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905304 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="init-config-reloader" Sep 15 09:18:33.905325 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905310 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="prom-label-proxy" Sep 15 09:18:33.905325 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905316 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="prom-label-proxy" Sep 15 09:18:33.905325 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905325 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy-metric" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905330 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy-metric" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905337 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy-web" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905342 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy-web" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905348 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905353 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905359 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="alertmanager" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905365 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="alertmanager" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905370 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dcec993-9fbd-470e-adbe-2b8604976b66" containerName="console" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905375 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dcec993-9fbd-470e-adbe-2b8604976b66" containerName="console" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905440 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy-metric" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905449 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy-web" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905455 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="kube-rbac-proxy" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905461 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d665a621-12af-4879-bd99-7778907928c7" containerName="registry" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905466 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dcec993-9fbd-470e-adbe-2b8604976b66" containerName="console" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905472 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="alertmanager" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905479 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="config-reloader" Sep 15 09:18:33.905630 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.905485 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" containerName="prom-label-proxy" Sep 15 09:18:33.910508 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.910485 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:33.913673 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.913380 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 15 09:18:33.913673 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.913462 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 15 09:18:33.913673 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.913477 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 15 09:18:33.913673 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.913504 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-776q8\"" Sep 15 09:18:33.913673 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.913514 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 15 09:18:33.913673 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.913470 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 15 09:18:33.913673 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.913606 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 15 09:18:33.914094 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.913802 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 15 09:18:33.914152 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.914141 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 15 09:18:33.918764 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.918737 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 15 09:18:33.927299 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:33.927276 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 09:18:34.043903 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.043866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.043903 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.043906 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044096 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.043926 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044096 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.044006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-config-volume\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044096 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.044035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044096 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.044057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044096 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.044076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-config-out\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044246 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.044128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-web-config\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044246 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.044168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs7z4\" (UniqueName: \"kubernetes.io/projected/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-kube-api-access-zs7z4\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044246 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.044207 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044335 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.044244 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044335 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.044266 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.044335 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.044286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145188 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145097 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-config-volume\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145188 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145137 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145188 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145188 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145182 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-config-out\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-web-config\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145264 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs7z4\" (UniqueName: \"kubernetes.io/projected/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-kube-api-access-zs7z4\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145348 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145395 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.145523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.146016 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.145978 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.146551 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.146220 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.146551 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.146363 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.148215 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.148188 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-config-out\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.148334 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.148312 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-config-volume\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.148477 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.148449 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.148764 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.148745 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-web-config\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.148845 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.148749 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.148845 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.148825 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.149290 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.149270 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.149344 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.149327 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.150162 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.150137 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.154618 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.154589 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs7z4\" (UniqueName: \"kubernetes.io/projected/52ab40d3-1531-48c3-9cb1-9cb7d1659b80-kube-api-access-zs7z4\") pod \"alertmanager-main-0\" (UID: \"52ab40d3-1531-48c3-9cb1-9cb7d1659b80\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.221582 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.221526 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 09:18:34.504762 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.504736 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 09:18:34.507179 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:18:34.507146 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ab40d3_1531_48c3_9cb1_9cb7d1659b80.slice/crio-6fcf61bde261a034b47c6e0fbf70b6c4e5b117df866951d0b8d9c8d3bfc2dc45 WatchSource:0}: Error finding container 6fcf61bde261a034b47c6e0fbf70b6c4e5b117df866951d0b8d9c8d3bfc2dc45: Status 404 returned error can't find the container with id 6fcf61bde261a034b47c6e0fbf70b6c4e5b117df866951d0b8d9c8d3bfc2dc45 Sep 15 09:18:34.847883 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.847797 2566 generic.go:356] "Generic (PLEG): container finished" podID="52ab40d3-1531-48c3-9cb1-9cb7d1659b80" containerID="403afca94db693b0fdf31be0c06bf79ae622020cd745e1cf05b8eb4182440093" exitCode=0 Sep 15 09:18:34.848059 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.847886 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52ab40d3-1531-48c3-9cb1-9cb7d1659b80","Type":"ContainerDied","Data":"403afca94db693b0fdf31be0c06bf79ae622020cd745e1cf05b8eb4182440093"} Sep 15 09:18:34.848059 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.847958 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52ab40d3-1531-48c3-9cb1-9cb7d1659b80","Type":"ContainerStarted","Data":"6fcf61bde261a034b47c6e0fbf70b6c4e5b117df866951d0b8d9c8d3bfc2dc45"} Sep 15 09:18:34.974742 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:34.974714 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ec47666-4a74-447a-ba5f-04d4ee9eeb2b" path="/var/lib/kubelet/pods/4ec47666-4a74-447a-ba5f-04d4ee9eeb2b/volumes" Sep 15 09:18:35.857009 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:35.856971 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52ab40d3-1531-48c3-9cb1-9cb7d1659b80","Type":"ContainerStarted","Data":"e106e262dcca427b8f0a74e89d3b2531a7d5b2a36fa8a52a46101f067c2ffdf4"} Sep 15 09:18:35.857354 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:35.857036 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52ab40d3-1531-48c3-9cb1-9cb7d1659b80","Type":"ContainerStarted","Data":"c8a61e8a0761ac1ec27c897cb4f0f714e66f0bb5fa6bbeb58f6f474aaff714a0"} Sep 15 09:18:35.857354 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:35.857061 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52ab40d3-1531-48c3-9cb1-9cb7d1659b80","Type":"ContainerStarted","Data":"c1043422bf9f4c3f8d940742179c363fba12a616d43802823b6a2424b9c51e0d"} Sep 15 09:18:35.857354 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:35.857084 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52ab40d3-1531-48c3-9cb1-9cb7d1659b80","Type":"ContainerStarted","Data":"3c25f4212eabce084d9c52c9a5ac7d6013b49dad2fe074450f8ceb8bfedc3e0a"} Sep 15 09:18:35.857354 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:35.857109 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52ab40d3-1531-48c3-9cb1-9cb7d1659b80","Type":"ContainerStarted","Data":"7ea388db7cf9ae556a87ef17e17ac38a2eda7d745c223dc154662be64f0a3b18"} Sep 15 09:18:35.857354 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:35.857134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52ab40d3-1531-48c3-9cb1-9cb7d1659b80","Type":"ContainerStarted","Data":"ebb673e5e2f694270143cffcfaa9ddce1f8afc1a7865d96c2ddd8c3cc3186de0"} Sep 15 09:18:35.885917 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:35.885866 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.869369068 podStartE2EDuration="2.885850754s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.481686ms" isStatefulPod=false podCreationTimestamp="2026-09-15 09:18:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:18:35.885517002 +0000 UTC m=+205.392094439" watchObservedRunningTime="2026-09-15 09:18:35.885850754 +0000 UTC m=+205.392428190" Sep 15 09:18:41.647161 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.647128 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-854ff8dd96-z2q6c"] Sep 15 09:18:41.650549 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.650517 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.659541 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.659516 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-854ff8dd96-z2q6c"] Sep 15 09:18:41.812107 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.812054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn4bh\" (UniqueName: \"kubernetes.io/projected/4b3ec636-2423-4d7e-a74d-226d18a08dba-kube-api-access-kn4bh\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.812107 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.812114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-trusted-ca-bundle\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.812327 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.812189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-oauth-serving-cert\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.812327 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.812229 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-service-ca\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.812327 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.812257 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-serving-cert\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.812460 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.812347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-config\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.812460 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.812385 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-oauth-config\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.913482 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.913446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-config\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.913683 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.913505 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-oauth-config\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.913683 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.913550 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn4bh\" (UniqueName: \"kubernetes.io/projected/4b3ec636-2423-4d7e-a74d-226d18a08dba-kube-api-access-kn4bh\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.913683 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.913586 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-trusted-ca-bundle\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.913683 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.913626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-oauth-serving-cert\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.913683 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.913649 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-service-ca\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.914643 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.914129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-serving-cert\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.914643 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.914606 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-config\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.918423 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.914903 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-service-ca\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.918423 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.914973 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-oauth-serving-cert\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.918423 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.914994 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-trusted-ca-bundle\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.920425 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.920378 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-oauth-config\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.920531 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.920379 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-serving-cert\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.928732 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.928712 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn4bh\" (UniqueName: \"kubernetes.io/projected/4b3ec636-2423-4d7e-a74d-226d18a08dba-kube-api-access-kn4bh\") pod \"console-854ff8dd96-z2q6c\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:41.960230 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:41.960205 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:42.232513 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:42.232358 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-854ff8dd96-z2q6c"] Sep 15 09:18:42.235281 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:18:42.235248 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3ec636_2423_4d7e_a74d_226d18a08dba.slice/crio-c45d07f8c42816c2c9feb4301be802759731d40db8c9efcac28d9bfb9bfaf22e WatchSource:0}: Error finding container c45d07f8c42816c2c9feb4301be802759731d40db8c9efcac28d9bfb9bfaf22e: Status 404 returned error can't find the container with id c45d07f8c42816c2c9feb4301be802759731d40db8c9efcac28d9bfb9bfaf22e Sep 15 09:18:42.884844 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:42.884811 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-854ff8dd96-z2q6c" event={"ID":"4b3ec636-2423-4d7e-a74d-226d18a08dba","Type":"ContainerStarted","Data":"12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33"} Sep 15 09:18:42.885228 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:42.884862 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-854ff8dd96-z2q6c" event={"ID":"4b3ec636-2423-4d7e-a74d-226d18a08dba","Type":"ContainerStarted","Data":"c45d07f8c42816c2c9feb4301be802759731d40db8c9efcac28d9bfb9bfaf22e"} Sep 15 09:18:42.900816 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:42.900765 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-854ff8dd96-z2q6c" podStartSLOduration=1.900749102 podStartE2EDuration="1.900749102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:18:42.899919687 +0000 UTC m=+212.406497123" watchObservedRunningTime="2026-09-15 09:18:42.900749102 +0000 UTC m=+212.407326539" Sep 15 09:18:51.961269 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:51.961229 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:51.961668 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:51.961313 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:51.966026 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:51.966000 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:52.926454 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:52.926426 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:18:53.004442 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:18:53.004392 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7f5bf8c7-zb5m9"] Sep 15 09:19:18.027680 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.027614 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d7f5bf8c7-zb5m9" podUID="6216b95d-0977-4757-a074-231b7cfe8fc6" containerName="console" containerID="cri-o://920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823" gracePeriod=15 Sep 15 09:19:18.254093 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.254069 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:19:18.296769 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.296693 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-oauth-config\") pod \"6216b95d-0977-4757-a074-231b7cfe8fc6\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " Sep 15 09:19:18.296769 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.296740 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-trusted-ca-bundle\") pod \"6216b95d-0977-4757-a074-231b7cfe8fc6\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " Sep 15 09:19:18.296769 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.296766 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-oauth-serving-cert\") pod \"6216b95d-0977-4757-a074-231b7cfe8fc6\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " Sep 15 09:19:18.297004 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.296797 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-service-ca\") pod \"6216b95d-0977-4757-a074-231b7cfe8fc6\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " Sep 15 09:19:18.297004 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.296815 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-serving-cert\") pod \"6216b95d-0977-4757-a074-231b7cfe8fc6\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " Sep 15 09:19:18.297004 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.296839 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-console-config\") pod \"6216b95d-0977-4757-a074-231b7cfe8fc6\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " Sep 15 09:19:18.297004 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.296884 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69ms2\" (UniqueName: \"kubernetes.io/projected/6216b95d-0977-4757-a074-231b7cfe8fc6-kube-api-access-69ms2\") pod \"6216b95d-0977-4757-a074-231b7cfe8fc6\" (UID: \"6216b95d-0977-4757-a074-231b7cfe8fc6\") " Sep 15 09:19:18.297258 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.297226 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-service-ca" (OuterVolumeSpecName: "service-ca") pod "6216b95d-0977-4757-a074-231b7cfe8fc6" (UID: "6216b95d-0977-4757-a074-231b7cfe8fc6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:19:18.297258 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.297244 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6216b95d-0977-4757-a074-231b7cfe8fc6" (UID: "6216b95d-0977-4757-a074-231b7cfe8fc6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:19:18.297358 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.297259 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-console-config" (OuterVolumeSpecName: "console-config") pod "6216b95d-0977-4757-a074-231b7cfe8fc6" (UID: "6216b95d-0977-4757-a074-231b7cfe8fc6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:19:18.297358 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.297249 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6216b95d-0977-4757-a074-231b7cfe8fc6" (UID: "6216b95d-0977-4757-a074-231b7cfe8fc6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:19:18.298952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.298922 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6216b95d-0977-4757-a074-231b7cfe8fc6" (UID: "6216b95d-0977-4757-a074-231b7cfe8fc6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:19:18.299058 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.298975 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6216b95d-0977-4757-a074-231b7cfe8fc6" (UID: "6216b95d-0977-4757-a074-231b7cfe8fc6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:19:18.299058 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.299022 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6216b95d-0977-4757-a074-231b7cfe8fc6-kube-api-access-69ms2" (OuterVolumeSpecName: "kube-api-access-69ms2") pod "6216b95d-0977-4757-a074-231b7cfe8fc6" (UID: "6216b95d-0977-4757-a074-231b7cfe8fc6"). InnerVolumeSpecName "kube-api-access-69ms2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:19:18.397801 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.397775 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-oauth-config\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:19:18.397801 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.397797 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-trusted-ca-bundle\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:19:18.397958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.397807 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-oauth-serving-cert\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:19:18.397958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.397816 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-service-ca\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:19:18.397958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.397823 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6216b95d-0977-4757-a074-231b7cfe8fc6-console-serving-cert\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:19:18.397958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.397832 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6216b95d-0977-4757-a074-231b7cfe8fc6-console-config\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:19:18.397958 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:18.397842 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69ms2\" (UniqueName: \"kubernetes.io/projected/6216b95d-0977-4757-a074-231b7cfe8fc6-kube-api-access-69ms2\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:19:19.036383 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:19.036347 2566 generic.go:356] "Generic (PLEG): container finished" podID="6216b95d-0977-4757-a074-231b7cfe8fc6" containerID="920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823" exitCode=0 Sep 15 09:19:19.036771 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:19.036392 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7f5bf8c7-zb5m9" Sep 15 09:19:19.036771 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:19.036441 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7f5bf8c7-zb5m9" event={"ID":"6216b95d-0977-4757-a074-231b7cfe8fc6","Type":"ContainerDied","Data":"920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823"} Sep 15 09:19:19.036771 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:19.036493 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7f5bf8c7-zb5m9" event={"ID":"6216b95d-0977-4757-a074-231b7cfe8fc6","Type":"ContainerDied","Data":"deec92d50c55cdf6b3255077c61a968882d119305872718589180281d1e332a2"} Sep 15 09:19:19.036771 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:19.036516 2566 scope.go:117] "RemoveContainer" containerID="920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823" Sep 15 09:19:19.044497 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:19.044480 2566 scope.go:117] "RemoveContainer" containerID="920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823" Sep 15 09:19:19.044748 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:19:19.044733 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823\": container with ID starting with 920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823 not found: ID does not exist" containerID="920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823" Sep 15 09:19:19.044792 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:19.044754 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823"} err="failed to get container status \"920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823\": rpc error: code = NotFound desc = could not find container \"920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823\": container with ID starting with 920d56564ee0c085291b5e36d618a3d16fe81ce7cab0c4ed2ce803ae0a744823 not found: ID does not exist" Sep 15 09:19:19.050822 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:19.050801 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7f5bf8c7-zb5m9"] Sep 15 09:19:19.054778 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:19.054758 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d7f5bf8c7-zb5m9"] Sep 15 09:19:20.973921 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:19:20.973888 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6216b95d-0977-4757-a074-231b7cfe8fc6" path="/var/lib/kubelet/pods/6216b95d-0977-4757-a074-231b7cfe8fc6/volumes" Sep 15 09:20:10.917504 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:10.917470 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:20:10.923748 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:10.923725 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:20:10.928468 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:10.928449 2566 kubelet.go:1648] "Image garbage collection succeeded" Sep 15 09:20:29.396842 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.396808 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw"] Sep 15 09:20:29.399150 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.397099 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6216b95d-0977-4757-a074-231b7cfe8fc6" containerName="console" Sep 15 09:20:29.399150 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.397109 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6216b95d-0977-4757-a074-231b7cfe8fc6" containerName="console" Sep 15 09:20:29.399150 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.397166 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6216b95d-0977-4757-a074-231b7cfe8fc6" containerName="console" Sep 15 09:20:29.400083 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.400067 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" Sep 15 09:20:29.402269 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.402251 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 15 09:20:29.403034 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.403014 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 15 09:20:29.403123 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.403015 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-7lbmn\"" Sep 15 09:20:29.407237 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.407217 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw"] Sep 15 09:20:29.449606 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.449583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6gm7\" (UniqueName: \"kubernetes.io/projected/6d206f45-5ab1-4f96-9bda-2174194258a9-kube-api-access-s6gm7\") pod \"feast-operator-controller-manager-7bf78c84dd-7c7lw\" (UID: \"6d206f45-5ab1-4f96-9bda-2174194258a9\") " pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" Sep 15 09:20:29.550252 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.550214 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6gm7\" (UniqueName: \"kubernetes.io/projected/6d206f45-5ab1-4f96-9bda-2174194258a9-kube-api-access-s6gm7\") pod \"feast-operator-controller-manager-7bf78c84dd-7c7lw\" (UID: \"6d206f45-5ab1-4f96-9bda-2174194258a9\") " pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" Sep 15 09:20:29.560251 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.560231 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6gm7\" (UniqueName: \"kubernetes.io/projected/6d206f45-5ab1-4f96-9bda-2174194258a9-kube-api-access-s6gm7\") pod \"feast-operator-controller-manager-7bf78c84dd-7c7lw\" (UID: \"6d206f45-5ab1-4f96-9bda-2174194258a9\") " pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" Sep 15 09:20:29.710959 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.710921 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" Sep 15 09:20:29.977092 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.977065 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw"] Sep 15 09:20:29.979648 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:20:29.979621 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d206f45_5ab1_4f96_9bda_2174194258a9.slice/crio-de86b4984e1ae76f404ac01ea6f9dcc87813503f04379ebc6a324a3f522c1e65 WatchSource:0}: Error finding container de86b4984e1ae76f404ac01ea6f9dcc87813503f04379ebc6a324a3f522c1e65: Status 404 returned error can't find the container with id de86b4984e1ae76f404ac01ea6f9dcc87813503f04379ebc6a324a3f522c1e65 Sep 15 09:20:29.981517 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:29.981499 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 09:20:30.306102 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:30.306024 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" event={"ID":"6d206f45-5ab1-4f96-9bda-2174194258a9","Type":"ContainerStarted","Data":"de86b4984e1ae76f404ac01ea6f9dcc87813503f04379ebc6a324a3f522c1e65"} Sep 15 09:20:33.319474 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:33.319436 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" event={"ID":"6d206f45-5ab1-4f96-9bda-2174194258a9","Type":"ContainerStarted","Data":"a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e"} Sep 15 09:20:33.319941 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:33.319578 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" Sep 15 09:20:33.335471 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:33.335423 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" podStartSLOduration=1.985262568 podStartE2EDuration="4.335387875s" totalImagesPullingTime="2.350125307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:33.333875091 +0000 UTC m=+322.840452527" watchObservedRunningTime="2026-09-15 09:20:33.335387875 +0000 UTC m=+322.841965312" Sep 15 09:20:44.325847 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:20:44.325812 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" Sep 15 09:21:06.346377 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.346290 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6"] Sep 15 09:21:06.350742 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.350716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.352983 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.352960 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 15 09:21:06.353120 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.352960 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 15 09:21:06.353120 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.353021 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 15 09:21:06.353120 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.353044 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 15 09:21:06.353120 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.353056 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-nqpl4\"" Sep 15 09:21:06.353120 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.353110 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 15 09:21:06.353389 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.352971 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 15 09:21:06.353389 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.353368 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 15 09:21:06.362271 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.362252 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6"] Sep 15 09:21:06.458147 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.458115 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-offline-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.458295 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.458156 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-online-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.458295 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.458178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk2x4\" (UniqueName: \"kubernetes.io/projected/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-kube-api-access-gk2x4\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.458295 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.458194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-registry-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.458295 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.458207 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-ui-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.458295 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.458237 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-feast-data\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.559510 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.559467 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-online-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.559510 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.559517 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk2x4\" (UniqueName: \"kubernetes.io/projected/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-kube-api-access-gk2x4\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.559748 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.559536 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-registry-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.559748 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.559553 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-ui-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.559748 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.559591 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-feast-data\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.559748 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.559638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-offline-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.559748 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:21:06.559676 2566 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 15 09:21:06.559748 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:21:06.559750 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-ui-tls podName:033fee42-7ee9-4f7e-a45d-f6fe5b6fd514 nodeName:}" failed. No retries permitted until 2026-09-15 09:21:07.059731182 +0000 UTC m=+356.566308597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-ui-tls") pod "feast-simple-feast-setup-75c5475989-mk2l6" (UID: "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514") : secret "feast-simple-feast-setup-ui-tls" not found Sep 15 09:21:06.560144 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.560118 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-feast-data\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.562048 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.562027 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-offline-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.562150 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.562055 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-registry-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.562150 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.562077 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-online-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:06.569124 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:06.569099 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk2x4\" (UniqueName: \"kubernetes.io/projected/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-kube-api-access-gk2x4\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:07.063177 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:07.063146 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-ui-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:07.065560 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:07.065535 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-ui-tls\") pod \"feast-simple-feast-setup-75c5475989-mk2l6\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:07.269205 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:07.269172 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:07.560228 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:07.560203 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6"] Sep 15 09:21:07.561134 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:21:07.561113 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod033fee42_7ee9_4f7e_a45d_f6fe5b6fd514.slice/crio-e33f7babef8f881ce3be0f0433d92d2468706b847d412e87e9c8441faaecfa46 WatchSource:0}: Error finding container e33f7babef8f881ce3be0f0433d92d2468706b847d412e87e9c8441faaecfa46: Status 404 returned error can't find the container with id e33f7babef8f881ce3be0f0433d92d2468706b847d412e87e9c8441faaecfa46 Sep 15 09:21:08.459764 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:08.459722 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerStarted","Data":"e33f7babef8f881ce3be0f0433d92d2468706b847d412e87e9c8441faaecfa46"} Sep 15 09:21:35.583512 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:35.583467 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerStarted","Data":"34ff6aee884144428e9b373e9b6019fdd95c3db49a8fc32ec4c909d7f1b412ca"} Sep 15 09:21:40.605687 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:40.605656 2566 generic.go:356] "Generic (PLEG): container finished" podID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerID="34ff6aee884144428e9b373e9b6019fdd95c3db49a8fc32ec4c909d7f1b412ca" exitCode=0 Sep 15 09:21:40.606066 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:40.605727 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerDied","Data":"34ff6aee884144428e9b373e9b6019fdd95c3db49a8fc32ec4c909d7f1b412ca"} Sep 15 09:21:41.612682 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:41.612640 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerStarted","Data":"7597f1bfeb78b7cfe92beb8fe8489f1c87e24bb1a5af766d33c04cae9e24ce38"} Sep 15 09:21:47.637867 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:47.637834 2566 generic.go:356] "Generic (PLEG): container finished" podID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerID="7597f1bfeb78b7cfe92beb8fe8489f1c87e24bb1a5af766d33c04cae9e24ce38" exitCode=0 Sep 15 09:21:47.638263 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:47.637871 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerDied","Data":"7597f1bfeb78b7cfe92beb8fe8489f1c87e24bb1a5af766d33c04cae9e24ce38"} Sep 15 09:21:47.646644 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:47.646623 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 15 09:21:48.648681 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:48.648628 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerStarted","Data":"09dc19eb15634c9c1f4bc41aaa20f33007ceae1243f7e65fa6055dc83668f298"} Sep 15 09:21:48.649144 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:48.648692 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerStarted","Data":"4a47c1bda231ba529a65e6ec975ded378c7fe80ae04ee28eaca90962e889ced6"} Sep 15 09:21:48.649144 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:48.648711 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerStarted","Data":"7d15d835c1678865aba47e0202060125615781e83e0b48deaaa3fbc41434a5e8"} Sep 15 09:21:48.649144 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:48.648729 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerStarted","Data":"c3190e057a8a0ab7d27097ffa838093ac5b79db78436ef8ced84c953596d7590"} Sep 15 09:21:48.670814 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:48.670750 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podStartSLOduration=15.398008307 podStartE2EDuration="42.670729799s" totalImagesPullingTime="27.272721492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:48.670041665 +0000 UTC m=+398.176619106" watchObservedRunningTime="2026-09-15 09:21:48.670729799 +0000 UTC m=+398.177307237" Sep 15 09:21:49.269853 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:49.269812 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:49.270131 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:49.270102 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:49.270131 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:49.270135 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:49.270307 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:49.270153 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:49.272158 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:49.272119 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 15 09:21:49.272259 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:49.272151 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Sep 15 09:21:49.272259 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:49.272217 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 15 09:21:49.272417 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:49.272373 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 15 09:21:52.271129 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:52.270743 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 15 09:21:52.271129 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:52.270858 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 15 09:21:52.271129 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:52.271028 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 15 09:21:52.271129 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:52.271086 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Sep 15 09:21:55.270429 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:55.270350 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Sep 15 09:21:55.270429 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:55.270361 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 15 09:21:55.270971 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:55.270454 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 15 09:21:55.270971 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:55.270362 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 15 09:21:57.269901 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:57.269862 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:57.270275 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:57.269937 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:57.270275 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:57.269952 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:57.270275 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:57.269963 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:58.270727 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:58.270667 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:58.271155 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:58.270799 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:58.271155 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:58.271071 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:58.275853 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:58.275830 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:58.698256 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:58.698230 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:58.698432 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:58.698290 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:58.698432 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:58.698327 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:21:58.700921 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:21:58.700895 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:22:25.900684 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:25.900652 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66899f7b6d-9pclg"] Sep 15 09:22:25.914361 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:25.914330 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66899f7b6d-9pclg"] Sep 15 09:22:25.914518 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:25.914442 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.052027 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.051993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae5a08e-f311-43ad-9f95-5899b1a9116a-console-oauth-config\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.052027 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.052025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrc7x\" (UniqueName: \"kubernetes.io/projected/aae5a08e-f311-43ad-9f95-5899b1a9116a-kube-api-access-zrc7x\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.052230 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.052168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae5a08e-f311-43ad-9f95-5899b1a9116a-console-serving-cert\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.052230 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.052214 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-console-config\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.052302 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.052281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-trusted-ca-bundle\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.052336 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.052301 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-oauth-serving-cert\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.052368 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.052332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-service-ca\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.153528 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.153503 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-service-ca\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.153658 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.153550 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae5a08e-f311-43ad-9f95-5899b1a9116a-console-oauth-config\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.153658 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.153566 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrc7x\" (UniqueName: \"kubernetes.io/projected/aae5a08e-f311-43ad-9f95-5899b1a9116a-kube-api-access-zrc7x\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.153658 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.153596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae5a08e-f311-43ad-9f95-5899b1a9116a-console-serving-cert\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.153658 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.153618 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-console-config\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.153658 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.153645 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-trusted-ca-bundle\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.153912 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.153668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-oauth-serving-cert\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.154344 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.154310 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-console-config\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.154504 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.154322 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-service-ca\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.154585 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.154505 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-oauth-serving-cert\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.154670 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.154648 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae5a08e-f311-43ad-9f95-5899b1a9116a-trusted-ca-bundle\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.156045 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.156023 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae5a08e-f311-43ad-9f95-5899b1a9116a-console-serving-cert\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.156152 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.156084 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae5a08e-f311-43ad-9f95-5899b1a9116a-console-oauth-config\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.161153 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.161131 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrc7x\" (UniqueName: \"kubernetes.io/projected/aae5a08e-f311-43ad-9f95-5899b1a9116a-kube-api-access-zrc7x\") pod \"console-66899f7b6d-9pclg\" (UID: \"aae5a08e-f311-43ad-9f95-5899b1a9116a\") " pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.223854 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.223803 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:26.492827 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.492780 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66899f7b6d-9pclg"] Sep 15 09:22:26.495077 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:22:26.495048 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae5a08e_f311_43ad_9f95_5899b1a9116a.slice/crio-a4e08c5bd631802525de4345168f85e074ad6e2079312100123274a114363c26 WatchSource:0}: Error finding container a4e08c5bd631802525de4345168f85e074ad6e2079312100123274a114363c26: Status 404 returned error can't find the container with id a4e08c5bd631802525de4345168f85e074ad6e2079312100123274a114363c26 Sep 15 09:22:26.806322 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.806238 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66899f7b6d-9pclg" event={"ID":"aae5a08e-f311-43ad-9f95-5899b1a9116a","Type":"ContainerStarted","Data":"691f98cb616d2ed6a4e437ad1f01ae910d3c969059051dc75b3e6dd5c5945aa2"} Sep 15 09:22:26.806322 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.806287 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66899f7b6d-9pclg" event={"ID":"aae5a08e-f311-43ad-9f95-5899b1a9116a","Type":"ContainerStarted","Data":"a4e08c5bd631802525de4345168f85e074ad6e2079312100123274a114363c26"} Sep 15 09:22:26.823764 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:26.823715 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66899f7b6d-9pclg" podStartSLOduration=1.823699803 podStartE2EDuration="1.823699803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:22:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:22:26.821867978 +0000 UTC m=+436.328445414" watchObservedRunningTime="2026-09-15 09:22:26.823699803 +0000 UTC m=+436.330277281" Sep 15 09:22:36.224783 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:36.224678 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:36.224783 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:36.224770 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:36.229663 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:36.229644 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:36.850681 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:36.850649 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66899f7b6d-9pclg" Sep 15 09:22:36.895247 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:22:36.895213 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-854ff8dd96-z2q6c"] Sep 15 09:23:00.473163 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.473126 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6"] Sep 15 09:23:00.473606 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.473459 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="registry" containerID="cri-o://c3190e057a8a0ab7d27097ffa838093ac5b79db78436ef8ced84c953596d7590" gracePeriod=30 Sep 15 09:23:00.473606 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.473484 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="offline" containerID="cri-o://4a47c1bda231ba529a65e6ec975ded378c7fe80ae04ee28eaca90962e889ced6" gracePeriod=30 Sep 15 09:23:00.473606 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.473516 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="online" containerID="cri-o://7d15d835c1678865aba47e0202060125615781e83e0b48deaaa3fbc41434a5e8" gracePeriod=30 Sep 15 09:23:00.473606 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.473516 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="ui" containerID="cri-o://09dc19eb15634c9c1f4bc41aaa20f33007ceae1243f7e65fa6055dc83668f298" gracePeriod=30 Sep 15 09:23:00.856535 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.856446 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp"] Sep 15 09:23:00.861411 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.861382 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:00.868087 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.868060 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-gwddw\"" Sep 15 09:23:00.875971 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.875945 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp"] Sep 15 09:23:00.936021 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.935980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-offline-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:00.936197 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.936039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-ui-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:00.936197 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.936059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-feast-data\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:00.936197 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.936116 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-online-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:00.936197 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.936173 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrjc6\" (UniqueName: \"kubernetes.io/projected/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-kube-api-access-jrjc6\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:00.936328 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:00.936228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-registry-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.037005 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.036946 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-offline-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.037195 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.037030 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-ui-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.037195 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.037054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-feast-data\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.037195 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.037089 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-online-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.037195 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:23:01.037097 2566 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 15 09:23:01.037195 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.037143 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrjc6\" (UniqueName: \"kubernetes.io/projected/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-kube-api-access-jrjc6\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.037195 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:23:01.037170 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-offline-tls podName:7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60 nodeName:}" failed. No retries permitted until 2026-09-15 09:23:01.537149261 +0000 UTC m=+471.043726676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-offline-tls") pod "feast-simple-feast-setup-75c5475989-zbdgp" (UID: "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60") : secret "feast-simple-feast-setup-offline-tls" not found Sep 15 09:23:01.037519 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.037255 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-registry-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.037519 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:23:01.037374 2566 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 15 09:23:01.037519 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:23:01.037472 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-registry-tls podName:7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60 nodeName:}" failed. No retries permitted until 2026-09-15 09:23:01.537454204 +0000 UTC m=+471.044031619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-registry-tls") pod "feast-simple-feast-setup-75c5475989-zbdgp" (UID: "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60") : secret "feast-simple-feast-setup-registry-tls" not found Sep 15 09:23:01.037832 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.037807 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-feast-data\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.039834 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.039811 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-online-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.040066 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.040047 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-ui-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.045152 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.045128 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrjc6\" (UniqueName: \"kubernetes.io/projected/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-kube-api-access-jrjc6\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.541839 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.541802 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-registry-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.542299 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.541852 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-offline-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.544343 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.544306 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-offline-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.544477 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.544306 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-registry-tls\") pod \"feast-simple-feast-setup-75c5475989-zbdgp\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.771887 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.771840 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:01.915224 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.915170 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-854ff8dd96-z2q6c" podUID="4b3ec636-2423-4d7e-a74d-226d18a08dba" containerName="console" containerID="cri-o://12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33" gracePeriod=15 Sep 15 09:23:01.959287 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.959255 2566 generic.go:356] "Generic (PLEG): container finished" podID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerID="09dc19eb15634c9c1f4bc41aaa20f33007ceae1243f7e65fa6055dc83668f298" exitCode=0 Sep 15 09:23:01.959287 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.959283 2566 generic.go:356] "Generic (PLEG): container finished" podID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerID="7d15d835c1678865aba47e0202060125615781e83e0b48deaaa3fbc41434a5e8" exitCode=0 Sep 15 09:23:01.959506 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.959323 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerDied","Data":"09dc19eb15634c9c1f4bc41aaa20f33007ceae1243f7e65fa6055dc83668f298"} Sep 15 09:23:01.959506 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:01.959361 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerDied","Data":"7d15d835c1678865aba47e0202060125615781e83e0b48deaaa3fbc41434a5e8"} Sep 15 09:23:02.050242 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.050160 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp"] Sep 15 09:23:02.053140 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:23:02.053108 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b5b37ff_eb06_4ce6_b0bf_c93b991c5f60.slice/crio-97c22b9d3bbe2fb3721b0b399daf1a40d7d9e20f0508d9f50b5a73e878d931e1 WatchSource:0}: Error finding container 97c22b9d3bbe2fb3721b0b399daf1a40d7d9e20f0508d9f50b5a73e878d931e1: Status 404 returned error can't find the container with id 97c22b9d3bbe2fb3721b0b399daf1a40d7d9e20f0508d9f50b5a73e878d931e1 Sep 15 09:23:02.159650 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.159626 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:23:02.247334 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.247297 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn4bh\" (UniqueName: \"kubernetes.io/projected/4b3ec636-2423-4d7e-a74d-226d18a08dba-kube-api-access-kn4bh\") pod \"4b3ec636-2423-4d7e-a74d-226d18a08dba\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " Sep 15 09:23:02.247334 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.247337 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-trusted-ca-bundle\") pod \"4b3ec636-2423-4d7e-a74d-226d18a08dba\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " Sep 15 09:23:02.247621 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.247384 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-config\") pod \"4b3ec636-2423-4d7e-a74d-226d18a08dba\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " Sep 15 09:23:02.247621 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.247507 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-service-ca\") pod \"4b3ec636-2423-4d7e-a74d-226d18a08dba\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " Sep 15 09:23:02.247621 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.247545 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-serving-cert\") pod \"4b3ec636-2423-4d7e-a74d-226d18a08dba\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " Sep 15 09:23:02.247621 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.247579 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-oauth-serving-cert\") pod \"4b3ec636-2423-4d7e-a74d-226d18a08dba\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " Sep 15 09:23:02.247829 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.247655 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-oauth-config\") pod \"4b3ec636-2423-4d7e-a74d-226d18a08dba\" (UID: \"4b3ec636-2423-4d7e-a74d-226d18a08dba\") " Sep 15 09:23:02.247829 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.247798 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-config" (OuterVolumeSpecName: "console-config") pod "4b3ec636-2423-4d7e-a74d-226d18a08dba" (UID: "4b3ec636-2423-4d7e-a74d-226d18a08dba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:23:02.247947 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.247919 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4b3ec636-2423-4d7e-a74d-226d18a08dba" (UID: "4b3ec636-2423-4d7e-a74d-226d18a08dba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:23:02.248014 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.247936 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-config\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:02.248202 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.248163 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-service-ca" (OuterVolumeSpecName: "service-ca") pod "4b3ec636-2423-4d7e-a74d-226d18a08dba" (UID: "4b3ec636-2423-4d7e-a74d-226d18a08dba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:23:02.248328 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.248261 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4b3ec636-2423-4d7e-a74d-226d18a08dba" (UID: "4b3ec636-2423-4d7e-a74d-226d18a08dba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:23:02.250052 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.250030 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b3ec636-2423-4d7e-a74d-226d18a08dba-kube-api-access-kn4bh" (OuterVolumeSpecName: "kube-api-access-kn4bh") pod "4b3ec636-2423-4d7e-a74d-226d18a08dba" (UID: "4b3ec636-2423-4d7e-a74d-226d18a08dba"). InnerVolumeSpecName "kube-api-access-kn4bh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:23:02.250137 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.250036 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4b3ec636-2423-4d7e-a74d-226d18a08dba" (UID: "4b3ec636-2423-4d7e-a74d-226d18a08dba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:23:02.250306 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.250292 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4b3ec636-2423-4d7e-a74d-226d18a08dba" (UID: "4b3ec636-2423-4d7e-a74d-226d18a08dba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:23:02.349029 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.348853 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn4bh\" (UniqueName: \"kubernetes.io/projected/4b3ec636-2423-4d7e-a74d-226d18a08dba-kube-api-access-kn4bh\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:02.349029 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.348890 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-trusted-ca-bundle\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:02.349029 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.348904 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-service-ca\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:02.349029 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.348918 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-serving-cert\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:02.349029 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.348932 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b3ec636-2423-4d7e-a74d-226d18a08dba-oauth-serving-cert\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:02.349029 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.348945 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b3ec636-2423-4d7e-a74d-226d18a08dba-console-oauth-config\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:02.964923 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.964881 2566 generic.go:356] "Generic (PLEG): container finished" podID="4b3ec636-2423-4d7e-a74d-226d18a08dba" containerID="12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33" exitCode=0 Sep 15 09:23:02.965348 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.964934 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-854ff8dd96-z2q6c" Sep 15 09:23:02.965348 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.964961 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-854ff8dd96-z2q6c" event={"ID":"4b3ec636-2423-4d7e-a74d-226d18a08dba","Type":"ContainerDied","Data":"12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33"} Sep 15 09:23:02.965348 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.965036 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-854ff8dd96-z2q6c" event={"ID":"4b3ec636-2423-4d7e-a74d-226d18a08dba","Type":"ContainerDied","Data":"c45d07f8c42816c2c9feb4301be802759731d40db8c9efcac28d9bfb9bfaf22e"} Sep 15 09:23:02.965348 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.965056 2566 scope.go:117] "RemoveContainer" containerID="12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33" Sep 15 09:23:02.966948 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.966926 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerStarted","Data":"7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8"} Sep 15 09:23:02.967033 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.966963 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerStarted","Data":"97c22b9d3bbe2fb3721b0b399daf1a40d7d9e20f0508d9f50b5a73e878d931e1"} Sep 15 09:23:02.978864 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.978841 2566 scope.go:117] "RemoveContainer" containerID="12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33" Sep 15 09:23:02.979570 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:23:02.979503 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33\": container with ID starting with 12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33 not found: ID does not exist" containerID="12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33" Sep 15 09:23:02.979570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:02.979536 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33"} err="failed to get container status \"12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33\": rpc error: code = NotFound desc = could not find container \"12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33\": container with ID starting with 12da0b6cd7d29faa4f549326aae1146942d5a909ba151a0fa50475c1bec24a33 not found: ID does not exist" Sep 15 09:23:03.005171 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:03.005138 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-854ff8dd96-z2q6c"] Sep 15 09:23:03.008690 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:03.008665 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-854ff8dd96-z2q6c"] Sep 15 09:23:04.975435 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:04.975387 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b3ec636-2423-4d7e-a74d-226d18a08dba" path="/var/lib/kubelet/pods/4b3ec636-2423-4d7e-a74d-226d18a08dba/volumes" Sep 15 09:23:06.985737 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:06.985706 2566 generic.go:356] "Generic (PLEG): container finished" podID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerID="7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8" exitCode=0 Sep 15 09:23:06.986119 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:06.985770 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerDied","Data":"7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8"} Sep 15 09:23:07.991961 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:07.991923 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerStarted","Data":"2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c"} Sep 15 09:23:08.698609 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:08.698530 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 15 09:23:08.698609 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:08.698583 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 15 09:23:13.013875 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:13.013841 2566 generic.go:356] "Generic (PLEG): container finished" podID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerID="2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c" exitCode=0 Sep 15 09:23:13.014345 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:13.013921 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerDied","Data":"2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c"} Sep 15 09:23:14.024188 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:14.024135 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerStarted","Data":"740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb"} Sep 15 09:23:14.024692 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:14.024204 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerStarted","Data":"1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46"} Sep 15 09:23:14.024692 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:14.024226 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerStarted","Data":"07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d"} Sep 15 09:23:14.024692 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:14.024245 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerStarted","Data":"57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13"} Sep 15 09:23:14.049801 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:14.049721 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podStartSLOduration=14.049697395 podStartE2EDuration="14.049697395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:14.046884244 +0000 UTC m=+483.553461706" watchObservedRunningTime="2026-09-15 09:23:14.049697395 +0000 UTC m=+483.556274833" Sep 15 09:23:16.772722 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:16.772682 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:16.773286 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:16.773258 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:16.773448 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:16.773294 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:16.773448 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:16.773312 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:16.774911 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:16.774877 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 15 09:23:16.775002 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:16.774922 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 15 09:23:16.775002 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:16.774941 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Sep 15 09:23:16.775165 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:16.775135 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused" Sep 15 09:23:18.698124 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:18.697813 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 15 09:23:18.698124 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:18.698080 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 15 09:23:19.772640 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:19.772585 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused" Sep 15 09:23:19.773118 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:19.772583 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Sep 15 09:23:19.773118 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:19.772583 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 15 09:23:19.773118 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:19.773030 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 15 09:23:21.772687 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:21.772648 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:21.773079 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:21.772727 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:21.773079 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:21.772757 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:21.773079 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:21.772776 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:22.772826 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:22.772770 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:22.773322 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:22.773056 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:22.773322 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:22.773142 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:22.778244 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:22.778220 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:23.074063 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:23.073975 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:23.074207 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:23.074109 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:23.074307 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:23.074290 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:23.076761 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:23.076740 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:23:28.697844 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:28.697806 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 15 09:23:28.698302 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:28.697798 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 15 09:23:28.698302 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:28.697959 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:23:28.698302 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:28.698031 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:23:31.108790 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.108759 2566 generic.go:356] "Generic (PLEG): container finished" podID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerID="4a47c1bda231ba529a65e6ec975ded378c7fe80ae04ee28eaca90962e889ced6" exitCode=137 Sep 15 09:23:31.108790 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.108788 2566 generic.go:356] "Generic (PLEG): container finished" podID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerID="c3190e057a8a0ab7d27097ffa838093ac5b79db78436ef8ced84c953596d7590" exitCode=137 Sep 15 09:23:31.109190 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.108840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerDied","Data":"4a47c1bda231ba529a65e6ec975ded378c7fe80ae04ee28eaca90962e889ced6"} Sep 15 09:23:31.109190 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.108894 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerDied","Data":"c3190e057a8a0ab7d27097ffa838093ac5b79db78436ef8ced84c953596d7590"} Sep 15 09:23:31.123306 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.123283 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:23:31.211639 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.211598 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-online-tls\") pod \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " Sep 15 09:23:31.211639 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.211642 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-offline-tls\") pod \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " Sep 15 09:23:31.211896 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.211687 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk2x4\" (UniqueName: \"kubernetes.io/projected/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-kube-api-access-gk2x4\") pod \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " Sep 15 09:23:31.211896 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.211706 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-registry-tls\") pod \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " Sep 15 09:23:31.211896 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.211738 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-feast-data\") pod \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " Sep 15 09:23:31.211896 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.211877 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-ui-tls\") pod \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\" (UID: \"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514\") " Sep 15 09:23:31.212343 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.212311 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-feast-data" (OuterVolumeSpecName: "feast-data") pod "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" (UID: "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:23:31.214066 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.214039 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-online-tls" (OuterVolumeSpecName: "online-tls") pod "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" (UID: "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:23:31.214168 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.214059 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-kube-api-access-gk2x4" (OuterVolumeSpecName: "kube-api-access-gk2x4") pod "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" (UID: "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514"). InnerVolumeSpecName "kube-api-access-gk2x4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:23:31.214168 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.214059 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" (UID: "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:23:31.214236 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.214185 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" (UID: "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:23:31.214236 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.214202 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" (UID: "033fee42-7ee9-4f7e-a45d-f6fe5b6fd514"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:23:31.312720 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.312635 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-online-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:31.312720 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.312667 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-offline-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:31.312720 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.312677 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk2x4\" (UniqueName: \"kubernetes.io/projected/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-kube-api-access-gk2x4\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:31.312720 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.312686 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-registry-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:31.312720 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.312697 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-feast-data\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:31.312720 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:31.312705 2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514-ui-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:23:32.115899 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.115860 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" event={"ID":"033fee42-7ee9-4f7e-a45d-f6fe5b6fd514","Type":"ContainerDied","Data":"e33f7babef8f881ce3be0f0433d92d2468706b847d412e87e9c8441faaecfa46"} Sep 15 09:23:32.116283 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.115922 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6" Sep 15 09:23:32.116283 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.115925 2566 scope.go:117] "RemoveContainer" containerID="09dc19eb15634c9c1f4bc41aaa20f33007ceae1243f7e65fa6055dc83668f298" Sep 15 09:23:32.127084 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.127067 2566 scope.go:117] "RemoveContainer" containerID="4a47c1bda231ba529a65e6ec975ded378c7fe80ae04ee28eaca90962e889ced6" Sep 15 09:23:32.135233 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.135212 2566 scope.go:117] "RemoveContainer" containerID="7d15d835c1678865aba47e0202060125615781e83e0b48deaaa3fbc41434a5e8" Sep 15 09:23:32.138011 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.137990 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6"] Sep 15 09:23:32.143228 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.143204 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-mk2l6"] Sep 15 09:23:32.143753 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.143739 2566 scope.go:117] "RemoveContainer" containerID="c3190e057a8a0ab7d27097ffa838093ac5b79db78436ef8ced84c953596d7590" Sep 15 09:23:32.151203 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.151184 2566 scope.go:117] "RemoveContainer" containerID="7597f1bfeb78b7cfe92beb8fe8489f1c87e24bb1a5af766d33c04cae9e24ce38" Sep 15 09:23:32.158039 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.158017 2566 scope.go:117] "RemoveContainer" containerID="34ff6aee884144428e9b373e9b6019fdd95c3db49a8fc32ec4c909d7f1b412ca" Sep 15 09:23:32.974822 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:23:32.974781 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" path="/var/lib/kubelet/pods/033fee42-7ee9-4f7e-a45d-f6fe5b6fd514/volumes" Sep 15 09:24:25.833395 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833361 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx"] Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833679 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="offline" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833691 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="offline" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833703 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="online" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833709 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="online" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833715 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3ec636-2423-4d7e-a74d-226d18a08dba" containerName="console" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833721 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3ec636-2423-4d7e-a74d-226d18a08dba" containerName="console" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833727 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="ui" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833733 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="ui" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833747 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="feast-init" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833752 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="feast-init" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833761 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="registry" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833766 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="registry" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833773 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="feast-apply" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833778 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="feast-apply" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833824 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="registry" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833833 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3ec636-2423-4d7e-a74d-226d18a08dba" containerName="console" Sep 15 09:24:25.833836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833838 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="offline" Sep 15 09:24:25.834645 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833846 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="online" Sep 15 09:24:25.834645 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.833854 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="033fee42-7ee9-4f7e-a45d-f6fe5b6fd514" containerName="ui" Sep 15 09:24:25.838486 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.838467 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:25.840653 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.840625 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 15 09:24:25.840653 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.840626 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 15 09:24:25.840839 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.840669 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 15 09:24:25.840839 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.840719 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-bh5b2\"" Sep 15 09:24:25.840839 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.840669 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 15 09:24:25.841076 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.841059 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 15 09:24:25.841422 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.841383 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 15 09:24:25.841494 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.841440 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 15 09:24:25.847620 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.847598 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx"] Sep 15 09:24:25.945388 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.945353 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-offline-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:25.945561 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.945396 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/84641722-bc61-47d8-8d38-20a801258185-registry-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:25.945561 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.945495 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-online-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:25.945561 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.945547 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-ui-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:25.945667 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.945567 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/84641722-bc61-47d8-8d38-20a801258185-feast-data\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:25.945667 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:25.945603 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqjlw\" (UniqueName: \"kubernetes.io/projected/84641722-bc61-47d8-8d38-20a801258185-kube-api-access-kqjlw\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.047004 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.046970 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqjlw\" (UniqueName: \"kubernetes.io/projected/84641722-bc61-47d8-8d38-20a801258185-kube-api-access-kqjlw\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.047004 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.047007 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-offline-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.047238 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.047030 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/84641722-bc61-47d8-8d38-20a801258185-registry-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.047238 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.047225 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-online-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.047342 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.047284 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-ui-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.047342 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.047313 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/84641722-bc61-47d8-8d38-20a801258185-feast-data\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.047714 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.047687 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/84641722-bc61-47d8-8d38-20a801258185-feast-data\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.047905 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.047883 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/84641722-bc61-47d8-8d38-20a801258185-registry-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.049568 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.049541 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-offline-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.049674 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.049638 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-ui-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.049725 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.049679 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-online-tls\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.053885 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.053863 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqjlw\" (UniqueName: \"kubernetes.io/projected/84641722-bc61-47d8-8d38-20a801258185-kube-api-access-kqjlw\") pod \"feast-simple-feast-remote-setup-685567f4f8-qchdx\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.148003 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.147938 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:26.422559 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:26.422523 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx"] Sep 15 09:24:26.424894 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:24:26.424855 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84641722_bc61_47d8_8d38_20a801258185.slice/crio-333ff6ec85cef42f195dfb2912be5dca62093daaa0923322689cdd2b97a0c39d WatchSource:0}: Error finding container 333ff6ec85cef42f195dfb2912be5dca62093daaa0923322689cdd2b97a0c39d: Status 404 returned error can't find the container with id 333ff6ec85cef42f195dfb2912be5dca62093daaa0923322689cdd2b97a0c39d Sep 15 09:24:27.335834 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:27.335786 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerStarted","Data":"7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9"} Sep 15 09:24:27.336350 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:27.335846 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerStarted","Data":"333ff6ec85cef42f195dfb2912be5dca62093daaa0923322689cdd2b97a0c39d"} Sep 15 09:24:31.353697 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:31.353660 2566 generic.go:356] "Generic (PLEG): container finished" podID="84641722-bc61-47d8-8d38-20a801258185" containerID="7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9" exitCode=0 Sep 15 09:24:31.354050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:31.353717 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerDied","Data":"7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9"} Sep 15 09:24:32.360571 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:32.360537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerStarted","Data":"9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650"} Sep 15 09:24:52.444470 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:52.444428 2566 generic.go:356] "Generic (PLEG): container finished" podID="84641722-bc61-47d8-8d38-20a801258185" containerID="9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650" exitCode=0 Sep 15 09:24:52.444855 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:52.444442 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerDied","Data":"9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650"} Sep 15 09:24:53.453800 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:53.453756 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerStarted","Data":"2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7"} Sep 15 09:24:53.454259 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:53.453813 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerStarted","Data":"892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953"} Sep 15 09:24:53.454259 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:53.453827 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerStarted","Data":"6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8"} Sep 15 09:24:53.476731 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:53.476674 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podStartSLOduration=28.476644123 podStartE2EDuration="28.476644123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:24:53.476166604 +0000 UTC m=+582.982744067" watchObservedRunningTime="2026-09-15 09:24:53.476644123 +0000 UTC m=+582.983221563" Sep 15 09:24:56.148834 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:56.148793 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:56.149395 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:56.149361 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:56.149524 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:56.149436 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:56.149524 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:56.149458 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:56.149524 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:56.149475 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:56.149771 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:56.149758 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:24:56.150438 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:56.150385 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused" Sep 15 09:24:56.150530 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:56.150439 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Sep 15 09:24:56.150530 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:56.150487 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 15 09:24:59.148667 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:59.148621 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Sep 15 09:24:59.148667 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:59.148657 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 15 09:24:59.149241 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:24:59.148621 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused" Sep 15 09:25:02.149119 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:25:02.149084 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:25:02.149609 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:25:02.149574 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:25:02.149882 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:25:02.149866 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:25:02.168709 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:25:02.168682 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:25:02.499567 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:25:02.499540 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:25:02.516665 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:25:02.516633 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:25:10.948003 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:25:10.947978 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:25:10.951313 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:25:10.951288 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:26:04.071209 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:04.071177 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx"] Sep 15 09:26:04.071741 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:04.071391 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="online" containerID="cri-o://6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8" gracePeriod=30 Sep 15 09:26:04.071741 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:04.071499 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="ui" containerID="cri-o://2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7" gracePeriod=30 Sep 15 09:26:04.071741 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:04.071488 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="offline" containerID="cri-o://892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953" gracePeriod=30 Sep 15 09:26:04.175355 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:04.175318 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp"] Sep 15 09:26:04.175725 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:04.175622 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="registry" containerID="cri-o://57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13" gracePeriod=30 Sep 15 09:26:04.175725 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:04.175681 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="online" containerID="cri-o://07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d" gracePeriod=30 Sep 15 09:26:04.175725 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:04.175682 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="offline" containerID="cri-o://1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46" gracePeriod=30 Sep 15 09:26:04.175947 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:04.175685 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="ui" containerID="cri-o://740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb" gracePeriod=30 Sep 15 09:26:05.760128 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:05.760098 2566 generic.go:356] "Generic (PLEG): container finished" podID="84641722-bc61-47d8-8d38-20a801258185" containerID="2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7" exitCode=0 Sep 15 09:26:05.760128 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:05.760121 2566 generic.go:356] "Generic (PLEG): container finished" podID="84641722-bc61-47d8-8d38-20a801258185" containerID="6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8" exitCode=0 Sep 15 09:26:05.760574 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:05.760167 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerDied","Data":"2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7"} Sep 15 09:26:05.760574 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:05.760206 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerDied","Data":"6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8"} Sep 15 09:26:05.763051 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:05.763032 2566 generic.go:356] "Generic (PLEG): container finished" podID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerID="740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb" exitCode=0 Sep 15 09:26:05.763051 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:05.763048 2566 generic.go:356] "Generic (PLEG): container finished" podID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerID="07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d" exitCode=0 Sep 15 09:26:05.763187 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:05.763078 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerDied","Data":"740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb"} Sep 15 09:26:05.763187 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:05.763102 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerDied","Data":"07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d"} Sep 15 09:26:12.499070 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:12.499029 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Sep 15 09:26:12.499070 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:12.499051 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 15 09:26:13.073586 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:13.073536 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 15 09:26:13.073787 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:13.073555 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 15 09:26:22.500013 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:22.499966 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Sep 15 09:26:22.500433 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:22.499988 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 15 09:26:23.073645 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:23.073594 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 15 09:26:23.073830 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:23.073664 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 15 09:26:32.499992 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:32.499947 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Sep 15 09:26:32.500518 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:32.499997 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 15 09:26:32.500518 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:32.500083 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:26:32.500518 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:32.500159 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:26:33.073522 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:33.073473 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 15 09:26:33.073717 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:33.073535 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 15 09:26:33.073717 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:33.073606 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:26:33.073826 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:33.073812 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:26:34.305414 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.305378 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:26:34.346267 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.346205 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-online-tls\") pod \"84641722-bc61-47d8-8d38-20a801258185\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " Sep 15 09:26:34.346267 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.346240 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/84641722-bc61-47d8-8d38-20a801258185-registry-tls\") pod \"84641722-bc61-47d8-8d38-20a801258185\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " Sep 15 09:26:34.346450 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.346274 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-ui-tls\") pod \"84641722-bc61-47d8-8d38-20a801258185\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " Sep 15 09:26:34.346515 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.346461 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-offline-tls\") pod \"84641722-bc61-47d8-8d38-20a801258185\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " Sep 15 09:26:34.346577 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.346514 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqjlw\" (UniqueName: \"kubernetes.io/projected/84641722-bc61-47d8-8d38-20a801258185-kube-api-access-kqjlw\") pod \"84641722-bc61-47d8-8d38-20a801258185\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " Sep 15 09:26:34.346577 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.346546 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/84641722-bc61-47d8-8d38-20a801258185-feast-data\") pod \"84641722-bc61-47d8-8d38-20a801258185\" (UID: \"84641722-bc61-47d8-8d38-20a801258185\") " Sep 15 09:26:34.346721 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.346600 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84641722-bc61-47d8-8d38-20a801258185-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "84641722-bc61-47d8-8d38-20a801258185" (UID: "84641722-bc61-47d8-8d38-20a801258185"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:26:34.346839 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.346814 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/84641722-bc61-47d8-8d38-20a801258185-registry-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.347026 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.346999 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84641722-bc61-47d8-8d38-20a801258185-feast-data" (OuterVolumeSpecName: "feast-data") pod "84641722-bc61-47d8-8d38-20a801258185" (UID: "84641722-bc61-47d8-8d38-20a801258185"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:26:34.348700 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.348670 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "84641722-bc61-47d8-8d38-20a801258185" (UID: "84641722-bc61-47d8-8d38-20a801258185"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:26:34.348782 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.348692 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84641722-bc61-47d8-8d38-20a801258185-kube-api-access-kqjlw" (OuterVolumeSpecName: "kube-api-access-kqjlw") pod "84641722-bc61-47d8-8d38-20a801258185" (UID: "84641722-bc61-47d8-8d38-20a801258185"). InnerVolumeSpecName "kube-api-access-kqjlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:26:34.348830 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.348786 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "84641722-bc61-47d8-8d38-20a801258185" (UID: "84641722-bc61-47d8-8d38-20a801258185"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:26:34.348830 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.348812 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-online-tls" (OuterVolumeSpecName: "online-tls") pod "84641722-bc61-47d8-8d38-20a801258185" (UID: "84641722-bc61-47d8-8d38-20a801258185"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:26:34.447952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.447930 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-online-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.447952 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.447950 2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-ui-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.448092 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.447959 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/84641722-bc61-47d8-8d38-20a801258185-offline-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.448092 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.447968 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqjlw\" (UniqueName: \"kubernetes.io/projected/84641722-bc61-47d8-8d38-20a801258185-kube-api-access-kqjlw\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.448092 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.447977 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/84641722-bc61-47d8-8d38-20a801258185-feast-data\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.806252 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.806229 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:26:34.851861 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.851834 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-registry-tls\") pod \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " Sep 15 09:26:34.851999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.851893 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-feast-data\") pod \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " Sep 15 09:26:34.851999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.851909 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-online-tls\") pod \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " Sep 15 09:26:34.851999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.851926 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-ui-tls\") pod \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " Sep 15 09:26:34.851999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.851956 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrjc6\" (UniqueName: \"kubernetes.io/projected/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-kube-api-access-jrjc6\") pod \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " Sep 15 09:26:34.851999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.851978 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-offline-tls\") pod \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\" (UID: \"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60\") " Sep 15 09:26:34.852520 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.852486 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-feast-data" (OuterVolumeSpecName: "feast-data") pod "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" (UID: "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:26:34.854011 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.853979 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" (UID: "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:26:34.854114 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.854024 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" (UID: "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:26:34.854114 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.854051 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-kube-api-access-jrjc6" (OuterVolumeSpecName: "kube-api-access-jrjc6") pod "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" (UID: "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60"). InnerVolumeSpecName "kube-api-access-jrjc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:26:34.854366 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.854344 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-online-tls" (OuterVolumeSpecName: "online-tls") pod "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" (UID: "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:26:34.854366 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.854356 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" (UID: "7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:26:34.882747 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.882720 2566 generic.go:356] "Generic (PLEG): container finished" podID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerID="1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46" exitCode=137 Sep 15 09:26:34.882747 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.882745 2566 generic.go:356] "Generic (PLEG): container finished" podID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerID="57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13" exitCode=137 Sep 15 09:26:34.882878 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.882793 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" Sep 15 09:26:34.882878 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.882785 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerDied","Data":"1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46"} Sep 15 09:26:34.882973 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.882922 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerDied","Data":"57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13"} Sep 15 09:26:34.882973 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.882951 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp" event={"ID":"7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60","Type":"ContainerDied","Data":"97c22b9d3bbe2fb3721b0b399daf1a40d7d9e20f0508d9f50b5a73e878d931e1"} Sep 15 09:26:34.883049 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.882975 2566 scope.go:117] "RemoveContainer" containerID="740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb" Sep 15 09:26:34.885684 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.885666 2566 generic.go:356] "Generic (PLEG): container finished" podID="84641722-bc61-47d8-8d38-20a801258185" containerID="892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953" exitCode=137 Sep 15 09:26:34.885775 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.885709 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerDied","Data":"892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953"} Sep 15 09:26:34.885775 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.885731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" event={"ID":"84641722-bc61-47d8-8d38-20a801258185","Type":"ContainerDied","Data":"333ff6ec85cef42f195dfb2912be5dca62093daaa0923322689cdd2b97a0c39d"} Sep 15 09:26:34.885775 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.885757 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx" Sep 15 09:26:34.891373 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.891356 2566 scope.go:117] "RemoveContainer" containerID="1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46" Sep 15 09:26:34.900156 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.900141 2566 scope.go:117] "RemoveContainer" containerID="07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d" Sep 15 09:26:34.906231 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.906208 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp"] Sep 15 09:26:34.907752 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.907738 2566 scope.go:117] "RemoveContainer" containerID="57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13" Sep 15 09:26:34.910167 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.910148 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c5475989-zbdgp"] Sep 15 09:26:34.915426 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.915392 2566 scope.go:117] "RemoveContainer" containerID="2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c" Sep 15 09:26:34.920228 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.920209 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx"] Sep 15 09:26:34.922791 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.922772 2566 scope.go:117] "RemoveContainer" containerID="7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8" Sep 15 09:26:34.924016 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.923997 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-685567f4f8-qchdx"] Sep 15 09:26:34.929567 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.929549 2566 scope.go:117] "RemoveContainer" containerID="740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb" Sep 15 09:26:34.929827 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.929804 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb\": container with ID starting with 740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb not found: ID does not exist" containerID="740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb" Sep 15 09:26:34.929869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.929836 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb"} err="failed to get container status \"740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb\": rpc error: code = NotFound desc = could not find container \"740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb\": container with ID starting with 740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb not found: ID does not exist" Sep 15 09:26:34.929869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.929853 2566 scope.go:117] "RemoveContainer" containerID="1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46" Sep 15 09:26:34.930111 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.930090 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46\": container with ID starting with 1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46 not found: ID does not exist" containerID="1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46" Sep 15 09:26:34.930189 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.930113 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46"} err="failed to get container status \"1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46\": rpc error: code = NotFound desc = could not find container \"1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46\": container with ID starting with 1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46 not found: ID does not exist" Sep 15 09:26:34.930189 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.930130 2566 scope.go:117] "RemoveContainer" containerID="07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d" Sep 15 09:26:34.930375 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.930358 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d\": container with ID starting with 07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d not found: ID does not exist" containerID="07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d" Sep 15 09:26:34.930428 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.930380 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d"} err="failed to get container status \"07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d\": rpc error: code = NotFound desc = could not find container \"07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d\": container with ID starting with 07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d not found: ID does not exist" Sep 15 09:26:34.930428 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.930394 2566 scope.go:117] "RemoveContainer" containerID="57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13" Sep 15 09:26:34.930665 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.930650 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13\": container with ID starting with 57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13 not found: ID does not exist" containerID="57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13" Sep 15 09:26:34.930702 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.930667 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13"} err="failed to get container status \"57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13\": rpc error: code = NotFound desc = could not find container \"57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13\": container with ID starting with 57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13 not found: ID does not exist" Sep 15 09:26:34.930702 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.930684 2566 scope.go:117] "RemoveContainer" containerID="2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c" Sep 15 09:26:34.930940 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.930924 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c\": container with ID starting with 2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c not found: ID does not exist" containerID="2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c" Sep 15 09:26:34.930988 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.930943 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c"} err="failed to get container status \"2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c\": rpc error: code = NotFound desc = could not find container \"2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c\": container with ID starting with 2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c not found: ID does not exist" Sep 15 09:26:34.930988 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.930956 2566 scope.go:117] "RemoveContainer" containerID="7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8" Sep 15 09:26:34.931172 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.931158 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8\": container with ID starting with 7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8 not found: ID does not exist" containerID="7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8" Sep 15 09:26:34.931209 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.931174 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8"} err="failed to get container status \"7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8\": rpc error: code = NotFound desc = could not find container \"7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8\": container with ID starting with 7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8 not found: ID does not exist" Sep 15 09:26:34.931209 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.931186 2566 scope.go:117] "RemoveContainer" containerID="740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb" Sep 15 09:26:34.931377 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.931362 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb"} err="failed to get container status \"740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb\": rpc error: code = NotFound desc = could not find container \"740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb\": container with ID starting with 740127ab1b2637764e1f6037cbcf174571314f127feb912091e6be1fd025a8eb not found: ID does not exist" Sep 15 09:26:34.931437 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.931377 2566 scope.go:117] "RemoveContainer" containerID="1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46" Sep 15 09:26:34.931640 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.931622 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46"} err="failed to get container status \"1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46\": rpc error: code = NotFound desc = could not find container \"1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46\": container with ID starting with 1ff5630b96ad1d6b36f700e185662738b310dabfff35e357d40f7658fd5dfe46 not found: ID does not exist" Sep 15 09:26:34.931683 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.931641 2566 scope.go:117] "RemoveContainer" containerID="07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d" Sep 15 09:26:34.931842 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.931828 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d"} err="failed to get container status \"07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d\": rpc error: code = NotFound desc = could not find container \"07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d\": container with ID starting with 07ad3ad76a8e1251ccdfcf03e71a08cfee6ab1c8dd3c704d99190ab68fe9942d not found: ID does not exist" Sep 15 09:26:34.931842 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.931842 2566 scope.go:117] "RemoveContainer" containerID="57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13" Sep 15 09:26:34.932072 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.932057 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13"} err="failed to get container status \"57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13\": rpc error: code = NotFound desc = could not find container \"57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13\": container with ID starting with 57e36ceebf89fce54b5d6ffd1055324458be0fab851c2e87f8293f633dbd1d13 not found: ID does not exist" Sep 15 09:26:34.932072 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.932072 2566 scope.go:117] "RemoveContainer" containerID="2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c" Sep 15 09:26:34.932263 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.932249 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c"} err="failed to get container status \"2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c\": rpc error: code = NotFound desc = could not find container \"2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c\": container with ID starting with 2d29b61dc88a0c523b34e734af7952a60d70935cd969faa6f9a356e39d53882c not found: ID does not exist" Sep 15 09:26:34.932312 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.932263 2566 scope.go:117] "RemoveContainer" containerID="7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8" Sep 15 09:26:34.932531 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.932512 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8"} err="failed to get container status \"7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8\": rpc error: code = NotFound desc = could not find container \"7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8\": container with ID starting with 7778ed34d5a96761bc39b3c458ef00bd7d6e882a3a32209ef65b3e503353cbb8 not found: ID does not exist" Sep 15 09:26:34.932531 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.932531 2566 scope.go:117] "RemoveContainer" containerID="2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7" Sep 15 09:26:34.939234 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.939217 2566 scope.go:117] "RemoveContainer" containerID="892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953" Sep 15 09:26:34.945901 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.945884 2566 scope.go:117] "RemoveContainer" containerID="6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8" Sep 15 09:26:34.952549 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.952534 2566 scope.go:117] "RemoveContainer" containerID="9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650" Sep 15 09:26:34.952842 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.952823 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-offline-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.952911 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.952848 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-registry-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.952911 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.952861 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-feast-data\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.952911 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.952875 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-online-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.952911 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.952887 2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-ui-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.952911 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.952898 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrjc6\" (UniqueName: \"kubernetes.io/projected/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60-kube-api-access-jrjc6\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:26:34.959051 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.959036 2566 scope.go:117] "RemoveContainer" containerID="7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9" Sep 15 09:26:34.965605 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.965590 2566 scope.go:117] "RemoveContainer" containerID="2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7" Sep 15 09:26:34.965833 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.965817 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7\": container with ID starting with 2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7 not found: ID does not exist" containerID="2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7" Sep 15 09:26:34.965878 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.965838 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7"} err="failed to get container status \"2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7\": rpc error: code = NotFound desc = could not find container \"2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7\": container with ID starting with 2689f14e5a7e582913825e8ac5420390a828f480d43bae3f1e7d93a6a1270fd7 not found: ID does not exist" Sep 15 09:26:34.965878 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.965852 2566 scope.go:117] "RemoveContainer" containerID="892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953" Sep 15 09:26:34.966086 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.966070 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953\": container with ID starting with 892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953 not found: ID does not exist" containerID="892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953" Sep 15 09:26:34.966125 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.966089 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953"} err="failed to get container status \"892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953\": rpc error: code = NotFound desc = could not find container \"892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953\": container with ID starting with 892d0609ef5a4e15856e2bd7c22d3a234f6674c61ae8ef8d7e9e796f9c4da953 not found: ID does not exist" Sep 15 09:26:34.966125 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.966101 2566 scope.go:117] "RemoveContainer" containerID="6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8" Sep 15 09:26:34.966315 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.966295 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8\": container with ID starting with 6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8 not found: ID does not exist" containerID="6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8" Sep 15 09:26:34.966386 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.966323 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8"} err="failed to get container status \"6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8\": rpc error: code = NotFound desc = could not find container \"6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8\": container with ID starting with 6124218366c9cf8fcd3c01f18a42e403c72286632db2684a9a2d8a955d45ebb8 not found: ID does not exist" Sep 15 09:26:34.966386 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.966344 2566 scope.go:117] "RemoveContainer" containerID="9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650" Sep 15 09:26:34.966626 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.966610 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650\": container with ID starting with 9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650 not found: ID does not exist" containerID="9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650" Sep 15 09:26:34.966670 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.966629 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650"} err="failed to get container status \"9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650\": rpc error: code = NotFound desc = could not find container \"9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650\": container with ID starting with 9fae59200f503726f9bb442f6e403607a79d361b67741bf21840b9d63f4df650 not found: ID does not exist" Sep 15 09:26:34.966670 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.966640 2566 scope.go:117] "RemoveContainer" containerID="7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9" Sep 15 09:26:34.966855 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:26:34.966839 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9\": container with ID starting with 7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9 not found: ID does not exist" containerID="7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9" Sep 15 09:26:34.966906 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.966861 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9"} err="failed to get container status \"7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9\": rpc error: code = NotFound desc = could not find container \"7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9\": container with ID starting with 7956721ca1515121e5f5eb136e53f96494eac291903c5c3acad83d27a925f9a9 not found: ID does not exist" Sep 15 09:26:34.973556 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.973538 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" path="/var/lib/kubelet/pods/7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60/volumes" Sep 15 09:26:34.974128 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:34.974115 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84641722-bc61-47d8-8d38-20a801258185" path="/var/lib/kubelet/pods/84641722-bc61-47d8-8d38-20a801258185/volumes" Sep 15 09:26:46.902056 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902027 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-wztnb"] Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902361 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="feast-apply" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902373 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="feast-apply" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902382 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="registry" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902387 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="registry" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902394 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="feast-apply" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902416 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="feast-apply" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902425 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="ui" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902431 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="ui" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902441 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="offline" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902445 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="offline" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902454 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="ui" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902459 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="ui" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902466 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="feast-init" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902471 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="feast-init" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902479 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="online" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902487 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="online" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902497 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="online" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902502 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="online" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902512 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="offline" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902518 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="offline" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902524 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="feast-init" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902529 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="feast-init" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902584 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="ui" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902593 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="online" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902600 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="offline" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902606 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="84641722-bc61-47d8-8d38-20a801258185" containerName="offline" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902611 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="ui" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902617 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="registry" Sep 15 09:26:46.902654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.902622 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5b37ff-eb06-4ce6-b0bf-c93b991c5f60" containerName="online" Sep 15 09:26:46.905446 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.905428 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wztnb" Sep 15 09:26:46.907439 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.907420 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 15 09:26:46.907547 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.907515 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 15 09:26:46.908209 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.908194 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 15 09:26:46.908263 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.908212 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-97nn7\"" Sep 15 09:26:46.914048 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.914028 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wztnb"] Sep 15 09:26:46.928291 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.928239 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-jdwgp"] Sep 15 09:26:46.931487 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.931461 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-jdwgp" Sep 15 09:26:46.938744 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:46.938724 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-jdwgp"] Sep 15 09:26:47.050307 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.050282 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-postgresdata\") pod \"postgres-864846d4f5-wztnb\" (UID: \"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36\") " pod="test-ns-feast/postgres-864846d4f5-wztnb" Sep 15 09:26:47.050456 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.050320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rdmj\" (UniqueName: \"kubernetes.io/projected/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-kube-api-access-2rdmj\") pod \"postgres-864846d4f5-wztnb\" (UID: \"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36\") " pod="test-ns-feast/postgres-864846d4f5-wztnb" Sep 15 09:26:47.050456 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.050340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw25m\" (UniqueName: \"kubernetes.io/projected/b710c606-56a3-47d7-92e2-9be8f3d70acc-kube-api-access-nw25m\") pod \"redis-69bbd798b6-jdwgp\" (UID: \"b710c606-56a3-47d7-92e2-9be8f3d70acc\") " pod="test-ns-feast/redis-69bbd798b6-jdwgp" Sep 15 09:26:47.151266 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.151230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-postgresdata\") pod \"postgres-864846d4f5-wztnb\" (UID: \"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36\") " pod="test-ns-feast/postgres-864846d4f5-wztnb" Sep 15 09:26:47.151498 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.151282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rdmj\" (UniqueName: \"kubernetes.io/projected/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-kube-api-access-2rdmj\") pod \"postgres-864846d4f5-wztnb\" (UID: \"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36\") " pod="test-ns-feast/postgres-864846d4f5-wztnb" Sep 15 09:26:47.151498 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.151306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw25m\" (UniqueName: \"kubernetes.io/projected/b710c606-56a3-47d7-92e2-9be8f3d70acc-kube-api-access-nw25m\") pod \"redis-69bbd798b6-jdwgp\" (UID: \"b710c606-56a3-47d7-92e2-9be8f3d70acc\") " pod="test-ns-feast/redis-69bbd798b6-jdwgp" Sep 15 09:26:47.151700 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.151665 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-postgresdata\") pod \"postgres-864846d4f5-wztnb\" (UID: \"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36\") " pod="test-ns-feast/postgres-864846d4f5-wztnb" Sep 15 09:26:47.160705 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.160649 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw25m\" (UniqueName: \"kubernetes.io/projected/b710c606-56a3-47d7-92e2-9be8f3d70acc-kube-api-access-nw25m\") pod \"redis-69bbd798b6-jdwgp\" (UID: \"b710c606-56a3-47d7-92e2-9be8f3d70acc\") " pod="test-ns-feast/redis-69bbd798b6-jdwgp" Sep 15 09:26:47.160705 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.160655 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rdmj\" (UniqueName: \"kubernetes.io/projected/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-kube-api-access-2rdmj\") pod \"postgres-864846d4f5-wztnb\" (UID: \"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36\") " pod="test-ns-feast/postgres-864846d4f5-wztnb" Sep 15 09:26:47.228718 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.228694 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wztnb" Sep 15 09:26:47.241722 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.241703 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-jdwgp" Sep 15 09:26:47.496968 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.496946 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wztnb"] Sep 15 09:26:47.499089 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:26:47.499061 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff3fbc61_ba24_4bfc_a3c3_fa5aa0aaea36.slice/crio-162d400d01ca5e193ee4bc446212d075d2c076cef25b8da8f8172661ab83da95 WatchSource:0}: Error finding container 162d400d01ca5e193ee4bc446212d075d2c076cef25b8da8f8172661ab83da95: Status 404 returned error can't find the container with id 162d400d01ca5e193ee4bc446212d075d2c076cef25b8da8f8172661ab83da95 Sep 15 09:26:47.501090 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.501071 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 09:26:47.515808 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.515787 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-jdwgp"] Sep 15 09:26:47.517809 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:26:47.517789 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb710c606_56a3_47d7_92e2_9be8f3d70acc.slice/crio-05e90bb907a507d31216c1c08d32bf8f5f9ad86cff89932fe32b564480cc80bd WatchSource:0}: Error finding container 05e90bb907a507d31216c1c08d32bf8f5f9ad86cff89932fe32b564480cc80bd: Status 404 returned error can't find the container with id 05e90bb907a507d31216c1c08d32bf8f5f9ad86cff89932fe32b564480cc80bd Sep 15 09:26:47.940826 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.940790 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wztnb" event={"ID":"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36","Type":"ContainerStarted","Data":"162d400d01ca5e193ee4bc446212d075d2c076cef25b8da8f8172661ab83da95"} Sep 15 09:26:47.941885 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:47.941861 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-jdwgp" event={"ID":"b710c606-56a3-47d7-92e2-9be8f3d70acc","Type":"ContainerStarted","Data":"05e90bb907a507d31216c1c08d32bf8f5f9ad86cff89932fe32b564480cc80bd"} Sep 15 09:26:49.952833 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:49.952790 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-jdwgp" event={"ID":"b710c606-56a3-47d7-92e2-9be8f3d70acc","Type":"ContainerStarted","Data":"eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d"} Sep 15 09:26:49.966534 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:49.966486 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-jdwgp" podStartSLOduration=2.094965536 podStartE2EDuration="3.966469645s" totalImagesPullingTime="1.871504109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:26:49.965567616 +0000 UTC m=+699.472145053" watchObservedRunningTime="2026-09-15 09:26:49.966469645 +0000 UTC m=+699.473047081" Sep 15 09:26:52.974276 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:52.974243 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wztnb" event={"ID":"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36","Type":"ContainerStarted","Data":"8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06"} Sep 15 09:26:52.986181 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:52.986132 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-wztnb" podStartSLOduration=2.334528429 podStartE2EDuration="6.986117767s" totalImagesPullingTime="4.651589338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:26:52.985030472 +0000 UTC m=+702.491607910" watchObservedRunningTime="2026-09-15 09:26:52.986117767 +0000 UTC m=+702.492695204" Sep 15 09:26:55.713461 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.713430 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw"] Sep 15 09:26:55.717245 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.717221 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.719572 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.719543 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Sep 15 09:26:55.719690 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.719552 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Sep 15 09:26:55.719690 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.719580 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 15 09:26:55.719690 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.719571 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Sep 15 09:26:55.719690 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.719661 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-8qt2k\"" Sep 15 09:26:55.727756 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.727736 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw"] Sep 15 09:26:55.827026 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.826993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-registry-tls\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.827026 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.827026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-feast-data\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.827230 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.827054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-offline-tls\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.827230 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.827179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-online-tls\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.827230 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.827211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6ttl\" (UniqueName: \"kubernetes.io/projected/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-kube-api-access-c6ttl\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.928290 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.928227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-offline-tls\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.928462 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.928326 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-online-tls\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.928462 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.928351 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ttl\" (UniqueName: \"kubernetes.io/projected/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-kube-api-access-c6ttl\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.928462 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.928398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-registry-tls\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.928596 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.928462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-feast-data\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.928866 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.928839 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-feast-data\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.930824 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.930800 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-registry-tls\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.930920 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.930829 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-offline-tls\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.930920 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.930891 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-online-tls\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:55.935539 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:55.935518 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ttl\" (UniqueName: \"kubernetes.io/projected/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-kube-api-access-c6ttl\") pod \"feast-credit-scoring-77c7554ddc-qg2fw\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:56.026491 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:56.026427 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:26:56.302369 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:56.302343 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw"] Sep 15 09:26:56.304627 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:26:56.304598 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e2c1c0_39dc_4dab_9d9a_276dcf53711a.slice/crio-eeaed38ae7996cde2da3fa0724b1bf09196bc7c7c6833b24c8a962f8c8a31c96 WatchSource:0}: Error finding container eeaed38ae7996cde2da3fa0724b1bf09196bc7c7c6833b24c8a962f8c8a31c96: Status 404 returned error can't find the container with id eeaed38ae7996cde2da3fa0724b1bf09196bc7c7c6833b24c8a962f8c8a31c96 Sep 15 09:26:56.985563 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:56.985522 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerStarted","Data":"fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34"} Sep 15 09:26:56.985932 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:56.985580 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerStarted","Data":"eeaed38ae7996cde2da3fa0724b1bf09196bc7c7c6833b24c8a962f8c8a31c96"} Sep 15 09:26:57.990803 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:57.990776 2566 generic.go:356] "Generic (PLEG): container finished" podID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerID="fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34" exitCode=0 Sep 15 09:26:57.991233 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:57.990810 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerDied","Data":"fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34"} Sep 15 09:26:58.996646 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:26:58.996611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerStarted","Data":"5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e"} Sep 15 09:27:05.022651 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:05.022614 2566 generic.go:356] "Generic (PLEG): container finished" podID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerID="5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e" exitCode=0 Sep 15 09:27:05.023124 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:05.022690 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerDied","Data":"5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e"} Sep 15 09:27:06.031659 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:06.031616 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerStarted","Data":"f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e"} Sep 15 09:27:06.032155 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:06.031695 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerStarted","Data":"b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40"} Sep 15 09:27:06.032155 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:06.031726 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerStarted","Data":"fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e"} Sep 15 09:27:06.054189 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:06.054139 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podStartSLOduration=11.054124876 podStartE2EDuration="11.054124876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:26:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:06.051474421 +0000 UTC m=+715.558051857" watchObservedRunningTime="2026-09-15 09:27:06.054124876 +0000 UTC m=+715.560702313" Sep 15 09:27:08.026777 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:08.026689 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:08.026777 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:08.026759 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:08.026777 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:08.026786 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:08.028780 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:08.028743 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused" Sep 15 09:27:08.028922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:08.028743 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 15 09:27:08.028922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:08.028806 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 15 09:27:11.027366 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:11.027317 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 15 09:27:11.027798 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:11.027390 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused" Sep 15 09:27:11.027798 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:11.027647 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 15 09:27:14.027599 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:14.027554 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 15 09:27:14.028487 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:14.028465 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:14.028847 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:14.028827 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:14.029298 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:14.029276 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:14.041305 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:14.041273 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:14.078523 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:14.078490 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:14.083042 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:14.083003 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:16.027093 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:16.027048 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:17.027436 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:17.027381 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 15 09:27:20.027972 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:20.027939 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:27:20.028883 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:27:20.028858 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:28:23.511873 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.511840 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw"] Sep 15 09:28:23.512398 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.512117 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="registry" containerID="cri-o://fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e" gracePeriod=30 Sep 15 09:28:23.512398 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.512127 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="online" containerID="cri-o://b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40" gracePeriod=30 Sep 15 09:28:23.512398 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.512168 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="offline" containerID="cri-o://f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e" gracePeriod=30 Sep 15 09:28:23.529613 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.529583 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wztnb"] Sep 15 09:28:23.529815 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.529778 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-wztnb" podUID="ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36" containerName="postgres" containerID="cri-o://8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06" gracePeriod=30 Sep 15 09:28:23.533993 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.533970 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-jdwgp"] Sep 15 09:28:23.534151 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.534131 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-jdwgp" podUID="b710c606-56a3-47d7-92e2-9be8f3d70acc" containerName="redis" containerID="cri-o://eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d" gracePeriod=30 Sep 15 09:28:23.801536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.801512 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wztnb" Sep 15 09:28:23.804496 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.804476 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-jdwgp" Sep 15 09:28:23.861618 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.861586 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rdmj\" (UniqueName: \"kubernetes.io/projected/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-kube-api-access-2rdmj\") pod \"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36\" (UID: \"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36\") " Sep 15 09:28:23.861807 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.861634 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-postgresdata\") pod \"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36\" (UID: \"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36\") " Sep 15 09:28:23.861807 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.861710 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw25m\" (UniqueName: \"kubernetes.io/projected/b710c606-56a3-47d7-92e2-9be8f3d70acc-kube-api-access-nw25m\") pod \"b710c606-56a3-47d7-92e2-9be8f3d70acc\" (UID: \"b710c606-56a3-47d7-92e2-9be8f3d70acc\") " Sep 15 09:28:23.863831 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.863803 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-kube-api-access-2rdmj" (OuterVolumeSpecName: "kube-api-access-2rdmj") pod "ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36" (UID: "ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36"). InnerVolumeSpecName "kube-api-access-2rdmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:28:23.864202 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.864175 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b710c606-56a3-47d7-92e2-9be8f3d70acc-kube-api-access-nw25m" (OuterVolumeSpecName: "kube-api-access-nw25m") pod "b710c606-56a3-47d7-92e2-9be8f3d70acc" (UID: "b710c606-56a3-47d7-92e2-9be8f3d70acc"). InnerVolumeSpecName "kube-api-access-nw25m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:28:23.894624 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.894574 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36" (UID: "ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:28:23.962793 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.962754 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rdmj\" (UniqueName: \"kubernetes.io/projected/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-kube-api-access-2rdmj\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:28:23.962793 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.962788 2566 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36-postgresdata\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:28:23.962793 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:23.962798 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw25m\" (UniqueName: \"kubernetes.io/projected/b710c606-56a3-47d7-92e2-9be8f3d70acc-kube-api-access-nw25m\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:28:24.078884 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.078796 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 15 09:28:24.388189 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.388160 2566 generic.go:356] "Generic (PLEG): container finished" podID="ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36" containerID="8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06" exitCode=0 Sep 15 09:28:24.388356 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.388206 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wztnb" Sep 15 09:28:24.388356 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.388235 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wztnb" event={"ID":"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36","Type":"ContainerDied","Data":"8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06"} Sep 15 09:28:24.388356 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.388275 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wztnb" event={"ID":"ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36","Type":"ContainerDied","Data":"162d400d01ca5e193ee4bc446212d075d2c076cef25b8da8f8172661ab83da95"} Sep 15 09:28:24.388356 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.388296 2566 scope.go:117] "RemoveContainer" containerID="8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06" Sep 15 09:28:24.389659 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.389635 2566 generic.go:356] "Generic (PLEG): container finished" podID="b710c606-56a3-47d7-92e2-9be8f3d70acc" containerID="eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d" exitCode=0 Sep 15 09:28:24.389750 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.389673 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-jdwgp" Sep 15 09:28:24.389750 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.389706 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-jdwgp" event={"ID":"b710c606-56a3-47d7-92e2-9be8f3d70acc","Type":"ContainerDied","Data":"eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d"} Sep 15 09:28:24.389750 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.389736 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-jdwgp" event={"ID":"b710c606-56a3-47d7-92e2-9be8f3d70acc","Type":"ContainerDied","Data":"05e90bb907a507d31216c1c08d32bf8f5f9ad86cff89932fe32b564480cc80bd"} Sep 15 09:28:24.409498 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.409478 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-jdwgp"] Sep 15 09:28:24.412488 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.412469 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-jdwgp"] Sep 15 09:28:24.423250 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.423226 2566 scope.go:117] "RemoveContainer" containerID="8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06" Sep 15 09:28:24.423250 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.423244 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wztnb"] Sep 15 09:28:24.423611 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:28:24.423594 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06\": container with ID starting with 8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06 not found: ID does not exist" containerID="8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06" Sep 15 09:28:24.423675 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.423621 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06"} err="failed to get container status \"8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06\": rpc error: code = NotFound desc = could not find container \"8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06\": container with ID starting with 8c2cd00b0d3ec857663ad737e97f12986c896f1113799c6e8f48864e38d0bc06 not found: ID does not exist" Sep 15 09:28:24.423675 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.423637 2566 scope.go:117] "RemoveContainer" containerID="eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d" Sep 15 09:28:24.426996 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.426974 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wztnb"] Sep 15 09:28:24.431003 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.430982 2566 scope.go:117] "RemoveContainer" containerID="eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d" Sep 15 09:28:24.431279 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:28:24.431261 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d\": container with ID starting with eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d not found: ID does not exist" containerID="eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d" Sep 15 09:28:24.431349 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.431283 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d"} err="failed to get container status \"eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d\": rpc error: code = NotFound desc = could not find container \"eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d\": container with ID starting with eba35e5de61a8dfca45edd93febb2f1e3ebc288ead41d75c4516a647ee3dcf4d not found: ID does not exist" Sep 15 09:28:24.973965 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.973931 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b710c606-56a3-47d7-92e2-9be8f3d70acc" path="/var/lib/kubelet/pods/b710c606-56a3-47d7-92e2-9be8f3d70acc/volumes" Sep 15 09:28:24.974321 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:24.974267 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36" path="/var/lib/kubelet/pods/ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36/volumes" Sep 15 09:28:25.397278 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:25.397204 2566 generic.go:356] "Generic (PLEG): container finished" podID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerID="b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40" exitCode=0 Sep 15 09:28:25.397435 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:25.397278 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerDied","Data":"b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40"} Sep 15 09:28:34.079435 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:34.079331 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 15 09:28:44.079326 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:44.079279 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 15 09:28:44.079730 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:44.079433 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:28:54.028943 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.028910 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused" Sep 15 09:28:54.161748 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.161725 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:28:54.221318 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.221285 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6ttl\" (UniqueName: \"kubernetes.io/projected/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-kube-api-access-c6ttl\") pod \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " Sep 15 09:28:54.221585 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.221331 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-feast-data\") pod \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " Sep 15 09:28:54.221585 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.221351 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-online-tls\") pod \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " Sep 15 09:28:54.221585 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.221376 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-offline-tls\") pod \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " Sep 15 09:28:54.221585 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.221432 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-registry-tls\") pod \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\" (UID: \"87e2c1c0-39dc-4dab-9d9a-276dcf53711a\") " Sep 15 09:28:54.223482 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.223449 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "87e2c1c0-39dc-4dab-9d9a-276dcf53711a" (UID: "87e2c1c0-39dc-4dab-9d9a-276dcf53711a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:28:54.223600 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.223568 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "87e2c1c0-39dc-4dab-9d9a-276dcf53711a" (UID: "87e2c1c0-39dc-4dab-9d9a-276dcf53711a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:28:54.223838 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.223820 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-online-tls" (OuterVolumeSpecName: "online-tls") pod "87e2c1c0-39dc-4dab-9d9a-276dcf53711a" (UID: "87e2c1c0-39dc-4dab-9d9a-276dcf53711a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:28:54.223954 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.223930 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-kube-api-access-c6ttl" (OuterVolumeSpecName: "kube-api-access-c6ttl") pod "87e2c1c0-39dc-4dab-9d9a-276dcf53711a" (UID: "87e2c1c0-39dc-4dab-9d9a-276dcf53711a"). InnerVolumeSpecName "kube-api-access-c6ttl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:28:54.228351 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.228325 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-feast-data" (OuterVolumeSpecName: "feast-data") pod "87e2c1c0-39dc-4dab-9d9a-276dcf53711a" (UID: "87e2c1c0-39dc-4dab-9d9a-276dcf53711a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:28:54.322343 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.322266 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-feast-data\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:28:54.322343 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.322289 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-online-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:28:54.322343 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.322298 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-offline-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:28:54.322343 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.322306 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-registry-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:28:54.322343 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.322314 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6ttl\" (UniqueName: \"kubernetes.io/projected/87e2c1c0-39dc-4dab-9d9a-276dcf53711a-kube-api-access-c6ttl\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:28:54.522205 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.522170 2566 generic.go:356] "Generic (PLEG): container finished" podID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerID="f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e" exitCode=137 Sep 15 09:28:54.522205 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.522197 2566 generic.go:356] "Generic (PLEG): container finished" podID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerID="fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e" exitCode=137 Sep 15 09:28:54.522392 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.522231 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" Sep 15 09:28:54.522392 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.522247 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerDied","Data":"f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e"} Sep 15 09:28:54.522392 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.522306 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerDied","Data":"fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e"} Sep 15 09:28:54.522392 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.522329 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" event={"ID":"87e2c1c0-39dc-4dab-9d9a-276dcf53711a","Type":"ContainerDied","Data":"eeaed38ae7996cde2da3fa0724b1bf09196bc7c7c6833b24c8a962f8c8a31c96"} Sep 15 09:28:54.522392 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.522349 2566 scope.go:117] "RemoveContainer" containerID="f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e" Sep 15 09:28:54.531228 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.531208 2566 scope.go:117] "RemoveContainer" containerID="b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40" Sep 15 09:28:54.538574 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.538552 2566 scope.go:117] "RemoveContainer" containerID="fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e" Sep 15 09:28:54.543471 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.543448 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw"] Sep 15 09:28:54.546846 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.546828 2566 scope.go:117] "RemoveContainer" containerID="5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e" Sep 15 09:28:54.549121 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.549102 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw"] Sep 15 09:28:54.554327 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.554312 2566 scope.go:117] "RemoveContainer" containerID="fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34" Sep 15 09:28:54.561162 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.561144 2566 scope.go:117] "RemoveContainer" containerID="f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e" Sep 15 09:28:54.561473 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:28:54.561454 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e\": container with ID starting with f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e not found: ID does not exist" containerID="f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e" Sep 15 09:28:54.561527 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.561482 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e"} err="failed to get container status \"f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e\": rpc error: code = NotFound desc = could not find container \"f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e\": container with ID starting with f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e not found: ID does not exist" Sep 15 09:28:54.561527 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.561499 2566 scope.go:117] "RemoveContainer" containerID="b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40" Sep 15 09:28:54.561767 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:28:54.561750 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40\": container with ID starting with b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40 not found: ID does not exist" containerID="b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40" Sep 15 09:28:54.561808 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.561773 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40"} err="failed to get container status \"b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40\": rpc error: code = NotFound desc = could not find container \"b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40\": container with ID starting with b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40 not found: ID does not exist" Sep 15 09:28:54.561808 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.561787 2566 scope.go:117] "RemoveContainer" containerID="fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e" Sep 15 09:28:54.562037 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:28:54.562020 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e\": container with ID starting with fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e not found: ID does not exist" containerID="fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e" Sep 15 09:28:54.562092 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.562041 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e"} err="failed to get container status \"fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e\": rpc error: code = NotFound desc = could not find container \"fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e\": container with ID starting with fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e not found: ID does not exist" Sep 15 09:28:54.562092 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.562059 2566 scope.go:117] "RemoveContainer" containerID="5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e" Sep 15 09:28:54.562276 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:28:54.562259 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e\": container with ID starting with 5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e not found: ID does not exist" containerID="5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e" Sep 15 09:28:54.562317 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.562278 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e"} err="failed to get container status \"5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e\": rpc error: code = NotFound desc = could not find container \"5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e\": container with ID starting with 5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e not found: ID does not exist" Sep 15 09:28:54.562317 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.562291 2566 scope.go:117] "RemoveContainer" containerID="fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34" Sep 15 09:28:54.562576 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:28:54.562546 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34\": container with ID starting with fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34 not found: ID does not exist" containerID="fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34" Sep 15 09:28:54.562623 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.562583 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34"} err="failed to get container status \"fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34\": rpc error: code = NotFound desc = could not find container \"fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34\": container with ID starting with fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34 not found: ID does not exist" Sep 15 09:28:54.562623 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.562601 2566 scope.go:117] "RemoveContainer" containerID="f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e" Sep 15 09:28:54.562871 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.562853 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e"} err="failed to get container status \"f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e\": rpc error: code = NotFound desc = could not find container \"f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e\": container with ID starting with f010f330f9882899776d3f0a74a71b7e917a6034b0738f4c175977f294fc848e not found: ID does not exist" Sep 15 09:28:54.562926 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.562872 2566 scope.go:117] "RemoveContainer" containerID="b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40" Sep 15 09:28:54.563086 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.563064 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40"} err="failed to get container status \"b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40\": rpc error: code = NotFound desc = could not find container \"b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40\": container with ID starting with b4786d85fd8e2420d57a10d67c1199a509b0cfbca8f8fa9a7e56e37b4db07d40 not found: ID does not exist" Sep 15 09:28:54.563137 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.563086 2566 scope.go:117] "RemoveContainer" containerID="fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e" Sep 15 09:28:54.563287 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.563270 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e"} err="failed to get container status \"fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e\": rpc error: code = NotFound desc = could not find container \"fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e\": container with ID starting with fc39edf8ffb9204ef6d6f6dfe25024ac197746d10af005ba2fdfa1195366a58e not found: ID does not exist" Sep 15 09:28:54.563332 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.563287 2566 scope.go:117] "RemoveContainer" containerID="5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e" Sep 15 09:28:54.563554 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.563536 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e"} err="failed to get container status \"5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e\": rpc error: code = NotFound desc = could not find container \"5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e\": container with ID starting with 5326880de4bdd955f999ff4ce4106231270322b7f0593bc9d0678b389e5d3e6e not found: ID does not exist" Sep 15 09:28:54.563609 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.563554 2566 scope.go:117] "RemoveContainer" containerID="fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34" Sep 15 09:28:54.563773 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.563755 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34"} err="failed to get container status \"fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34\": rpc error: code = NotFound desc = could not find container \"fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34\": container with ID starting with fe730cc1e1e246162e9c0a242de825769aa254fbb9c7a664b7bdaf89c87b8a34 not found: ID does not exist" Sep 15 09:28:54.974134 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:54.974098 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" path="/var/lib/kubelet/pods/87e2c1c0-39dc-4dab-9d9a-276dcf53711a/volumes" Sep 15 09:28:55.079104 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:28:55.079068 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-77c7554ddc-qg2fw" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Sep 15 09:30:10.980726 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:30:10.980655 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:30:10.981564 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:30:10.981536 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:31:13.621123 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621088 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n7lzh"] Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621563 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="feast-init" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621581 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="feast-init" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621595 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="feast-apply" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621603 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="feast-apply" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621626 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36" containerName="postgres" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621635 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36" containerName="postgres" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621646 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="registry" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621656 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="registry" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621667 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="online" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621675 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="online" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621687 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="offline" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621695 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="offline" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621717 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b710c606-56a3-47d7-92e2-9be8f3d70acc" containerName="redis" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621725 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b710c606-56a3-47d7-92e2-9be8f3d70acc" containerName="redis" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621803 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="registry" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621831 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="online" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621840 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff3fbc61-ba24-4bfc-a3c3-fa5aa0aaea36" containerName="postgres" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621848 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b710c606-56a3-47d7-92e2-9be8f3d70acc" containerName="redis" Sep 15 09:31:13.623637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.621856 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="87e2c1c0-39dc-4dab-9d9a-276dcf53711a" containerName="offline" Sep 15 09:31:13.624907 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.624887 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" Sep 15 09:31:13.626986 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.626956 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Sep 15 09:31:13.626986 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.626981 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-vxtds\"" Sep 15 09:31:13.627763 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.627747 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Sep 15 09:31:13.637295 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.637271 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n7lzh"] Sep 15 09:31:13.712713 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.712679 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb2z8\" (UniqueName: \"kubernetes.io/projected/b75a10d3-dc1c-4bf8-b953-06567fbf9eb4-kube-api-access-bb2z8\") pod \"redis-69bbd798b6-n7lzh\" (UID: \"b75a10d3-dc1c-4bf8-b953-06567fbf9eb4\") " pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" Sep 15 09:31:13.813692 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.813657 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb2z8\" (UniqueName: \"kubernetes.io/projected/b75a10d3-dc1c-4bf8-b953-06567fbf9eb4-kube-api-access-bb2z8\") pod \"redis-69bbd798b6-n7lzh\" (UID: \"b75a10d3-dc1c-4bf8-b953-06567fbf9eb4\") " pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" Sep 15 09:31:13.822456 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.822422 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb2z8\" (UniqueName: \"kubernetes.io/projected/b75a10d3-dc1c-4bf8-b953-06567fbf9eb4-kube-api-access-bb2z8\") pod \"redis-69bbd798b6-n7lzh\" (UID: \"b75a10d3-dc1c-4bf8-b953-06567fbf9eb4\") " pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" Sep 15 09:31:13.942708 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:13.942676 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" Sep 15 09:31:14.213414 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:14.213316 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n7lzh"] Sep 15 09:31:14.217178 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:31:14.217145 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb75a10d3_dc1c_4bf8_b953_06567fbf9eb4.slice/crio-89e8fca645bb364d35e2a3a6c3072a08357b9d02570b5b938ec4bab6d4fb3f48 WatchSource:0}: Error finding container 89e8fca645bb364d35e2a3a6c3072a08357b9d02570b5b938ec4bab6d4fb3f48: Status 404 returned error can't find the container with id 89e8fca645bb364d35e2a3a6c3072a08357b9d02570b5b938ec4bab6d4fb3f48 Sep 15 09:31:15.060416 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:15.060369 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" event={"ID":"b75a10d3-dc1c-4bf8-b953-06567fbf9eb4","Type":"ContainerStarted","Data":"f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b"} Sep 15 09:31:15.060773 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:15.060428 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" event={"ID":"b75a10d3-dc1c-4bf8-b953-06567fbf9eb4","Type":"ContainerStarted","Data":"89e8fca645bb364d35e2a3a6c3072a08357b9d02570b5b938ec4bab6d4fb3f48"} Sep 15 09:31:15.075336 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:15.075291 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" podStartSLOduration=2.075276843 podStartE2EDuration="2.075276843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:15.073953825 +0000 UTC m=+964.580531262" watchObservedRunningTime="2026-09-15 09:31:15.075276843 +0000 UTC m=+964.581854279" Sep 15 09:31:19.038590 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.038546 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-27chs"] Sep 15 09:31:19.043367 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.043344 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-27chs" Sep 15 09:31:19.046338 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.046313 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Sep 15 09:31:19.047083 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.047053 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-27chs"] Sep 15 09:31:19.051994 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.051760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmffc\" (UniqueName: \"kubernetes.io/projected/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-kube-api-access-dmffc\") pod \"postgres-864846d4f5-27chs\" (UID: \"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0\") " pod="test-ns-feast-rest/postgres-864846d4f5-27chs" Sep 15 09:31:19.051994 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.051838 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-postgresdata\") pod \"postgres-864846d4f5-27chs\" (UID: \"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0\") " pod="test-ns-feast-rest/postgres-864846d4f5-27chs" Sep 15 09:31:19.152524 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.152481 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmffc\" (UniqueName: \"kubernetes.io/projected/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-kube-api-access-dmffc\") pod \"postgres-864846d4f5-27chs\" (UID: \"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0\") " pod="test-ns-feast-rest/postgres-864846d4f5-27chs" Sep 15 09:31:19.152524 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.152526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-postgresdata\") pod \"postgres-864846d4f5-27chs\" (UID: \"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0\") " pod="test-ns-feast-rest/postgres-864846d4f5-27chs" Sep 15 09:31:19.152869 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.152854 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-postgresdata\") pod \"postgres-864846d4f5-27chs\" (UID: \"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0\") " pod="test-ns-feast-rest/postgres-864846d4f5-27chs" Sep 15 09:31:19.159988 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.159968 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmffc\" (UniqueName: \"kubernetes.io/projected/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-kube-api-access-dmffc\") pod \"postgres-864846d4f5-27chs\" (UID: \"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0\") " pod="test-ns-feast-rest/postgres-864846d4f5-27chs" Sep 15 09:31:19.354859 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.354771 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-27chs" Sep 15 09:31:19.622931 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:19.622802 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-27chs"] Sep 15 09:31:19.625508 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:31:19.625482 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a4cef9c_a952_47c5_91ba_8f9b82aff0e0.slice/crio-6621e59908bda8499784da3bcba7a8e6ed134a17173f0e49e86de6fb80eee7f5 WatchSource:0}: Error finding container 6621e59908bda8499784da3bcba7a8e6ed134a17173f0e49e86de6fb80eee7f5: Status 404 returned error can't find the container with id 6621e59908bda8499784da3bcba7a8e6ed134a17173f0e49e86de6fb80eee7f5 Sep 15 09:31:20.081780 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:20.081745 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-27chs" event={"ID":"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0","Type":"ContainerStarted","Data":"762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6"} Sep 15 09:31:20.082250 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:20.081798 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-27chs" event={"ID":"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0","Type":"ContainerStarted","Data":"6621e59908bda8499784da3bcba7a8e6ed134a17173f0e49e86de6fb80eee7f5"} Sep 15 09:31:20.098480 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:20.098424 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-27chs" podStartSLOduration=1.098391498 podStartE2EDuration="1.098391498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:20.097366945 +0000 UTC m=+969.603944383" watchObservedRunningTime="2026-09-15 09:31:20.098391498 +0000 UTC m=+969.604968935" Sep 15 09:31:24.585350 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.585319 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8"] Sep 15 09:31:24.589065 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.589045 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.591156 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.591137 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Sep 15 09:31:24.591252 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.591177 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-glqsf\"" Sep 15 09:31:24.591252 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.591225 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 15 09:31:24.591414 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.591382 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Sep 15 09:31:24.599430 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.599381 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8"] Sep 15 09:31:24.699704 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.699666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2pfl\" (UniqueName: \"kubernetes.io/projected/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-kube-api-access-g2pfl\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.699880 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.699728 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-feast-data\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.699880 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.699758 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-registry-tls\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.699880 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.699781 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-online-tls\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.800881 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.800846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2pfl\" (UniqueName: \"kubernetes.io/projected/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-kube-api-access-g2pfl\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.801075 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.800895 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-feast-data\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.801075 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.800917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-registry-tls\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.801075 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.800940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-online-tls\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.801265 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.801247 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-feast-data\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.803574 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.803544 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-online-tls\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.803691 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.803544 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-registry-tls\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.809073 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.809047 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2pfl\" (UniqueName: \"kubernetes.io/projected/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-kube-api-access-g2pfl\") pod \"feast-credit-scoring-799d98b8b9-2wnx8\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:24.897972 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:24.897891 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:25.177566 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:25.177537 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8"] Sep 15 09:31:25.180216 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:31:25.180188 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337e6ae7_1623_47dd_a0ac_5a09c79c3db5.slice/crio-00f8b23837500fbdbe1667deea756bf804304b87ad66be7c4120daa8d03acc4b WatchSource:0}: Error finding container 00f8b23837500fbdbe1667deea756bf804304b87ad66be7c4120daa8d03acc4b: Status 404 returned error can't find the container with id 00f8b23837500fbdbe1667deea756bf804304b87ad66be7c4120daa8d03acc4b Sep 15 09:31:26.106999 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:26.106963 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" event={"ID":"337e6ae7-1623-47dd-a0ac-5a09c79c3db5","Type":"ContainerStarted","Data":"19a8166c4fa05c76c0893a9bc9c23f1d22ea633bb2fb9fc5143f27964b5ceb72"} Sep 15 09:31:26.107371 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:26.107012 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" event={"ID":"337e6ae7-1623-47dd-a0ac-5a09c79c3db5","Type":"ContainerStarted","Data":"00f8b23837500fbdbe1667deea756bf804304b87ad66be7c4120daa8d03acc4b"} Sep 15 09:31:27.112931 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:27.112897 2566 generic.go:356] "Generic (PLEG): container finished" podID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerID="19a8166c4fa05c76c0893a9bc9c23f1d22ea633bb2fb9fc5143f27964b5ceb72" exitCode=0 Sep 15 09:31:27.113308 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:27.112965 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" event={"ID":"337e6ae7-1623-47dd-a0ac-5a09c79c3db5","Type":"ContainerDied","Data":"19a8166c4fa05c76c0893a9bc9c23f1d22ea633bb2fb9fc5143f27964b5ceb72"} Sep 15 09:31:28.119465 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:28.119426 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" event={"ID":"337e6ae7-1623-47dd-a0ac-5a09c79c3db5","Type":"ContainerStarted","Data":"6dfef5590346f25701f4a2bd7dc8bab17c66f78ad1d3dd9becc8c32141aff697"} Sep 15 09:31:35.149654 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:35.149618 2566 generic.go:356] "Generic (PLEG): container finished" podID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerID="6dfef5590346f25701f4a2bd7dc8bab17c66f78ad1d3dd9becc8c32141aff697" exitCode=0 Sep 15 09:31:35.150051 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:35.149690 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" event={"ID":"337e6ae7-1623-47dd-a0ac-5a09c79c3db5","Type":"ContainerDied","Data":"6dfef5590346f25701f4a2bd7dc8bab17c66f78ad1d3dd9becc8c32141aff697"} Sep 15 09:31:36.160008 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:36.159976 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" event={"ID":"337e6ae7-1623-47dd-a0ac-5a09c79c3db5","Type":"ContainerStarted","Data":"e7ee0ce629addae89b4dbe72ac4fc75c6ee3e55247b42f833de23266e9559313"} Sep 15 09:31:36.160459 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:36.160026 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" event={"ID":"337e6ae7-1623-47dd-a0ac-5a09c79c3db5","Type":"ContainerStarted","Data":"1f4f2eafc78977f65b6843751e3766ed508bd96d0882a3a35a10000bf534ee7a"} Sep 15 09:31:36.179851 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:36.179800 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podStartSLOduration=12.179779376 podStartE2EDuration="12.179779376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:36.17783339 +0000 UTC m=+985.684410827" watchObservedRunningTime="2026-09-15 09:31:36.179779376 +0000 UTC m=+985.686356814" Sep 15 09:31:36.899004 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:36.898967 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:36.899168 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:36.899041 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:36.900623 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:36.900585 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused" Sep 15 09:31:36.900735 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:36.900617 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused" Sep 15 09:31:39.898599 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:39.898539 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused" Sep 15 09:31:39.898599 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:39.898598 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused" Sep 15 09:31:42.898287 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:42.898247 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused" Sep 15 09:31:42.904292 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:42.904265 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:42.904657 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:42.904630 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:42.907483 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:42.907463 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:44.898957 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:44.898917 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:45.898608 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:45.898556 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused" Sep 15 09:31:48.899021 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:48.898990 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:48.899850 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:48.899830 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:31:50.335073 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.335037 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8"] Sep 15 09:31:50.339546 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.339523 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:50.341603 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.341582 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Sep 15 09:31:50.341739 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.341582 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Sep 15 09:31:50.341739 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.341582 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-5pgk8\"" Sep 15 09:31:50.341739 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.341690 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 15 09:31:50.353455 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.352326 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8"] Sep 15 09:31:50.435342 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.435314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-registry-tls\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:50.435507 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.435354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-online-tls\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:50.435507 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.435386 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kxnd\" (UniqueName: \"kubernetes.io/projected/7ab0df27-7e90-458f-ad91-34b3bb4aa877-kube-api-access-6kxnd\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:50.435507 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.435489 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7ab0df27-7e90-458f-ad91-34b3bb4aa877-feast-data\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:50.536306 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.536274 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-online-tls\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:50.536462 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.536315 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kxnd\" (UniqueName: \"kubernetes.io/projected/7ab0df27-7e90-458f-ad91-34b3bb4aa877-kube-api-access-6kxnd\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:50.536462 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.536353 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7ab0df27-7e90-458f-ad91-34b3bb4aa877-feast-data\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:50.536462 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.536385 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-registry-tls\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:50.536462 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:31:50.536423 2566 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-online-tls: secret "feast-driver-ranking-online-tls" not found Sep 15 09:31:50.536616 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:31:50.536494 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-online-tls podName:7ab0df27-7e90-458f-ad91-34b3bb4aa877 nodeName:}" failed. No retries permitted until 2026-09-15 09:31:51.036477624 +0000 UTC m=+1000.543055104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-online-tls") pod "feast-driver-ranking-68bbc86c66-psqs8" (UID: "7ab0df27-7e90-458f-ad91-34b3bb4aa877") : secret "feast-driver-ranking-online-tls" not found Sep 15 09:31:50.536616 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:31:50.536498 2566 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found Sep 15 09:31:50.536616 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:31:50.536557 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-registry-tls podName:7ab0df27-7e90-458f-ad91-34b3bb4aa877 nodeName:}" failed. No retries permitted until 2026-09-15 09:31:51.036540091 +0000 UTC m=+1000.543117506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-registry-tls") pod "feast-driver-ranking-68bbc86c66-psqs8" (UID: "7ab0df27-7e90-458f-ad91-34b3bb4aa877") : secret "feast-driver-ranking-registry-tls" not found Sep 15 09:31:50.536759 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.536742 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7ab0df27-7e90-458f-ad91-34b3bb4aa877-feast-data\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:50.544768 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:50.544740 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kxnd\" (UniqueName: \"kubernetes.io/projected/7ab0df27-7e90-458f-ad91-34b3bb4aa877-kube-api-access-6kxnd\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:51.041364 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:51.041326 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-registry-tls\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:51.041364 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:51.041369 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-online-tls\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:51.043838 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:51.043814 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-registry-tls\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:51.043954 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:51.043884 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-online-tls\") pod \"feast-driver-ranking-68bbc86c66-psqs8\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:51.250658 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:51.250625 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:31:51.524514 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:51.524488 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8"] Sep 15 09:31:51.525856 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:31:51.525825 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab0df27_7e90_458f_ad91_34b3bb4aa877.slice/crio-068202896fc0d24d4035ef56b06aa954c298bfd88aceb6b49089be2701007456 WatchSource:0}: Error finding container 068202896fc0d24d4035ef56b06aa954c298bfd88aceb6b49089be2701007456: Status 404 returned error can't find the container with id 068202896fc0d24d4035ef56b06aa954c298bfd88aceb6b49089be2701007456 Sep 15 09:31:52.231806 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:52.231773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" event={"ID":"7ab0df27-7e90-458f-ad91-34b3bb4aa877","Type":"ContainerStarted","Data":"256a43fc5c73b2c1ae1f2c61c4b9bf05f6df5d899d5a310878d24ff55cb94af9"} Sep 15 09:31:52.231979 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:52.231824 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" event={"ID":"7ab0df27-7e90-458f-ad91-34b3bb4aa877","Type":"ContainerStarted","Data":"068202896fc0d24d4035ef56b06aa954c298bfd88aceb6b49089be2701007456"} Sep 15 09:31:57.253676 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:57.253640 2566 generic.go:356] "Generic (PLEG): container finished" podID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerID="256a43fc5c73b2c1ae1f2c61c4b9bf05f6df5d899d5a310878d24ff55cb94af9" exitCode=0 Sep 15 09:31:57.254050 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:57.253712 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" event={"ID":"7ab0df27-7e90-458f-ad91-34b3bb4aa877","Type":"ContainerDied","Data":"256a43fc5c73b2c1ae1f2c61c4b9bf05f6df5d899d5a310878d24ff55cb94af9"} Sep 15 09:31:58.259664 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:31:58.259626 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" event={"ID":"7ab0df27-7e90-458f-ad91-34b3bb4aa877","Type":"ContainerStarted","Data":"7798b5b40b3c26e6412588f1d35154326334a94098b0416b7869482fa8eab577"} Sep 15 09:32:04.288915 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:04.288876 2566 generic.go:356] "Generic (PLEG): container finished" podID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerID="7798b5b40b3c26e6412588f1d35154326334a94098b0416b7869482fa8eab577" exitCode=0 Sep 15 09:32:04.289381 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:04.288949 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" event={"ID":"7ab0df27-7e90-458f-ad91-34b3bb4aa877","Type":"ContainerDied","Data":"7798b5b40b3c26e6412588f1d35154326334a94098b0416b7869482fa8eab577"} Sep 15 09:32:05.296187 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:05.296147 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" event={"ID":"7ab0df27-7e90-458f-ad91-34b3bb4aa877","Type":"ContainerStarted","Data":"d4abf5664c53eb834b701e3b5e247ba01e218a804b9f59b55cff979560809767"} Sep 15 09:32:05.296741 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:05.296203 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" event={"ID":"7ab0df27-7e90-458f-ad91-34b3bb4aa877","Type":"ContainerStarted","Data":"f43d80a1e6232e481835b9c902816acaf89397ff197d0521a3407bdae91f9493"} Sep 15 09:32:05.318495 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:05.318427 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podStartSLOduration=15.31838914 podStartE2EDuration="15.31838914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:32:05.314918407 +0000 UTC m=+1014.821495846" watchObservedRunningTime="2026-09-15 09:32:05.31838914 +0000 UTC m=+1014.824966578" Sep 15 09:32:06.250992 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:06.250955 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:32:06.251299 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:06.251016 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:32:06.252660 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:06.252622 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused" Sep 15 09:32:06.252660 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:06.252644 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused" Sep 15 09:32:09.251558 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:09.251506 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused" Sep 15 09:32:09.252014 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:09.251609 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused" Sep 15 09:32:11.251422 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:11.251373 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:32:11.251823 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:11.251442 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:32:12.251660 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:12.251619 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused" Sep 15 09:32:12.258006 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:12.257970 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:32:12.261652 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:12.261625 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:32:15.251417 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:15.251349 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused" Sep 15 09:32:18.252011 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:18.251979 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:32:18.252810 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:32:18.252793 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:33:38.098780 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.098747 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw"] Sep 15 09:33:38.099314 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.098958 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" podUID="6d206f45-5ab1-4f96-9bda-2174194258a9" containerName="manager" containerID="cri-o://a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e" gracePeriod=10 Sep 15 09:33:38.360349 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.360287 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" Sep 15 09:33:38.401849 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.401815 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8"] Sep 15 09:33:38.402158 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.402111 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="registry" containerID="cri-o://1f4f2eafc78977f65b6843751e3766ed508bd96d0882a3a35a10000bf534ee7a" gracePeriod=30 Sep 15 09:33:38.402268 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.402191 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="online" containerID="cri-o://e7ee0ce629addae89b4dbe72ac4fc75c6ee3e55247b42f833de23266e9559313" gracePeriod=30 Sep 15 09:33:38.405670 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.405644 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8"] Sep 15 09:33:38.405937 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.405889 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="registry" containerID="cri-o://f43d80a1e6232e481835b9c902816acaf89397ff197d0521a3407bdae91f9493" gracePeriod=30 Sep 15 09:33:38.406046 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.405933 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="online" containerID="cri-o://d4abf5664c53eb834b701e3b5e247ba01e218a804b9f59b55cff979560809767" gracePeriod=30 Sep 15 09:33:38.446189 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.446158 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6gm7\" (UniqueName: \"kubernetes.io/projected/6d206f45-5ab1-4f96-9bda-2174194258a9-kube-api-access-s6gm7\") pod \"6d206f45-5ab1-4f96-9bda-2174194258a9\" (UID: \"6d206f45-5ab1-4f96-9bda-2174194258a9\") " Sep 15 09:33:38.448170 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.448143 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d206f45-5ab1-4f96-9bda-2174194258a9-kube-api-access-s6gm7" (OuterVolumeSpecName: "kube-api-access-s6gm7") pod "6d206f45-5ab1-4f96-9bda-2174194258a9" (UID: "6d206f45-5ab1-4f96-9bda-2174194258a9"). InnerVolumeSpecName "kube-api-access-s6gm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:33:38.547696 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.547669 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6gm7\" (UniqueName: \"kubernetes.io/projected/6d206f45-5ab1-4f96-9bda-2174194258a9-kube-api-access-s6gm7\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:33:38.709854 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.709817 2566 generic.go:356] "Generic (PLEG): container finished" podID="6d206f45-5ab1-4f96-9bda-2174194258a9" containerID="a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e" exitCode=0 Sep 15 09:33:38.710034 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.709860 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" Sep 15 09:33:38.710034 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.709867 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" event={"ID":"6d206f45-5ab1-4f96-9bda-2174194258a9","Type":"ContainerDied","Data":"a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e"} Sep 15 09:33:38.710034 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.709921 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw" event={"ID":"6d206f45-5ab1-4f96-9bda-2174194258a9","Type":"ContainerDied","Data":"de86b4984e1ae76f404ac01ea6f9dcc87813503f04379ebc6a324a3f522c1e65"} Sep 15 09:33:38.710034 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.709954 2566 scope.go:117] "RemoveContainer" containerID="a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e" Sep 15 09:33:38.720556 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.720535 2566 scope.go:117] "RemoveContainer" containerID="a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e" Sep 15 09:33:38.720846 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:33:38.720828 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e\": container with ID starting with a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e not found: ID does not exist" containerID="a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e" Sep 15 09:33:38.720914 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.720855 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e"} err="failed to get container status \"a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e\": rpc error: code = NotFound desc = could not find container \"a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e\": container with ID starting with a9b6e7ac06d9836f5c99d78799a8b34485ec2c0e2e0edd466baf9440daf2675e not found: ID does not exist" Sep 15 09:33:38.730996 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.730967 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw"] Sep 15 09:33:38.734138 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.734116 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7bf78c84dd-7c7lw"] Sep 15 09:33:38.975852 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:38.975754 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d206f45-5ab1-4f96-9bda-2174194258a9" path="/var/lib/kubelet/pods/6d206f45-5ab1-4f96-9bda-2174194258a9/volumes" Sep 15 09:33:39.716703 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:39.716671 2566 generic.go:356] "Generic (PLEG): container finished" podID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerID="d4abf5664c53eb834b701e3b5e247ba01e218a804b9f59b55cff979560809767" exitCode=0 Sep 15 09:33:39.717095 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:39.716741 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" event={"ID":"7ab0df27-7e90-458f-ad91-34b3bb4aa877","Type":"ContainerDied","Data":"d4abf5664c53eb834b701e3b5e247ba01e218a804b9f59b55cff979560809767"} Sep 15 09:33:39.719717 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:39.719696 2566 generic.go:356] "Generic (PLEG): container finished" podID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerID="e7ee0ce629addae89b4dbe72ac4fc75c6ee3e55247b42f833de23266e9559313" exitCode=0 Sep 15 09:33:39.719836 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:39.719767 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" event={"ID":"337e6ae7-1623-47dd-a0ac-5a09c79c3db5","Type":"ContainerDied","Data":"e7ee0ce629addae89b4dbe72ac4fc75c6ee3e55247b42f833de23266e9559313"} Sep 15 09:33:40.873262 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:40.873227 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-27chs"] Sep 15 09:33:40.873741 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:40.873390 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-27chs" podUID="7a4cef9c-a952-47c5-91ba-8f9b82aff0e0" containerName="postgres" containerID="cri-o://762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6" gracePeriod=30 Sep 15 09:33:40.877767 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:40.877744 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n7lzh"] Sep 15 09:33:40.881650 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:40.877922 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" podUID="b75a10d3-dc1c-4bf8-b953-06567fbf9eb4" containerName="redis" containerID="cri-o://f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b" gracePeriod=30 Sep 15 09:33:41.139337 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.139314 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-27chs" Sep 15 09:33:41.141881 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.141864 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" Sep 15 09:33:41.271889 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.271862 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb2z8\" (UniqueName: \"kubernetes.io/projected/b75a10d3-dc1c-4bf8-b953-06567fbf9eb4-kube-api-access-bb2z8\") pod \"b75a10d3-dc1c-4bf8-b953-06567fbf9eb4\" (UID: \"b75a10d3-dc1c-4bf8-b953-06567fbf9eb4\") " Sep 15 09:33:41.272083 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.271912 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-postgresdata\") pod \"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0\" (UID: \"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0\") " Sep 15 09:33:41.272083 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.271987 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmffc\" (UniqueName: \"kubernetes.io/projected/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-kube-api-access-dmffc\") pod \"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0\" (UID: \"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0\") " Sep 15 09:33:41.274066 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.274036 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-kube-api-access-dmffc" (OuterVolumeSpecName: "kube-api-access-dmffc") pod "7a4cef9c-a952-47c5-91ba-8f9b82aff0e0" (UID: "7a4cef9c-a952-47c5-91ba-8f9b82aff0e0"). InnerVolumeSpecName "kube-api-access-dmffc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:33:41.274175 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.274084 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75a10d3-dc1c-4bf8-b953-06567fbf9eb4-kube-api-access-bb2z8" (OuterVolumeSpecName: "kube-api-access-bb2z8") pod "b75a10d3-dc1c-4bf8-b953-06567fbf9eb4" (UID: "b75a10d3-dc1c-4bf8-b953-06567fbf9eb4"). InnerVolumeSpecName "kube-api-access-bb2z8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:33:41.301358 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.301324 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "7a4cef9c-a952-47c5-91ba-8f9b82aff0e0" (UID: "7a4cef9c-a952-47c5-91ba-8f9b82aff0e0"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:33:41.373051 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.373025 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmffc\" (UniqueName: \"kubernetes.io/projected/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-kube-api-access-dmffc\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:33:41.373051 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.373049 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb2z8\" (UniqueName: \"kubernetes.io/projected/b75a10d3-dc1c-4bf8-b953-06567fbf9eb4-kube-api-access-bb2z8\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:33:41.373223 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.373058 2566 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0-postgresdata\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:33:41.730034 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.729998 2566 generic.go:356] "Generic (PLEG): container finished" podID="7a4cef9c-a952-47c5-91ba-8f9b82aff0e0" containerID="762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6" exitCode=0 Sep 15 09:33:41.730208 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.730043 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-27chs" Sep 15 09:33:41.730208 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.730055 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-27chs" event={"ID":"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0","Type":"ContainerDied","Data":"762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6"} Sep 15 09:33:41.730208 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.730101 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-27chs" event={"ID":"7a4cef9c-a952-47c5-91ba-8f9b82aff0e0","Type":"ContainerDied","Data":"6621e59908bda8499784da3bcba7a8e6ed134a17173f0e49e86de6fb80eee7f5"} Sep 15 09:33:41.730208 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.730123 2566 scope.go:117] "RemoveContainer" containerID="762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6" Sep 15 09:33:41.731479 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.731451 2566 generic.go:356] "Generic (PLEG): container finished" podID="b75a10d3-dc1c-4bf8-b953-06567fbf9eb4" containerID="f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b" exitCode=0 Sep 15 09:33:41.731595 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.731498 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" Sep 15 09:33:41.731595 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.731499 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" event={"ID":"b75a10d3-dc1c-4bf8-b953-06567fbf9eb4","Type":"ContainerDied","Data":"f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b"} Sep 15 09:33:41.731714 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.731607 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-n7lzh" event={"ID":"b75a10d3-dc1c-4bf8-b953-06567fbf9eb4","Type":"ContainerDied","Data":"89e8fca645bb364d35e2a3a6c3072a08357b9d02570b5b938ec4bab6d4fb3f48"} Sep 15 09:33:41.738657 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.738571 2566 scope.go:117] "RemoveContainer" containerID="762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6" Sep 15 09:33:41.738976 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:33:41.738955 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6\": container with ID starting with 762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6 not found: ID does not exist" containerID="762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6" Sep 15 09:33:41.739073 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.738986 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6"} err="failed to get container status \"762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6\": rpc error: code = NotFound desc = could not find container \"762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6\": container with ID starting with 762e1f51d04af2ecead232e4c1b126f4f8672f9442168a5bc571857a1793a5b6 not found: ID does not exist" Sep 15 09:33:41.739073 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.739008 2566 scope.go:117] "RemoveContainer" containerID="f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b" Sep 15 09:33:41.746296 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.746279 2566 scope.go:117] "RemoveContainer" containerID="f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b" Sep 15 09:33:41.746753 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:33:41.746733 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b\": container with ID starting with f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b not found: ID does not exist" containerID="f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b" Sep 15 09:33:41.746850 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.746757 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b"} err="failed to get container status \"f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b\": rpc error: code = NotFound desc = could not find container \"f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b\": container with ID starting with f470bf548df2f97fc52f23288fb3b57b243403fb390bd1c0a902e254cf508b2b not found: ID does not exist" Sep 15 09:33:41.751705 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.751686 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n7lzh"] Sep 15 09:33:41.753425 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.753390 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n7lzh"] Sep 15 09:33:41.761587 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.761570 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-27chs"] Sep 15 09:33:41.763346 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:41.763328 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-27chs"] Sep 15 09:33:42.259452 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:42.259390 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused" Sep 15 09:33:42.905141 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:42.905106 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused" Sep 15 09:33:42.974128 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:42.974096 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a4cef9c-a952-47c5-91ba-8f9b82aff0e0" path="/var/lib/kubelet/pods/7a4cef9c-a952-47c5-91ba-8f9b82aff0e0/volumes" Sep 15 09:33:42.974437 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:42.974423 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b75a10d3-dc1c-4bf8-b953-06567fbf9eb4" path="/var/lib/kubelet/pods/b75a10d3-dc1c-4bf8-b953-06567fbf9eb4/volumes" Sep 15 09:33:52.259494 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:52.259449 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused" Sep 15 09:33:52.905789 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:33:52.905748 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused" Sep 15 09:34:02.259461 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:02.259387 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused" Sep 15 09:34:02.259850 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:02.259547 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:34:02.905674 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:02.905633 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused" Sep 15 09:34:02.905858 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:02.905762 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:34:08.845244 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:08.845153 2566 generic.go:356] "Generic (PLEG): container finished" podID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerID="f43d80a1e6232e481835b9c902816acaf89397ff197d0521a3407bdae91f9493" exitCode=137 Sep 15 09:34:08.845244 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:08.845226 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" event={"ID":"7ab0df27-7e90-458f-ad91-34b3bb4aa877","Type":"ContainerDied","Data":"f43d80a1e6232e481835b9c902816acaf89397ff197d0521a3407bdae91f9493"} Sep 15 09:34:08.847633 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:08.847610 2566 generic.go:356] "Generic (PLEG): container finished" podID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerID="1f4f2eafc78977f65b6843751e3766ed508bd96d0882a3a35a10000bf534ee7a" exitCode=137 Sep 15 09:34:08.847753 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:08.847644 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" event={"ID":"337e6ae7-1623-47dd-a0ac-5a09c79c3db5","Type":"ContainerDied","Data":"1f4f2eafc78977f65b6843751e3766ed508bd96d0882a3a35a10000bf534ee7a"} Sep 15 09:34:08.900529 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:08.900489 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused" Sep 15 09:34:09.072690 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.072665 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:34:09.075187 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.075168 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:34:09.100452 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.100372 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2pfl\" (UniqueName: \"kubernetes.io/projected/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-kube-api-access-g2pfl\") pod \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " Sep 15 09:34:09.100587 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.100465 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-registry-tls\") pod \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " Sep 15 09:34:09.100587 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.100499 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-online-tls\") pod \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " Sep 15 09:34:09.100587 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.100534 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-online-tls\") pod \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " Sep 15 09:34:09.100587 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.100573 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-feast-data\") pod \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " Sep 15 09:34:09.100798 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.100633 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-registry-tls\") pod \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\" (UID: \"337e6ae7-1623-47dd-a0ac-5a09c79c3db5\") " Sep 15 09:34:09.100798 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.100665 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7ab0df27-7e90-458f-ad91-34b3bb4aa877-feast-data\") pod \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " Sep 15 09:34:09.100798 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.100692 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kxnd\" (UniqueName: \"kubernetes.io/projected/7ab0df27-7e90-458f-ad91-34b3bb4aa877-kube-api-access-6kxnd\") pod \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\" (UID: \"7ab0df27-7e90-458f-ad91-34b3bb4aa877\") " Sep 15 09:34:09.101371 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.101297 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab0df27-7e90-458f-ad91-34b3bb4aa877-feast-data" (OuterVolumeSpecName: "feast-data") pod "7ab0df27-7e90-458f-ad91-34b3bb4aa877" (UID: "7ab0df27-7e90-458f-ad91-34b3bb4aa877"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:34:09.102785 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.102756 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-online-tls" (OuterVolumeSpecName: "online-tls") pod "7ab0df27-7e90-458f-ad91-34b3bb4aa877" (UID: "7ab0df27-7e90-458f-ad91-34b3bb4aa877"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:34:09.103083 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.103060 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-online-tls" (OuterVolumeSpecName: "online-tls") pod "337e6ae7-1623-47dd-a0ac-5a09c79c3db5" (UID: "337e6ae7-1623-47dd-a0ac-5a09c79c3db5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:34:09.103439 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.103394 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7ab0df27-7e90-458f-ad91-34b3bb4aa877" (UID: "7ab0df27-7e90-458f-ad91-34b3bb4aa877"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:34:09.103533 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.103390 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "337e6ae7-1623-47dd-a0ac-5a09c79c3db5" (UID: "337e6ae7-1623-47dd-a0ac-5a09c79c3db5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:34:09.103533 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.103454 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab0df27-7e90-458f-ad91-34b3bb4aa877-kube-api-access-6kxnd" (OuterVolumeSpecName: "kube-api-access-6kxnd") pod "7ab0df27-7e90-458f-ad91-34b3bb4aa877" (UID: "7ab0df27-7e90-458f-ad91-34b3bb4aa877"). InnerVolumeSpecName "kube-api-access-6kxnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:34:09.104388 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.104366 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-kube-api-access-g2pfl" (OuterVolumeSpecName: "kube-api-access-g2pfl") pod "337e6ae7-1623-47dd-a0ac-5a09c79c3db5" (UID: "337e6ae7-1623-47dd-a0ac-5a09c79c3db5"). InnerVolumeSpecName "kube-api-access-g2pfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:34:09.111378 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.111349 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-feast-data" (OuterVolumeSpecName: "feast-data") pod "337e6ae7-1623-47dd-a0ac-5a09c79c3db5" (UID: "337e6ae7-1623-47dd-a0ac-5a09c79c3db5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:34:09.201589 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.201541 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-registry-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:34:09.201589 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.201604 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-online-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:34:09.201804 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.201613 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7ab0df27-7e90-458f-ad91-34b3bb4aa877-online-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:34:09.201804 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.201621 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-feast-data\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:34:09.201804 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.201629 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-registry-tls\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:34:09.201804 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.201637 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7ab0df27-7e90-458f-ad91-34b3bb4aa877-feast-data\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:34:09.201804 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.201645 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kxnd\" (UniqueName: \"kubernetes.io/projected/7ab0df27-7e90-458f-ad91-34b3bb4aa877-kube-api-access-6kxnd\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:34:09.201804 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.201656 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2pfl\" (UniqueName: \"kubernetes.io/projected/337e6ae7-1623-47dd-a0ac-5a09c79c3db5-kube-api-access-g2pfl\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:34:09.854146 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.854058 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" Sep 15 09:34:09.854619 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.854061 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8" event={"ID":"7ab0df27-7e90-458f-ad91-34b3bb4aa877","Type":"ContainerDied","Data":"068202896fc0d24d4035ef56b06aa954c298bfd88aceb6b49089be2701007456"} Sep 15 09:34:09.854619 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.854224 2566 scope.go:117] "RemoveContainer" containerID="d4abf5664c53eb834b701e3b5e247ba01e218a804b9f59b55cff979560809767" Sep 15 09:34:09.856763 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.856730 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" event={"ID":"337e6ae7-1623-47dd-a0ac-5a09c79c3db5","Type":"ContainerDied","Data":"00f8b23837500fbdbe1667deea756bf804304b87ad66be7c4120daa8d03acc4b"} Sep 15 09:34:09.856763 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.856750 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8" Sep 15 09:34:09.863938 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.863588 2566 scope.go:117] "RemoveContainer" containerID="f43d80a1e6232e481835b9c902816acaf89397ff197d0521a3407bdae91f9493" Sep 15 09:34:09.871738 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.871724 2566 scope.go:117] "RemoveContainer" containerID="7798b5b40b3c26e6412588f1d35154326334a94098b0416b7869482fa8eab577" Sep 15 09:34:09.876305 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.876284 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8"] Sep 15 09:34:09.879945 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.879928 2566 scope.go:117] "RemoveContainer" containerID="256a43fc5c73b2c1ae1f2c61c4b9bf05f6df5d899d5a310878d24ff55cb94af9" Sep 15 09:34:09.880193 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.880173 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68bbc86c66-psqs8"] Sep 15 09:34:09.887048 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.887033 2566 scope.go:117] "RemoveContainer" containerID="e7ee0ce629addae89b4dbe72ac4fc75c6ee3e55247b42f833de23266e9559313" Sep 15 09:34:09.891354 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.891336 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8"] Sep 15 09:34:09.895542 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.895524 2566 scope.go:117] "RemoveContainer" containerID="1f4f2eafc78977f65b6843751e3766ed508bd96d0882a3a35a10000bf534ee7a" Sep 15 09:34:09.895595 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.895531 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-799d98b8b9-2wnx8"] Sep 15 09:34:09.902800 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.902783 2566 scope.go:117] "RemoveContainer" containerID="6dfef5590346f25701f4a2bd7dc8bab17c66f78ad1d3dd9becc8c32141aff697" Sep 15 09:34:09.909567 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:09.909552 2566 scope.go:117] "RemoveContainer" containerID="19a8166c4fa05c76c0893a9bc9c23f1d22ea633bb2fb9fc5143f27964b5ceb72" Sep 15 09:34:10.975199 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:10.975165 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" path="/var/lib/kubelet/pods/337e6ae7-1623-47dd-a0ac-5a09c79c3db5/volumes" Sep 15 09:34:10.975684 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:34:10.975670 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" path="/var/lib/kubelet/pods/7ab0df27-7e90-458f-ad91-34b3bb4aa877/volumes" Sep 15 09:35:11.005687 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:35:11.005662 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:35:11.006231 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:35:11.005662 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:40:11.030051 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:40:11.030020 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:40:11.030799 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:40:11.030779 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:45:11.054097 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:11.054070 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:45:11.056088 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:11.056060 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:45:29.067039 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067002 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h5qkn/must-gather-ft6pl"] Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067297 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d206f45-5ab1-4f96-9bda-2174194258a9" containerName="manager" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067308 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d206f45-5ab1-4f96-9bda-2174194258a9" containerName="manager" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067316 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="online" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067323 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="online" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067332 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75a10d3-dc1c-4bf8-b953-06567fbf9eb4" containerName="redis" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067337 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75a10d3-dc1c-4bf8-b953-06567fbf9eb4" containerName="redis" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067345 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="feast-init" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067350 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="feast-init" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067358 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="online" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067363 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="online" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067369 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="feast-apply" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067374 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="feast-apply" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067381 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="feast-init" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067386 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="feast-init" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067397 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4cef9c-a952-47c5-91ba-8f9b82aff0e0" containerName="postgres" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067414 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4cef9c-a952-47c5-91ba-8f9b82aff0e0" containerName="postgres" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067419 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="feast-apply" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067423 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="feast-apply" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067429 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="registry" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067434 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="registry" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067442 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="registry" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067448 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="registry" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067492 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b75a10d3-dc1c-4bf8-b953-06567fbf9eb4" containerName="redis" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067499 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="registry" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067506 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="online" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067513 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d206f45-5ab1-4f96-9bda-2174194258a9" containerName="manager" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067519 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ab0df27-7e90-458f-ad91-34b3bb4aa877" containerName="registry" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067526 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a4cef9c-a952-47c5-91ba-8f9b82aff0e0" containerName="postgres" Sep 15 09:45:29.067536 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.067531 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="337e6ae7-1623-47dd-a0ac-5a09c79c3db5" containerName="online" Sep 15 09:45:29.070469 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.070450 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:29.073002 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.072979 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h5qkn\"/\"openshift-service-ca.crt\"" Sep 15 09:45:29.073587 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.073567 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h5qkn\"/\"default-dockercfg-vcsgv\"" Sep 15 09:45:29.073677 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.073608 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h5qkn\"/\"kube-root-ca.crt\"" Sep 15 09:45:29.079129 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.079106 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h5qkn/must-gather-ft6pl"] Sep 15 09:45:29.115448 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.115416 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-must-gather-output\") pod \"must-gather-ft6pl\" (UID: \"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8\") " pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:29.115589 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.115455 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq8fv\" (UniqueName: \"kubernetes.io/projected/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-kube-api-access-cq8fv\") pod \"must-gather-ft6pl\" (UID: \"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8\") " pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:29.216733 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.216700 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-must-gather-output\") pod \"must-gather-ft6pl\" (UID: \"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8\") " pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:29.216733 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.216735 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq8fv\" (UniqueName: \"kubernetes.io/projected/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-kube-api-access-cq8fv\") pod \"must-gather-ft6pl\" (UID: \"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8\") " pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:29.217093 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.217071 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-must-gather-output\") pod \"must-gather-ft6pl\" (UID: \"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8\") " pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:29.225211 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.225190 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq8fv\" (UniqueName: \"kubernetes.io/projected/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-kube-api-access-cq8fv\") pod \"must-gather-ft6pl\" (UID: \"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8\") " pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:29.393316 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.393222 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:29.660456 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.660431 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h5qkn/must-gather-ft6pl"] Sep 15 09:45:29.663588 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:45:29.663564 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcaff88bf_dd81_459a_bc9c_cb5fa6f89cd8.slice/crio-c1dd1f3106e3b84b18ef7bcaa8fdda936a97be13579f9a491b176f6ded2e9ee7 WatchSource:0}: Error finding container c1dd1f3106e3b84b18ef7bcaa8fdda936a97be13579f9a491b176f6ded2e9ee7: Status 404 returned error can't find the container with id c1dd1f3106e3b84b18ef7bcaa8fdda936a97be13579f9a491b176f6ded2e9ee7 Sep 15 09:45:29.665501 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:29.665481 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 09:45:30.442540 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:30.442491 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" event={"ID":"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8","Type":"ContainerStarted","Data":"c1dd1f3106e3b84b18ef7bcaa8fdda936a97be13579f9a491b176f6ded2e9ee7"} Sep 15 09:45:36.472341 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:36.472307 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" event={"ID":"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8","Type":"ContainerStarted","Data":"77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893"} Sep 15 09:45:36.472758 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:36.472356 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" event={"ID":"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8","Type":"ContainerStarted","Data":"8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28"} Sep 15 09:45:36.487931 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:36.487876 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" podStartSLOduration=1.534521784 podStartE2EDuration="7.487859555s" totalImagesPullingTime="5.953337771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:36.486255127 +0000 UTC m=+1825.992832564" watchObservedRunningTime="2026-09-15 09:45:36.487859555 +0000 UTC m=+1825.994436991" Sep 15 09:45:45.508497 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:45.508415 2566 generic.go:356] "Generic (PLEG): container finished" podID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" containerID="8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28" exitCode=0 Sep 15 09:45:45.508497 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:45.508474 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" event={"ID":"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8","Type":"ContainerDied","Data":"8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28"} Sep 15 09:45:45.508909 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:45.508748 2566 scope.go:117] "RemoveContainer" containerID="8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28" Sep 15 09:45:46.180485 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.180454 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-h5qkn_must-gather-ft6pl_caff88bf-dd81-459a-bc9c-cb5fa6f89cd8/gather/0.log" Sep 15 09:45:46.630311 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.630234 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mxgxj/must-gather-d6tj9"] Sep 15 09:45:46.633201 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.633185 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxgxj/must-gather-d6tj9" Sep 15 09:45:46.635411 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.635372 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mxgxj\"/\"default-dockercfg-pcfhp\"" Sep 15 09:45:46.636082 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.636064 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mxgxj\"/\"openshift-service-ca.crt\"" Sep 15 09:45:46.636431 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.636418 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mxgxj\"/\"kube-root-ca.crt\"" Sep 15 09:45:46.643297 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.643276 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxgxj/must-gather-d6tj9"] Sep 15 09:45:46.768863 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.768832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6da10815-59eb-4977-8fd8-1c6775f3daef-must-gather-output\") pod \"must-gather-d6tj9\" (UID: \"6da10815-59eb-4977-8fd8-1c6775f3daef\") " pod="openshift-must-gather-mxgxj/must-gather-d6tj9" Sep 15 09:45:46.769023 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.768876 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2npmp\" (UniqueName: \"kubernetes.io/projected/6da10815-59eb-4977-8fd8-1c6775f3daef-kube-api-access-2npmp\") pod \"must-gather-d6tj9\" (UID: \"6da10815-59eb-4977-8fd8-1c6775f3daef\") " pod="openshift-must-gather-mxgxj/must-gather-d6tj9" Sep 15 09:45:46.869831 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.869806 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6da10815-59eb-4977-8fd8-1c6775f3daef-must-gather-output\") pod \"must-gather-d6tj9\" (UID: \"6da10815-59eb-4977-8fd8-1c6775f3daef\") " pod="openshift-must-gather-mxgxj/must-gather-d6tj9" Sep 15 09:45:46.869972 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.869847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2npmp\" (UniqueName: \"kubernetes.io/projected/6da10815-59eb-4977-8fd8-1c6775f3daef-kube-api-access-2npmp\") pod \"must-gather-d6tj9\" (UID: \"6da10815-59eb-4977-8fd8-1c6775f3daef\") " pod="openshift-must-gather-mxgxj/must-gather-d6tj9" Sep 15 09:45:46.870139 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.870117 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6da10815-59eb-4977-8fd8-1c6775f3daef-must-gather-output\") pod \"must-gather-d6tj9\" (UID: \"6da10815-59eb-4977-8fd8-1c6775f3daef\") " pod="openshift-must-gather-mxgxj/must-gather-d6tj9" Sep 15 09:45:46.877184 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.877162 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2npmp\" (UniqueName: \"kubernetes.io/projected/6da10815-59eb-4977-8fd8-1c6775f3daef-kube-api-access-2npmp\") pod \"must-gather-d6tj9\" (UID: \"6da10815-59eb-4977-8fd8-1c6775f3daef\") " pod="openshift-must-gather-mxgxj/must-gather-d6tj9" Sep 15 09:45:46.942367 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:46.942346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxgxj/must-gather-d6tj9" Sep 15 09:45:47.210565 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:47.210483 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxgxj/must-gather-d6tj9"] Sep 15 09:45:47.212805 ip-10-0-132-158 kubenswrapper[2566]: W0915 09:45:47.212772 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6da10815_59eb_4977_8fd8_1c6775f3daef.slice/crio-4b054ec5f42c20136a959e2bd3272abfc24e8d48b13903ea5f09fc200486837c WatchSource:0}: Error finding container 4b054ec5f42c20136a959e2bd3272abfc24e8d48b13903ea5f09fc200486837c: Status 404 returned error can't find the container with id 4b054ec5f42c20136a959e2bd3272abfc24e8d48b13903ea5f09fc200486837c Sep 15 09:45:47.518268 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:47.518186 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxgxj/must-gather-d6tj9" event={"ID":"6da10815-59eb-4977-8fd8-1c6775f3daef","Type":"ContainerStarted","Data":"4b054ec5f42c20136a959e2bd3272abfc24e8d48b13903ea5f09fc200486837c"} Sep 15 09:45:48.523922 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:48.523887 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxgxj/must-gather-d6tj9" event={"ID":"6da10815-59eb-4977-8fd8-1c6775f3daef","Type":"ContainerStarted","Data":"a54ea03bc9979621afddf224d14679e7d37c279a11741f8b0b18ee7354c057b7"} Sep 15 09:45:48.524297 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:48.523936 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxgxj/must-gather-d6tj9" event={"ID":"6da10815-59eb-4977-8fd8-1c6775f3daef","Type":"ContainerStarted","Data":"08e5f2d16cb8a5c325546c1c0085c1fbc5fa8209f415502bf57b4adb02ab9bac"} Sep 15 09:45:48.540617 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:48.540554 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mxgxj/must-gather-d6tj9" podStartSLOduration=1.787367565 podStartE2EDuration="2.54053135s" totalImagesPullingTime="753.163785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:48.537651522 +0000 UTC m=+1838.044228964" watchObservedRunningTime="2026-09-15 09:45:48.54053135 +0000 UTC m=+1838.047108790" Sep 15 09:45:49.267324 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:49.267295 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4wbhf_e9e36a2a-23f0-4257-8685-1d9349789349/global-pull-secret-syncer/0.log" Sep 15 09:45:49.417023 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:49.416994 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xqg97_52e1c8dc-6067-4995-9433-c631cce937cc/konnectivity-agent/0.log" Sep 15 09:45:49.438417 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:49.438376 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-158.ec2.internal_3a44f61a74ce15f38275564d7d0ce773/haproxy/0.log" Sep 15 09:45:51.476173 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:51.476132 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-h5qkn/must-gather-ft6pl"] Sep 15 09:45:51.476784 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:51.476682 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" containerName="copy" containerID="cri-o://77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893" gracePeriod=2 Sep 15 09:45:51.478509 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:45:51.478481 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ft6pl\" is forbidden: User \"system:node:ip-10-0-132-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h5qkn\": no relationship found between node 'ip-10-0-132-158.ec2.internal' and this object" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:51.479424 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:51.479372 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-h5qkn/must-gather-ft6pl"] Sep 15 09:45:51.823483 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:51.820444 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-h5qkn_must-gather-ft6pl_caff88bf-dd81-459a-bc9c-cb5fa6f89cd8/copy/0.log" Sep 15 09:45:51.828581 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:51.828046 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:51.839037 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:45:51.832594 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ft6pl\" is forbidden: User \"system:node:ip-10-0-132-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h5qkn\": no relationship found between node 'ip-10-0-132-158.ec2.internal' and this object" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:52.027042 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.027003 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-must-gather-output\") pod \"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8\" (UID: \"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8\") " Sep 15 09:45:52.027247 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.027058 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq8fv\" (UniqueName: \"kubernetes.io/projected/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-kube-api-access-cq8fv\") pod \"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8\" (UID: \"caff88bf-dd81-459a-bc9c-cb5fa6f89cd8\") " Sep 15 09:45:52.028215 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.028187 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" (UID: "caff88bf-dd81-459a-bc9c-cb5fa6f89cd8"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:45:52.036344 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.036295 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-kube-api-access-cq8fv" (OuterVolumeSpecName: "kube-api-access-cq8fv") pod "caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" (UID: "caff88bf-dd81-459a-bc9c-cb5fa6f89cd8"). InnerVolumeSpecName "kube-api-access-cq8fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:45:52.128594 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.128463 2566 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-must-gather-output\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:45:52.128594 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.128508 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq8fv\" (UniqueName: \"kubernetes.io/projected/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8-kube-api-access-cq8fv\") on node \"ip-10-0-132-158.ec2.internal\" DevicePath \"\"" Sep 15 09:45:52.587314 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.587287 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-h5qkn_must-gather-ft6pl_caff88bf-dd81-459a-bc9c-cb5fa6f89cd8/copy/0.log" Sep 15 09:45:52.588440 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.588394 2566 generic.go:356] "Generic (PLEG): container finished" podID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" containerID="77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893" exitCode=143 Sep 15 09:45:52.588632 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.588619 2566 scope.go:117] "RemoveContainer" containerID="77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893" Sep 15 09:45:52.588959 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.588935 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:52.596279 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:45:52.596247 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ft6pl\" is forbidden: User \"system:node:ip-10-0-132-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h5qkn\": no relationship found between node 'ip-10-0-132-158.ec2.internal' and this object" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:52.605871 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.605631 2566 scope.go:117] "RemoveContainer" containerID="8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28" Sep 15 09:45:52.615086 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:45:52.615040 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ft6pl\" is forbidden: User \"system:node:ip-10-0-132-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h5qkn\": no relationship found between node 'ip-10-0-132-158.ec2.internal' and this object" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" pod="openshift-must-gather-h5qkn/must-gather-ft6pl" Sep 15 09:45:52.627992 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.627631 2566 scope.go:117] "RemoveContainer" containerID="77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893" Sep 15 09:45:52.628538 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:45:52.628205 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893\": container with ID starting with 77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893 not found: ID does not exist" containerID="77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893" Sep 15 09:45:52.628538 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.628241 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893"} err="failed to get container status \"77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893\": rpc error: code = NotFound desc = could not find container \"77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893\": container with ID starting with 77b89355ba897f03b32b7eafa8575c8ac6ef15ae973d2bd8643917a05bc7f893 not found: ID does not exist" Sep 15 09:45:52.628538 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.628265 2566 scope.go:117] "RemoveContainer" containerID="8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28" Sep 15 09:45:52.628938 ip-10-0-132-158 kubenswrapper[2566]: E0915 09:45:52.628841 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28\": container with ID starting with 8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28 not found: ID does not exist" containerID="8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28" Sep 15 09:45:52.628938 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.628881 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28"} err="failed to get container status \"8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28\": rpc error: code = NotFound desc = could not find container \"8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28\": container with ID starting with 8762fe4b3dab58221c87406ce8e1504106a76bb7206797e45d19af18fbb68d28 not found: ID does not exist" Sep 15 09:45:52.978308 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:52.978267 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" path="/var/lib/kubelet/pods/caff88bf-dd81-459a-bc9c-cb5fa6f89cd8/volumes" Sep 15 09:45:53.395118 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.395029 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52ab40d3-1531-48c3-9cb1-9cb7d1659b80/alertmanager/0.log" Sep 15 09:45:53.419678 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.419644 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52ab40d3-1531-48c3-9cb1-9cb7d1659b80/config-reloader/0.log" Sep 15 09:45:53.445567 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.445542 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52ab40d3-1531-48c3-9cb1-9cb7d1659b80/kube-rbac-proxy-web/0.log" Sep 15 09:45:53.475563 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.475498 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52ab40d3-1531-48c3-9cb1-9cb7d1659b80/kube-rbac-proxy/0.log" Sep 15 09:45:53.497347 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.497313 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52ab40d3-1531-48c3-9cb1-9cb7d1659b80/kube-rbac-proxy-metric/0.log" Sep 15 09:45:53.519263 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.519231 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52ab40d3-1531-48c3-9cb1-9cb7d1659b80/prom-label-proxy/0.log" Sep 15 09:45:53.542637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.542605 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52ab40d3-1531-48c3-9cb1-9cb7d1659b80/init-config-reloader/0.log" Sep 15 09:45:53.706031 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.705997 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-77rnf_bb1a5e48-cbaf-4fac-90c5-a09e4b36b12b/monitoring-plugin/0.log" Sep 15 09:45:53.809480 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.809360 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk8kb_01dff57b-579d-457b-8d75-3012ddd4f3d1/node-exporter/0.log" Sep 15 09:45:53.832224 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.832197 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk8kb_01dff57b-579d-457b-8d75-3012ddd4f3d1/kube-rbac-proxy/0.log" Sep 15 09:45:53.861918 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:53.861889 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk8kb_01dff57b-579d-457b-8d75-3012ddd4f3d1/init-textfile/0.log" Sep 15 09:45:54.226412 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:54.226367 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-d2t6d_5d6a9e70-250b-4fcf-bee2-2429f7bc67e4/prometheus-operator/0.log" Sep 15 09:45:54.246285 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:54.246257 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-d2t6d_5d6a9e70-250b-4fcf-bee2-2429f7bc67e4/kube-rbac-proxy/0.log" Sep 15 09:45:54.277628 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:54.277598 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-lwnk9_9970a3de-f057-4369-97a9-c8ec1ca73aea/prometheus-operator-admission-webhook/0.log" Sep 15 09:45:54.303719 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:54.303689 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566d69fc7f-5pfl9_6f46c5aa-f2ce-480f-a803-e4dcac0a5fef/telemeter-client/0.log" Sep 15 09:45:54.323157 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:54.323126 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566d69fc7f-5pfl9_6f46c5aa-f2ce-480f-a803-e4dcac0a5fef/reload/0.log" Sep 15 09:45:54.345645 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:54.345610 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566d69fc7f-5pfl9_6f46c5aa-f2ce-480f-a803-e4dcac0a5fef/kube-rbac-proxy/0.log" Sep 15 09:45:56.201790 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:56.201762 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/2.log" Sep 15 09:45:56.206979 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:56.206940 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-7fpdd_49187d15-474b-4a73-86ba-8803028dc6a8/console-operator/3.log" Sep 15 09:45:56.582637 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:56.582566 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66899f7b6d-9pclg_aae5a08e-f311-43ad-9f95-5899b1a9116a/console/0.log" Sep 15 09:45:56.616217 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:56.616181 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-ht9s8_37c4b1d9-4f93-4b64-9178-32c707e3ffd9/download-server/0.log" Sep 15 09:45:57.801490 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.801459 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8"] Sep 15 09:45:57.802555 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.802525 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" containerName="copy" Sep 15 09:45:57.802698 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.802683 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" containerName="copy" Sep 15 09:45:57.802837 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.802815 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" containerName="gather" Sep 15 09:45:57.802837 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.802833 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" containerName="gather" Sep 15 09:45:57.802989 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.802916 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" containerName="copy" Sep 15 09:45:57.802989 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.802934 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="caff88bf-dd81-459a-bc9c-cb5fa6f89cd8" containerName="gather" Sep 15 09:45:57.809413 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.809378 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.814127 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.814101 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8"] Sep 15 09:45:57.879038 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.878997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-sys\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.879251 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.879055 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-lib-modules\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.879251 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.879098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-podres\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.879251 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.879133 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bhp2\" (UniqueName: \"kubernetes.io/projected/87821948-bac5-49e4-adfa-26878c15f72c-kube-api-access-4bhp2\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.879251 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.879163 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-proc\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.940269 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.940241 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvzkl_1ac81511-86aa-4d8d-a67b-683277287dfc/dns/0.log" Sep 15 09:45:57.960181 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.960152 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvzkl_1ac81511-86aa-4d8d-a67b-683277287dfc/kube-rbac-proxy/0.log" Sep 15 09:45:57.979759 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.979726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-podres\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.979917 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.979767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bhp2\" (UniqueName: \"kubernetes.io/projected/87821948-bac5-49e4-adfa-26878c15f72c-kube-api-access-4bhp2\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.979917 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.979797 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-proc\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.979917 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.979872 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-sys\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.979917 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.979879 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-podres\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.979917 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.979903 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-lib-modules\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.980145 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.979932 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-sys\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.980145 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.979933 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-proc\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.980145 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.980030 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87821948-bac5-49e4-adfa-26878c15f72c-lib-modules\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:57.987242 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:57.987217 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bhp2\" (UniqueName: \"kubernetes.io/projected/87821948-bac5-49e4-adfa-26878c15f72c-kube-api-access-4bhp2\") pod \"perf-node-gather-daemonset-m7hk8\" (UID: \"87821948-bac5-49e4-adfa-26878c15f72c\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:58.066345 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:58.066268 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v4rkp_0f58ca49-d00b-4740-8ca4-96e5f1836bb0/dns-node-resolver/0.log" Sep 15 09:45:58.124338 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:58.124305 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:58.400205 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:58.400121 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8"] Sep 15 09:45:58.504606 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:58.504583 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8s2p_abe08162-7133-43f5-b5d4-c4db416ecab3/node-ca/0.log" Sep 15 09:45:58.626478 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:58.626437 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" event={"ID":"87821948-bac5-49e4-adfa-26878c15f72c","Type":"ContainerStarted","Data":"42f8222d3795894fe79ac3a9af1e5413019cb28558be97df9b69c8d34f541da5"} Sep 15 09:45:58.626666 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:58.626497 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" event={"ID":"87821948-bac5-49e4-adfa-26878c15f72c","Type":"ContainerStarted","Data":"e0f31cc63314c517802a18fd3153af861b965744082af8813030c864ac435d59"} Sep 15 09:45:58.626666 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:58.626527 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:45:58.642124 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:58.642073 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" podStartSLOduration=1.642056285 podStartE2EDuration="1.642056285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:58.640818574 +0000 UTC m=+1848.147396011" watchObservedRunningTime="2026-09-15 09:45:58.642056285 +0000 UTC m=+1848.148633792" Sep 15 09:45:59.478473 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:59.478441 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6d885_0e93a76c-8324-4681-8b94-a454ec734a22/serve-healthcheck-canary/0.log" Sep 15 09:45:59.833116 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:59.833035 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-5v5xq_4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae/insights-operator/0.log" Sep 15 09:45:59.833477 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:59.833459 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-5v5xq_4196ebe8-dcfa-4f70-ad84-2b8d0888f2ae/insights-operator/1.log" Sep 15 09:45:59.974519 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:59.974492 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tlzjp_af705269-bc07-422f-aed7-a411b8954c6d/kube-rbac-proxy/0.log" Sep 15 09:45:59.993727 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:45:59.993706 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tlzjp_af705269-bc07-422f-aed7-a411b8954c6d/exporter/0.log" Sep 15 09:46:00.014770 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:00.014744 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tlzjp_af705269-bc07-422f-aed7-a411b8954c6d/extractor/0.log" Sep 15 09:46:04.640899 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:04.640870 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-m7hk8" Sep 15 09:46:05.232684 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:05.232653 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqqj2_f03148de-9805-4f67-8fb7-2ba911accd06/kube-multus-additional-cni-plugins/0.log" Sep 15 09:46:05.251077 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:05.251049 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqqj2_f03148de-9805-4f67-8fb7-2ba911accd06/egress-router-binary-copy/0.log" Sep 15 09:46:05.269841 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:05.269817 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqqj2_f03148de-9805-4f67-8fb7-2ba911accd06/cni-plugins/0.log" Sep 15 09:46:05.289034 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:05.289015 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqqj2_f03148de-9805-4f67-8fb7-2ba911accd06/bond-cni-plugin/0.log" Sep 15 09:46:05.310582 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:05.310558 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqqj2_f03148de-9805-4f67-8fb7-2ba911accd06/routeoverride-cni/0.log" Sep 15 09:46:05.328879 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:05.328858 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqqj2_f03148de-9805-4f67-8fb7-2ba911accd06/whereabouts-cni-bincopy/0.log" Sep 15 09:46:05.347581 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:05.347563 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqqj2_f03148de-9805-4f67-8fb7-2ba911accd06/whereabouts-cni/0.log" Sep 15 09:46:05.377057 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:05.377041 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-btkc9_1aa7f2cf-bd36-4ef1-84a9-7dfda0d979cf/kube-multus/0.log" Sep 15 09:46:05.419507 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:05.419484 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kl7xm_e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7/network-metrics-daemon/0.log" Sep 15 09:46:05.440288 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:05.440271 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kl7xm_e29f40c9-7bc4-4b1d-bbf2-0fac5ac735e7/kube-rbac-proxy/0.log" Sep 15 09:46:06.622554 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:06.622516 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzqrf_824cffcb-a109-4605-917b-4224320c952a/ovn-controller/0.log" Sep 15 09:46:06.642333 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:06.642311 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzqrf_824cffcb-a109-4605-917b-4224320c952a/ovn-acl-logging/0.log" Sep 15 09:46:06.668856 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:06.668788 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzqrf_824cffcb-a109-4605-917b-4224320c952a/kube-rbac-proxy-node/0.log" Sep 15 09:46:06.690464 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:06.690398 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzqrf_824cffcb-a109-4605-917b-4224320c952a/kube-rbac-proxy-ovn-metrics/0.log" Sep 15 09:46:06.709699 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:06.709642 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzqrf_824cffcb-a109-4605-917b-4224320c952a/northd/0.log" Sep 15 09:46:06.732074 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:06.732006 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzqrf_824cffcb-a109-4605-917b-4224320c952a/nbdb/0.log" Sep 15 09:46:06.759570 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:06.759526 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzqrf_824cffcb-a109-4605-917b-4224320c952a/sbdb/0.log" Sep 15 09:46:06.808250 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:06.808182 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzqrf_824cffcb-a109-4605-917b-4224320c952a/ovnkube-controller/0.log" Sep 15 09:46:07.763893 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:07.763864 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-swmmq_2c5284d5-5fca-4c6c-b37f-33b04532d494/check-endpoints/0.log" Sep 15 09:46:07.784132 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:07.784108 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5qt48_db4dddf9-4ec7-4b46-8f22-e508adeddc95/network-check-target-container/0.log" Sep 15 09:46:08.720261 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:08.720233 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-g66b8_ed9b06ef-3480-4265-8056-5d8c8ec1c4b5/iptables-alerter/0.log" Sep 15 09:46:09.321167 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:09.321086 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-ncxjn_5d63bbad-f561-4ca9-88e8-cf715a6f0a03/tuned/0.log" Sep 15 09:46:10.872703 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:10.872666 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-2ncsq_034dc83c-508d-4905-a35c-4ee9fc41ca8f/cluster-samples-operator/0.log" Sep 15 09:46:10.886468 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:10.886444 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-2ncsq_034dc83c-508d-4905-a35c-4ee9fc41ca8f/cluster-samples-operator-watch/0.log" Sep 15 09:46:12.477600 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:12.477568 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-wpmqv_627bf239-bde8-4671-ae9c-3e59d0f8faa7/csi-driver/0.log" Sep 15 09:46:12.497397 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:12.497369 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-wpmqv_627bf239-bde8-4671-ae9c-3e59d0f8faa7/csi-node-driver-registrar/0.log" Sep 15 09:46:12.516107 ip-10-0-132-158 kubenswrapper[2566]: I0915 09:46:12.516082 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-wpmqv_627bf239-bde8-4671-ae9c-3e59d0f8faa7/csi-liveness-probe/0.log"