Sep 10 04:24:30.700395 ip-10-0-140-38 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 04:24:30.700409 ip-10-0-140-38 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 04:24:30.700419 ip-10-0-140-38 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 04:24:30.700734 ip-10-0-140-38 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 04:24:40.701908 ip-10-0-140-38 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 04:24:40.701925 ip-10-0-140-38 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ad0f61a186254541a5e851a1c16a4603 -- Sep 10 04:26:09.939473 ip-10-0-140-38 systemd[1]: Starting Kubernetes Kubelet... Sep 10 04:26:10.377265 ip-10-0-140-38 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 04:26:10.377265 ip-10-0-140-38 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 04:26:10.377265 ip-10-0-140-38 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 04:26:10.377265 ip-10-0-140-38 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 04:26:10.377265 ip-10-0-140-38 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 04:26:10.379392 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.379313 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 04:26:10.384200 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384185 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:10.384200 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384199 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384203 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384206 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384210 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384213 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384217 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384220 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384223 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384226 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384229 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384232 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384235 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384237 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384240 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384243 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384245 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384248 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384250 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384253 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384257 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:10.384264 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384261 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384264 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384268 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384271 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384281 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384284 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384287 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384291 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384294 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384297 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384300 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384302 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384305 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384308 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384310 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384313 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384316 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384318 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384321 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:10.384738 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384324 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384327 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384329 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384332 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384334 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384337 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384339 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384342 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384345 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384349 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384352 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384355 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384358 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384360 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384363 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384366 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384369 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384372 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384374 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:10.385201 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384377 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384380 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384382 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384385 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384389 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384392 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384394 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384397 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384400 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384402 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384405 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384408 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384410 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384413 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384416 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384418 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384420 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384423 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384427 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:10.385664 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384430 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384432 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384435 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384437 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384440 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384442 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384445 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384447 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384450 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384454 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384457 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384459 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384462 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384465 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384467 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384470 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384473 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384475 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384478 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384480 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:10.386154 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.384483 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385157 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385178 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385181 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385184 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385188 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385191 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385194 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385197 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385199 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385202 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385206 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385210 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385212 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385215 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385218 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385221 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385223 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385226 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385229 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:10.386654 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385231 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385234 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385237 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385240 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385242 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385245 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385247 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385250 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385253 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385256 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385259 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385261 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385264 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385266 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385269 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385271 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385274 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385277 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385280 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385282 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:10.387148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385285 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385287 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385290 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385293 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385295 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385298 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385301 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385304 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385306 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385309 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385312 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385315 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385318 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385320 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385323 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385325 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385328 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385332 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385336 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:10.387645 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385339 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385342 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385345 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385348 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385350 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385353 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385356 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385358 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385361 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385364 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385367 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385369 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385372 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385375 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385377 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385380 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385383 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385385 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385388 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385391 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:10.388099 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385394 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385396 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385399 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385401 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385404 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385407 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385409 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385413 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385416 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385419 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385422 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385426 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385429 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385432 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385435 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385438 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385441 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385443 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385446 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:10.388613 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385448 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385451 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385804 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385809 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385811 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385814 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385817 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385820 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385822 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385825 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385828 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385830 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385834 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385836 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385839 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385841 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385844 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385847 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385849 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385852 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:10.389148 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385855 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385857 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385860 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385863 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385865 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385868 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385870 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385873 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385876 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385880 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385882 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385885 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385887 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385890 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385894 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385896 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385899 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385901 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385904 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385906 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:10.389652 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385909 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385914 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385917 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385919 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385923 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385926 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385929 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385931 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385934 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385936 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385939 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385941 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385944 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385947 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385949 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385953 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385956 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385959 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385962 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:10.390128 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385965 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385968 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385970 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385973 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385975 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385978 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385981 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385984 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385988 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385991 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385994 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.385997 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386000 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386003 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386007 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386009 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386012 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386014 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386017 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:10.390608 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386021 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386024 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386026 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386029 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386032 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386034 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386037 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386040 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386042 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386044 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386047 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386049 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386052 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386054 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386057 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386059 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386062 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386064 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386067 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386069 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:10.391103 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386073 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386076 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386078 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386172 2555 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386214 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386222 2555 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386226 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386231 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386235 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386239 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386243 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386246 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386249 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386254 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386257 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386261 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386264 2555 flags.go:64] FLAG: --cgroup-root="" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386267 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386270 2555 flags.go:64] FLAG: --client-ca-file="" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386273 2555 flags.go:64] FLAG: --cloud-provider="external" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386275 2555 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386279 2555 flags.go:64] FLAG: --cluster-domain="" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386282 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386285 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 04:26:10.391591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386288 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386292 2555 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386296 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386299 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386302 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386305 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386308 2555 flags.go:64] FLAG: --contention-profiling="false" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386311 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386316 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386319 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386322 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386326 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386329 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386332 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386335 2555 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386338 2555 flags.go:64] FLAG: --enable-server="true" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386341 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386346 2555 flags.go:64] FLAG: --event-burst="100" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386350 2555 flags.go:64] FLAG: --event-qps="50" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386352 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386355 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386358 2555 flags.go:64] FLAG: --eviction-hard="" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386365 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386368 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386371 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 04:26:10.392153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386374 2555 flags.go:64] FLAG: --eviction-soft="" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386377 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386379 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386382 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386385 2555 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386388 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386391 2555 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386394 2555 flags.go:64] FLAG: --feature-gates="" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386397 2555 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386400 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386403 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386406 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386409 2555 flags.go:64] FLAG: --healthz-port="10248" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386412 2555 flags.go:64] FLAG: --help="false" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386415 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386419 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386423 2555 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386426 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386429 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386432 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386435 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386438 2555 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386442 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 04:26:10.392761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386445 2555 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386447 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386451 2555 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386454 2555 flags.go:64] FLAG: --kube-reserved="" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386457 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386460 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386463 2555 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386467 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386470 2555 flags.go:64] FLAG: --lock-file="" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386473 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386476 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386479 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386484 2555 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386487 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386490 2555 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386493 2555 flags.go:64] FLAG: --logging-format="text" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386496 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386499 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386502 2555 flags.go:64] FLAG: --manifest-url="" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386505 2555 flags.go:64] FLAG: --manifest-url-header="" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386518 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386521 2555 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386526 2555 flags.go:64] FLAG: --max-pods="110" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386529 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386533 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 04:26:10.393382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386536 2555 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386539 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386542 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386545 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386548 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386555 2555 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386558 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386561 2555 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386564 2555 flags.go:64] FLAG: --pod-cidr="" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386567 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386572 2555 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386579 2555 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386582 2555 flags.go:64] FLAG: --pods-per-core="0" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386585 2555 flags.go:64] FLAG: --port="10250" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386588 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386592 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0433aea2ad5ecb8b8" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386595 2555 flags.go:64] FLAG: --qos-reserved="" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386598 2555 flags.go:64] FLAG: --read-only-port="10255" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386601 2555 flags.go:64] FLAG: --register-node="true" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386604 2555 flags.go:64] FLAG: --register-with-taints="" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386607 2555 flags.go:64] FLAG: --registry-burst="10" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386610 2555 flags.go:64] FLAG: --registry-qps="5" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386612 2555 flags.go:64] FLAG: --reserved-cpus="" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386615 2555 flags.go:64] FLAG: --reserved-memory="" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386618 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 04:26:10.393978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386621 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386624 2555 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386627 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386630 2555 flags.go:64] FLAG: --runonce="false" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386633 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386636 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386640 2555 flags.go:64] FLAG: --seccomp-default="false" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386643 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386646 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386649 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386652 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386655 2555 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386658 2555 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386661 2555 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386665 2555 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386668 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386672 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386675 2555 flags.go:64] FLAG: --system-cgroups="" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386677 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386682 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386685 2555 flags.go:64] FLAG: --tls-cert-file="" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386688 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386692 2555 flags.go:64] FLAG: --tls-min-version="" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386695 2555 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386698 2555 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 04:26:10.394651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386701 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386704 2555 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386707 2555 flags.go:64] FLAG: --v="2" Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386710 2555 flags.go:64] FLAG: --version="false" Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386717 2555 flags.go:64] FLAG: --vmodule="" Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386720 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.386724 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386844 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386848 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386852 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386855 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386858 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386861 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386865 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386867 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386870 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386872 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386875 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386877 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386880 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386882 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:10.395268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386886 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386889 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386891 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386894 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386897 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386900 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386902 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386905 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386909 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386913 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386917 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386920 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386923 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386925 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386928 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386930 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386933 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386935 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386938 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386940 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:10.395779 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386943 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386945 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386948 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386950 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386953 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386955 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386958 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386960 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386963 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386967 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386970 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386973 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386977 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386980 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386982 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386985 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386987 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386990 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386992 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:10.396268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386995 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.386999 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387002 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387006 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387014 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387017 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387020 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387023 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387025 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387028 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387030 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387033 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387036 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387038 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387041 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387043 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387046 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387048 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387051 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:10.396726 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387054 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387056 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387059 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387061 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387064 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387066 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387070 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387072 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387075 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387077 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387080 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387082 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387085 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387088 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387090 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387093 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387095 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387098 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387106 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387109 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:10.397258 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387111 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387114 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387116 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387119 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387122 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387124 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.387127 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.388074 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.396546 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.396560 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.396573 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.396581 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396649 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396654 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396657 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:10.397750 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396660 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396663 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396666 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396669 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396671 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396674 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396677 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396679 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396682 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396685 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396687 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396690 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396693 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396697 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396700 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396703 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396706 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396709 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396711 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:10.398146 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396714 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396717 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396720 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396723 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396725 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396728 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396731 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396735 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396738 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396741 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396743 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396746 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396749 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396751 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396754 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396756 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396759 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396762 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396764 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396767 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:10.398614 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396769 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396772 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396774 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396777 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396779 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396783 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396787 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396790 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396793 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396795 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396798 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396801 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396803 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396807 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396811 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396813 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396816 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396819 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396822 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:10.399097 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396824 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396828 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396830 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396833 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396836 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396838 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396841 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396844 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396846 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396849 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396851 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396854 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396857 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396860 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396862 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396865 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396867 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396870 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396873 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396875 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:10.399570 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396878 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396880 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396883 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396885 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396888 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396890 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396893 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396896 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396898 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396900 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396903 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396907 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396910 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396912 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396915 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396918 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396920 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:10.400047 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.396923 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.396928 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397034 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397038 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397041 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397044 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397046 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397049 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397051 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397054 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397058 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397062 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397065 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397068 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397071 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:10.400455 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397073 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397076 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397079 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397082 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397085 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397087 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397090 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397093 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397096 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397099 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397101 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397104 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397107 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397110 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397112 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397115 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397118 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397121 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397123 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397125 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:10.400814 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397128 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397131 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397133 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397135 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397138 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397140 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397143 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397145 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397148 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397150 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397152 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397155 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397157 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397177 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397182 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397185 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397188 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397190 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397193 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:10.401377 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397195 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397198 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397200 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397203 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397205 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397208 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397211 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397213 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397215 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397219 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397221 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397224 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397226 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397228 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397231 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397233 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397236 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397238 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397240 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397243 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397245 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:10.401833 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397248 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397250 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397252 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397255 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397258 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397260 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397263 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397267 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397270 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397273 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397276 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397279 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397281 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397284 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397287 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397290 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397292 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397295 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397298 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:10.402528 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397300 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397303 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397306 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397308 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397312 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397316 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:10.397318 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.397323 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.397414 2555 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.399785 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.400967 2555 server.go:1019] "Starting client certificate rotation" Sep 10 04:26:10.403268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.401063 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 04:26:10.404219 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.404194 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 04:26:10.405749 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.405733 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 04:26:10.410406 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.410389 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 04:26:10.420595 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.420579 2555 log.go:25] "Validated CRI v1 runtime API" Sep 10 04:26:10.424678 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.424664 2555 log.go:25] "Validated CRI v1 image API" Sep 10 04:26:10.425556 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.425544 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 04:26:10.431438 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.431415 2555 fs.go:135] Filesystem UUIDs: map[53e45ba3-f6ff-430d-becf-41b1fc2daa98:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cd25edf9-5c68-4807-968d-67ca47e834f5:/dev/nvme0n1p4] Sep 10 04:26:10.431529 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.431438 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 04:26:10.435111 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.435096 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 04:26:10.436515 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.436408 2555 manager.go:216] Machine: {Timestamp:2026-09-10 04:26:10.434979695 +0000 UTC m=+0.371891159 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103333 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ce23f685af80984a0862fc5b27bb4 SystemUUID:ec2ce23f-685a-f809-84a0-862fc5b27bb4 BootID:ad0f61a1-8625-4541-a5e8-51a1c16a4603 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:04:4c:6a:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:04:4c:6a:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:6d:bd:a3:01:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 04:26:10.436515 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.436514 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 04:26:10.436619 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.436583 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 04:26:10.439967 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.439947 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 04:26:10.440095 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.439970 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 04:26:10.441461 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.441451 2555 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 04:26:10.441493 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.441464 2555 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 04:26:10.441493 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.441471 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 04:26:10.442219 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.442209 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 04:26:10.443940 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.443930 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 04:26:10.449269 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.449258 2555 state_mem.go:36] "Initialized new in-memory state store" Sep 10 04:26:10.449390 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.449381 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 04:26:10.449425 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.449411 2555 kubelet.go:486] "Attempting to sync node with API server" Sep 10 04:26:10.449456 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.449425 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 04:26:10.449456 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.449443 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 04:26:10.449509 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.449456 2555 kubelet.go:398] "Adding apiserver pod source" Sep 10 04:26:10.449509 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.449469 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 04:26:10.449840 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.449829 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 04:26:10.449873 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.449851 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 04:26:10.453134 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.453104 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 04:26:10.454806 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.454788 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b6nm5" Sep 10 04:26:10.456261 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.456246 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 04:26:10.456327 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.456276 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 04:26:10.457286 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457274 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 04:26:10.457327 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457292 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 04:26:10.457327 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457298 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 04:26:10.457327 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457304 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 04:26:10.457327 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457312 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 04:26:10.457327 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457317 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 04:26:10.457462 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457330 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 04:26:10.457462 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457335 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 04:26:10.457462 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457346 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 04:26:10.457462 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457351 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 04:26:10.457462 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457360 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 04:26:10.457462 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.457364 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 04:26:10.458226 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.458217 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 04:26:10.458226 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.458226 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 04:26:10.460479 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.460460 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 04:26:10.461207 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.461186 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 04:26:10.461257 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.461190 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 04:26:10.461968 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.461945 2555 server.go:1268] "Started kubelet" Sep 10 04:26:10.462050 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.461995 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 04:26:10.462095 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.462022 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 04:26:10.462095 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.462087 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 04:26:10.462827 ip-10-0-140-38 systemd[1]: Started Kubernetes Kubelet. Sep 10 04:26:10.463604 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.463586 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 04:26:10.463737 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.463721 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b6nm5" Sep 10 04:26:10.464375 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.464358 2555 server.go:310] "Adding debug handlers to kubelet server" Sep 10 04:26:10.469398 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.469371 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 04:26:10.470123 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.470108 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 04:26:10.470758 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.470737 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 04:26:10.471050 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.471031 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:10.471607 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.471594 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 04:26:10.471725 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.471596 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 04:26:10.471725 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.471724 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 04:26:10.471864 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.470593 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-38.ec2.internal.18d3db176173aa3c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-38.ec2.internal,UID:ip-10-0-140-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-38.ec2.internal,},FirstTimestamp:2026-09-10 04:26:10.461919804 +0000 UTC m=+0.398831268,LastTimestamp:2026-09-10 04:26:10.461919804 +0000 UTC m=+0.398831268,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-38.ec2.internal,}" Sep 10 04:26:10.471864 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.471607 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 04:26:10.471864 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.471781 2555 factory.go:55] Registering systemd factory Sep 10 04:26:10.471864 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.471837 2555 factory.go:223] Registration of the systemd container factory successfully Sep 10 04:26:10.471864 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.471864 2555 reconstruct.go:97] "Volume reconstruction finished" Sep 10 04:26:10.472064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.471874 2555 reconciler.go:29] "Reconciler: start to sync state" Sep 10 04:26:10.472094 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.472081 2555 factory.go:153] Registering CRI-O factory Sep 10 04:26:10.472094 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.472091 2555 factory.go:223] Registration of the crio container factory successfully Sep 10 04:26:10.472149 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.472104 2555 factory.go:103] Registering Raw factory Sep 10 04:26:10.472149 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.472114 2555 manager.go:1196] Started watching for new ooms in manager Sep 10 04:26:10.472429 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.472413 2555 manager.go:349] Starting recovery of all containers Sep 10 04:26:10.479674 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.479648 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:10.483403 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.483384 2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-38.ec2.internal\" not found" node="ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.485176 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.485144 2555 manager.go:354] Recovery completed Sep 10 04:26:10.489710 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.489698 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:10.491518 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.491502 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:10.491588 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.491529 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:10.491588 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.491539 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:10.492142 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.492128 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 04:26:10.492142 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.492137 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:10.492265 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.492139 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 04:26:10.492265 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.492212 2555 state_mem.go:36] "Initialized new in-memory state store" Sep 10 04:26:10.492855 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.492841 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:10.492902 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.492866 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:10.492902 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.492875 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:10.494197 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.494186 2555 policy_none.go:49] "None policy: Start" Sep 10 04:26:10.494234 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.494201 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 04:26:10.494234 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.494210 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 04:26:10.496071 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.496057 2555 policy_none.go:47] "Start" Sep 10 04:26:10.534769 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.534755 2555 manager.go:337] "Starting Device Plugin manager" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.534805 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.534817 2555 server.go:87] "Starting device plugin registration server" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.535118 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.535130 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.535232 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.535326 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.535336 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.536081 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.536128 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.540579 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.541793 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.541845 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.541866 2555 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.541912 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 04:26:10.551832 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.543811 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:10.635959 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.635907 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:10.636679 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.636664 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:10.636795 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.636696 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:10.636795 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.636717 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:10.636795 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.636737 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.642844 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.642816 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal"] Sep 10 04:26:10.642909 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.642891 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:10.643587 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.643572 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:10.643661 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.643600 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:10.643661 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.643613 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:10.644605 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.644592 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.644644 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.644612 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-38.ec2.internal\": node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:10.645919 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.645906 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:10.646065 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.646053 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.646105 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.646078 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:10.646738 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.646723 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:10.646818 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.646726 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:10.646818 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.646776 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:10.646818 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.646794 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:10.646818 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.646748 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:10.646993 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.646840 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:10.649021 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.649006 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.649099 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.649030 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:10.649620 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.649604 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:10.649679 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.649628 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:10.649679 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.649639 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:10.658834 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.658818 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:10.673362 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.673334 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8b25766694d6185c4f169c02becf28c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"a8b25766694d6185c4f169c02becf28c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.673362 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.673363 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8b25766694d6185c4f169c02becf28c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"a8b25766694d6185c4f169c02becf28c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.673481 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.673377 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9fdb93b4f2f56237d3ad52cebf5c1335-config\") pod \"kube-apiserver-proxy-ip-10-0-140-38.ec2.internal\" (UID: \"9fdb93b4f2f56237d3ad52cebf5c1335\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.679692 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.679675 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-38.ec2.internal\" not found" node="ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.683835 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.683819 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-38.ec2.internal\" not found" node="ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.759847 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.759825 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:10.773841 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.773811 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8b25766694d6185c4f169c02becf28c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"a8b25766694d6185c4f169c02becf28c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.773841 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.773845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9fdb93b4f2f56237d3ad52cebf5c1335-config\") pod \"kube-apiserver-proxy-ip-10-0-140-38.ec2.internal\" (UID: \"9fdb93b4f2f56237d3ad52cebf5c1335\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.773948 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.773864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8b25766694d6185c4f169c02becf28c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"a8b25766694d6185c4f169c02becf28c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.773948 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.773901 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9fdb93b4f2f56237d3ad52cebf5c1335-config\") pod \"kube-apiserver-proxy-ip-10-0-140-38.ec2.internal\" (UID: \"9fdb93b4f2f56237d3ad52cebf5c1335\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.773948 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.773901 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8b25766694d6185c4f169c02becf28c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"a8b25766694d6185c4f169c02becf28c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.773948 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.773921 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8b25766694d6185c4f169c02becf28c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"a8b25766694d6185c4f169c02becf28c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.860140 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.860120 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:10.960912 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:10.960857 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:10.983281 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.983260 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Sep 10 04:26:10.987432 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:10.987416 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Sep 10 04:26:11.061702 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:11.061682 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:11.162130 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:11.162114 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:11.262717 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:11.262650 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:11.363237 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:11.363214 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:11.400734 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.400716 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 04:26:11.401078 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.400844 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 04:26:11.401078 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.400873 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 04:26:11.464188 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:11.464151 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:11.472270 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.472223 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 04:21:10 +0000 UTC" deadline="2028-03-03 06:04:14.084947242 +0000 UTC" Sep 10 04:26:11.472270 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.472269 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12961h38m2.612682696s" Sep 10 04:26:11.561439 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:11.561205 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b25766694d6185c4f169c02becf28c.slice/crio-bd719e267d8d823c6fc05daeb7d29f7660c2733c8fd10b4ad0f68f71d3ab11aa WatchSource:0}: Error finding container bd719e267d8d823c6fc05daeb7d29f7660c2733c8fd10b4ad0f68f71d3ab11aa: Status 404 returned error can't find the container with id bd719e267d8d823c6fc05daeb7d29f7660c2733c8fd10b4ad0f68f71d3ab11aa Sep 10 04:26:11.564293 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:11.564269 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:11.565661 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.565641 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 04:26:11.569175 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:11.569130 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fdb93b4f2f56237d3ad52cebf5c1335.slice/crio-a3ec7bae7086f7ec25a4f4b42af042453c025a2c67a92b758c92ca1498e0727d WatchSource:0}: Error finding container a3ec7bae7086f7ec25a4f4b42af042453c025a2c67a92b758c92ca1498e0727d: Status 404 returned error can't find the container with id a3ec7bae7086f7ec25a4f4b42af042453c025a2c67a92b758c92ca1498e0727d Sep 10 04:26:11.608475 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.608452 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:11.667030 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:11.667002 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:11.773644 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:11.773622 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:11.873839 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:11.873777 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Sep 10 04:26:11.946796 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.946777 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:11.971977 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.971956 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Sep 10 04:26:11.983723 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.983701 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 04:26:11.985010 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.984993 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Sep 10 04:26:11.994749 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:11.994726 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 04:26:12.450524 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.450492 2555 apiserver.go:52] "Watching apiserver" Sep 10 04:26:12.461082 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.461055 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 04:26:12.461676 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.461646 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-pmsfj","openshift-network-operator/iptables-alerter-vkttb","openshift-ovn-kubernetes/ovnkube-node-jcvsz","kube-system/konnectivity-agent-rdj8n","kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd","openshift-cluster-node-tuning-operator/tuned-f59xr","openshift-dns/node-resolver-t5kv8","openshift-image-registry/node-ca-t8k86","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal","openshift-multus/network-metrics-daemon-clrgs","kube-system/global-pull-secret-syncer-66jvb","openshift-multus/multus-7cbwj","openshift-multus/multus-additional-cni-plugins-6hxp2"] Sep 10 04:26:12.464539 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.464512 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.467154 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.467047 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:12.467328 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.467157 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:12.467728 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.467706 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:26:12.467927 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.467910 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 04:26:12.468130 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.468110 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jc52b\"" Sep 10 04:26:12.470018 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.469837 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.471349 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.471326 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 04:26:12.472637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.472328 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:12.472970 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.472951 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 04:26:12.474593 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.474568 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 04:26:12.474825 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.474809 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 04:26:12.475075 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.475056 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 04:26:12.475311 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.475294 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kwnp5\"" Sep 10 04:26:12.475398 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.475375 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 04:26:12.475469 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.475413 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 04:26:12.475537 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.475517 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 04:26:12.475968 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.475554 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cr4dg\"" Sep 10 04:26:12.476055 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.475668 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 04:26:12.476169 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.475744 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.478765 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.478336 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.478984 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.478965 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 04:26:12.479611 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.479281 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 04:26:12.479611 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.479394 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 04:26:12.479611 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.479286 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pgljq\"" Sep 10 04:26:12.479611 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.479524 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 04:26:12.479853 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.479625 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 04:26:12.480943 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.480914 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 04:26:12.481265 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.481245 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.481877 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.481844 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kh7zf\"" Sep 10 04:26:12.481971 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.481919 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 04:26:12.482075 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.482056 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 04:26:12.483246 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483224 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-cni-netd\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.483344 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483262 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.483344 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-host\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.483474 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-node-log\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.483474 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27klz\" (UniqueName: \"kubernetes.io/projected/a6423083-a77c-492f-b9eb-0cfb8da61729-kube-api-access-27klz\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.483474 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483405 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b86f871b-a02c-4026-a329-957bcce55301-agent-certs\") pod \"konnectivity-agent-rdj8n\" (UID: \"b86f871b-a02c-4026-a329-957bcce55301\") " pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:12.483474 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483460 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b86f871b-a02c-4026-a329-957bcce55301-konnectivity-ca\") pod \"konnectivity-agent-rdj8n\" (UID: \"b86f871b-a02c-4026-a329-957bcce55301\") " pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:12.483663 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-kubernetes\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.483663 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483583 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-sys\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.483663 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:12.483663 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483633 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-systemd-units\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.483663 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483657 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-run-ovn\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.483810 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483682 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6423083-a77c-492f-b9eb-0cfb8da61729-env-overrides\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.483810 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483708 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-modprobe-d\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.483810 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-run\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.483810 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483752 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6626249e-c36b-4d75-8756-59cb8b8a5198-tmp\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.483810 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483780 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-sysctl-d\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.483810 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483802 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-var-lib-kubelet\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.483986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483824 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-tuned\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.483986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483827 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.483986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483850 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-log-socket\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.483986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483879 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6423083-a77c-492f-b9eb-0cfb8da61729-ovnkube-script-lib\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.483986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483896 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-systemd\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.483986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483915 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9kdg\" (UniqueName: \"kubernetes.io/projected/a348378a-58b7-43b0-9e14-76c8a8ba1679-kube-api-access-k9kdg\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:12.483986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483936 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-kubelet\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.483986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483979 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-run-netns\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.484353 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.483994 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-var-lib-openvswitch\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.484353 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-run-openvswitch\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.484353 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484025 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6423083-a77c-492f-b9eb-0cfb8da61729-ovnkube-config\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.484353 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484074 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-sysconfig\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.484353 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484113 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 04:26:12.484353 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484101 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-sysctl-conf\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.484353 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484264 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-lib-modules\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.484353 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtnt\" (UniqueName: \"kubernetes.io/projected/6626249e-c36b-4d75-8756-59cb8b8a5198-kube-api-access-tbtnt\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.484353 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484345 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-slash\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.484800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484361 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 04:26:12.484800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484369 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 04:26:12.484800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484380 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-etc-openvswitch\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.484800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484406 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-run-ovn-kubernetes\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.484800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484429 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-cni-bin\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.484800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484453 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-run-systemd\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.484800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484478 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6423083-a77c-492f-b9eb-0cfb8da61729-ovn-node-metrics-cert\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.484800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.484625 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pvnt7\"" Sep 10 04:26:12.486258 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.486121 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.488450 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.488102 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 04:26:12.488450 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.488278 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7l8xk\"" Sep 10 04:26:12.490126 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.490109 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:26:12.491222 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.490539 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gr6mf\"" Sep 10 04:26:12.491222 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.490180 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 04:26:12.491222 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.491034 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 04:26:12.491222 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.491069 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 04:26:12.491524 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.491263 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:12.494447 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.494097 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 04:26:12.494447 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.494105 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-57klp\"" Sep 10 04:26:12.494617 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.494486 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:12.494617 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.494572 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:12.495052 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.495034 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 04:26:12.496973 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.496950 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:12.497111 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.497021 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:12.507899 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.507871 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h5kgz" Sep 10 04:26:12.523183 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.523139 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h5kgz" Sep 10 04:26:12.547827 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.547776 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" event={"ID":"a8b25766694d6185c4f169c02becf28c","Type":"ContainerStarted","Data":"bd719e267d8d823c6fc05daeb7d29f7660c2733c8fd10b4ad0f68f71d3ab11aa"} Sep 10 04:26:12.549453 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.549433 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" event={"ID":"9fdb93b4f2f56237d3ad52cebf5c1335","Type":"ContainerStarted","Data":"a3ec7bae7086f7ec25a4f4b42af042453c025a2c67a92b758c92ca1498e0727d"} Sep 10 04:26:12.573316 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.573292 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 04:26:12.585369 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585347 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-sysctl-d\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.585470 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585380 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-tuned\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.585470 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585406 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-log-socket\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.585560 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585537 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-sysctl-d\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.585611 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585566 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-log-socket\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.585648 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585618 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-system-cni-dir\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.585693 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-run-netns\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.585730 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585692 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-run-netns\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.585730 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585713 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6423083-a77c-492f-b9eb-0cfb8da61729-ovnkube-config\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.585842 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585473ab-86f2-4972-9108-19b67edd1a06-cni-binary-copy\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.585842 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585755 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l29t8\" (UniqueName: \"kubernetes.io/projected/59056bf7-c39f-4b7a-add4-14b7cce7eaf4-kube-api-access-l29t8\") pod \"node-resolver-t5kv8\" (UID: \"59056bf7-c39f-4b7a-add4-14b7cce7eaf4\") " pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:12.585842 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585771 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-run-netns\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.585842 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585790 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-sysctl-conf\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.585842 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585815 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtnt\" (UniqueName: \"kubernetes.io/projected/6626249e-c36b-4d75-8756-59cb8b8a5198-kube-api-access-tbtnt\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.585842 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-cni-bin\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585858 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585879 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-run-systemd\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6423083-a77c-492f-b9eb-0cfb8da61729-ovn-node-metrics-cert\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585954 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-sysctl-conf\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585953 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-sys-fs\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.585999 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b63665a1-098c-4ed3-bbbf-216f1ea2bb8f-host\") pod \"node-ca-t8k86\" (UID: \"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f\") " pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586025 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b63665a1-098c-4ed3-bbbf-216f1ea2bb8f-serviceca\") pod \"node-ca-t8k86\" (UID: \"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f\") " pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586038 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-cni-bin\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-var-lib-cni-bin\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586073 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-var-lib-kubelet\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586078 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586098 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-run-systemd\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586153 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586098 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/59056bf7-c39f-4b7a-add4-14b7cce7eaf4-hosts-file\") pod \"node-resolver-t5kv8\" (UID: \"59056bf7-c39f-4b7a-add4-14b7cce7eaf4\") " pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586258 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-registration-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586292 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27klz\" (UniqueName: \"kubernetes.io/projected/a6423083-a77c-492f-b9eb-0cfb8da61729-kube-api-access-27klz\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586314 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b86f871b-a02c-4026-a329-957bcce55301-agent-certs\") pod \"konnectivity-agent-rdj8n\" (UID: \"b86f871b-a02c-4026-a329-957bcce55301\") " pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586363 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-multus-socket-dir-parent\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586390 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-sys\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586405 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6423083-a77c-492f-b9eb-0cfb8da61729-ovnkube-config\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586414 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-systemd-units\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586451 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-systemd-units\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586479 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-run-ovn\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586505 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x67ns\" (UniqueName: \"kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns\") pod \"network-check-target-pmsfj\" (UID: \"62deddbb-4d33-4337-a967-a45e6508cada\") " pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586554 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/39729577-e75a-4943-949c-647afac710e5-kubelet-config\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586579 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/39729577-e75a-4943-949c-647afac710e5-dbus\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586599 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-sys\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586605 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60afc3da-8b47-4964-9997-ff5167095ed0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586644 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-run-ovn\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-device-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.586906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-modprobe-d\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586766 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-run\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586787 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6626249e-c36b-4d75-8756-59cb8b8a5198-tmp\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586808 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65cfa46a-e5ea-4f75-b458-32c5dcaf43dc-iptables-alerter-script\") pod \"iptables-alerter-vkttb\" (UID: \"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc\") " pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586833 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2mww\" (UniqueName: \"kubernetes.io/projected/226eea5f-c503-4768-8d16-38c12ae30781-kube-api-access-c2mww\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586851 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-modprobe-d\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59056bf7-c39f-4b7a-add4-14b7cce7eaf4-tmp-dir\") pod \"node-resolver-t5kv8\" (UID: \"59056bf7-c39f-4b7a-add4-14b7cce7eaf4\") " pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586885 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-run\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586892 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-var-lib-kubelet\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586943 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-var-lib-kubelet\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.586989 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6423083-a77c-492f-b9eb-0cfb8da61729-ovnkube-script-lib\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587023 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr6s5\" (UniqueName: \"kubernetes.io/projected/60afc3da-8b47-4964-9997-ff5167095ed0-kube-api-access-fr6s5\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-multus-cni-dir\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587074 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7rlr\" (UniqueName: \"kubernetes.io/projected/585473ab-86f2-4972-9108-19b67edd1a06-kube-api-access-z7rlr\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587100 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-systemd\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587125 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9kdg\" (UniqueName: \"kubernetes.io/projected/a348378a-58b7-43b0-9e14-76c8a8ba1679-kube-api-access-k9kdg\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-kubelet\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.587637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587170 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-var-lib-openvswitch\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587210 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-run-openvswitch\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587233 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtbp9\" (UniqueName: \"kubernetes.io/projected/65cfa46a-e5ea-4f75-b458-32c5dcaf43dc-kube-api-access-vtbp9\") pod \"iptables-alerter-vkttb\" (UID: \"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc\") " pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587267 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60afc3da-8b47-4964-9997-ff5167095ed0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587288 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68qzv\" (UniqueName: \"kubernetes.io/projected/b63665a1-098c-4ed3-bbbf-216f1ea2bb8f-kube-api-access-68qzv\") pod \"node-ca-t8k86\" (UID: \"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f\") " pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587312 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-sysconfig\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587333 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-lib-modules\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587362 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-slash\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587428 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-etc-openvswitch\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587449 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-run-ovn-kubernetes\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587471 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-multus-conf-dir\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587500 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60afc3da-8b47-4964-9997-ff5167095ed0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587527 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587548 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-cni-netd\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587626 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-host\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587626 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6423083-a77c-492f-b9eb-0cfb8da61729-ovnkube-script-lib\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.588454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587648 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-node-log\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587690 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b86f871b-a02c-4026-a329-957bcce55301-konnectivity-ca\") pod \"konnectivity-agent-rdj8n\" (UID: \"b86f871b-a02c-4026-a329-957bcce55301\") " pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587710 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-sysconfig\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587711 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60afc3da-8b47-4964-9997-ff5167095ed0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587739 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-hostroot\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587759 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-etc-kubernetes\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587765 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-systemd\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587797 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-kubernetes\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587849 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587891 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6423083-a77c-492f-b9eb-0cfb8da61729-env-overrides\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.587986 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65cfa46a-e5ea-4f75-b458-32c5dcaf43dc-host-slash\") pod \"iptables-alerter-vkttb\" (UID: \"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc\") " pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588012 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60afc3da-8b47-4964-9997-ff5167095ed0-system-cni-dir\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588029 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-kubelet\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588044 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-etc-selinux\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588081 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-var-lib-openvswitch\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588165 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-node-log\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588208 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-slash\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.589340 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588214 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-lib-modules\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588266 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-etc-openvswitch\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-cnibin\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588313 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-var-lib-cni-multus\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588311 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-run-ovn-kubernetes\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588340 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60afc3da-8b47-4964-9997-ff5167095ed0-cnibin\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588382 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-socket-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588539 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-kubernetes\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588872 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6626249e-c36b-4d75-8756-59cb8b8a5198-host\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588879 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-run-openvswitch\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588988 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-run-k8s-cni-cncf-io\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.589026 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585473ab-86f2-4972-9108-19b67edd1a06-multus-daemon-config\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.589069 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-run-multus-certs\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.589144 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.589185 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-cni-netd\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.589304 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6423083-a77c-492f-b9eb-0cfb8da61729-env-overrides\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.589326 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs podName:a348378a-58b7-43b0-9e14-76c8a8ba1679 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:13.089280353 +0000 UTC m=+3.026191810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs") pod "network-metrics-daemon-clrgs" (UID: "a348378a-58b7-43b0-9e14-76c8a8ba1679") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:12.590193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.588848 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6423083-a77c-492f-b9eb-0cfb8da61729-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.591177 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.589447 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b86f871b-a02c-4026-a329-957bcce55301-konnectivity-ca\") pod \"konnectivity-agent-rdj8n\" (UID: \"b86f871b-a02c-4026-a329-957bcce55301\") " pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:12.591177 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.590942 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6626249e-c36b-4d75-8756-59cb8b8a5198-etc-tuned\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.591177 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.591035 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6423083-a77c-492f-b9eb-0cfb8da61729-ovn-node-metrics-cert\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.591322 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.591211 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6626249e-c36b-4d75-8756-59cb8b8a5198-tmp\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.591530 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.591508 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b86f871b-a02c-4026-a329-957bcce55301-agent-certs\") pod \"konnectivity-agent-rdj8n\" (UID: \"b86f871b-a02c-4026-a329-957bcce55301\") " pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:12.600211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.600187 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtnt\" (UniqueName: \"kubernetes.io/projected/6626249e-c36b-4d75-8756-59cb8b8a5198-kube-api-access-tbtnt\") pod \"tuned-f59xr\" (UID: \"6626249e-c36b-4d75-8756-59cb8b8a5198\") " pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.600454 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.600433 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9kdg\" (UniqueName: \"kubernetes.io/projected/a348378a-58b7-43b0-9e14-76c8a8ba1679-kube-api-access-k9kdg\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:12.601053 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.601033 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27klz\" (UniqueName: \"kubernetes.io/projected/a6423083-a77c-492f-b9eb-0cfb8da61729-kube-api-access-27klz\") pod \"ovnkube-node-jcvsz\" (UID: \"a6423083-a77c-492f-b9eb-0cfb8da61729\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.689896 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.689864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-sys-fs\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.690044 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.689900 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b63665a1-098c-4ed3-bbbf-216f1ea2bb8f-host\") pod \"node-ca-t8k86\" (UID: \"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f\") " pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.690044 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.689923 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b63665a1-098c-4ed3-bbbf-216f1ea2bb8f-serviceca\") pod \"node-ca-t8k86\" (UID: \"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f\") " pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.690044 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.689944 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-var-lib-cni-bin\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.690044 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.689965 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-var-lib-kubelet\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.690044 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.689988 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/59056bf7-c39f-4b7a-add4-14b7cce7eaf4-hosts-file\") pod \"node-resolver-t5kv8\" (UID: \"59056bf7-c39f-4b7a-add4-14b7cce7eaf4\") " pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:12.690044 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.689977 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b63665a1-098c-4ed3-bbbf-216f1ea2bb8f-host\") pod \"node-ca-t8k86\" (UID: \"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f\") " pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.690044 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.689983 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-sys-fs\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.690044 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690028 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-var-lib-cni-bin\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690031 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-registration-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690063 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/59056bf7-c39f-4b7a-add4-14b7cce7eaf4-hosts-file\") pod \"node-resolver-t5kv8\" (UID: \"59056bf7-c39f-4b7a-add4-14b7cce7eaf4\") " pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690073 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-var-lib-kubelet\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690099 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-multus-socket-dir-parent\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690129 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x67ns\" (UniqueName: \"kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns\") pod \"network-check-target-pmsfj\" (UID: \"62deddbb-4d33-4337-a967-a45e6508cada\") " pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/39729577-e75a-4943-949c-647afac710e5-kubelet-config\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690100 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-registration-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690171 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/39729577-e75a-4943-949c-647afac710e5-dbus\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690147 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-multus-socket-dir-parent\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690219 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/39729577-e75a-4943-949c-647afac710e5-kubelet-config\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690218 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60afc3da-8b47-4964-9997-ff5167095ed0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690259 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-device-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690287 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65cfa46a-e5ea-4f75-b458-32c5dcaf43dc-iptables-alerter-script\") pod \"iptables-alerter-vkttb\" (UID: \"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc\") " pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690301 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-device-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690314 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2mww\" (UniqueName: \"kubernetes.io/projected/226eea5f-c503-4768-8d16-38c12ae30781-kube-api-access-c2mww\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690324 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/39729577-e75a-4943-949c-647afac710e5-dbus\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:12.690501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690339 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59056bf7-c39f-4b7a-add4-14b7cce7eaf4-tmp-dir\") pod \"node-resolver-t5kv8\" (UID: \"59056bf7-c39f-4b7a-add4-14b7cce7eaf4\") " pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690367 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr6s5\" (UniqueName: \"kubernetes.io/projected/60afc3da-8b47-4964-9997-ff5167095ed0-kube-api-access-fr6s5\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690393 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-multus-cni-dir\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690421 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7rlr\" (UniqueName: \"kubernetes.io/projected/585473ab-86f2-4972-9108-19b67edd1a06-kube-api-access-z7rlr\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690448 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtbp9\" (UniqueName: \"kubernetes.io/projected/65cfa46a-e5ea-4f75-b458-32c5dcaf43dc-kube-api-access-vtbp9\") pod \"iptables-alerter-vkttb\" (UID: \"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc\") " pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690472 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60afc3da-8b47-4964-9997-ff5167095ed0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690496 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68qzv\" (UniqueName: \"kubernetes.io/projected/b63665a1-098c-4ed3-bbbf-216f1ea2bb8f-kube-api-access-68qzv\") pod \"node-ca-t8k86\" (UID: \"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f\") " pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690525 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-multus-conf-dir\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690549 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60afc3da-8b47-4964-9997-ff5167095ed0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690572 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60afc3da-8b47-4964-9997-ff5167095ed0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690621 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59056bf7-c39f-4b7a-add4-14b7cce7eaf4-tmp-dir\") pod \"node-resolver-t5kv8\" (UID: \"59056bf7-c39f-4b7a-add4-14b7cce7eaf4\") " pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690629 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-hostroot\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690669 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-multus-conf-dir\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-etc-kubernetes\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690681 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-multus-cni-dir\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690724 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65cfa46a-e5ea-4f75-b458-32c5dcaf43dc-host-slash\") pod \"iptables-alerter-vkttb\" (UID: \"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc\") " pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.691502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690750 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60afc3da-8b47-4964-9997-ff5167095ed0-system-cni-dir\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690773 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-etc-selinux\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690780 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60afc3da-8b47-4964-9997-ff5167095ed0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690797 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-cnibin\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690812 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-hostroot\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690822 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-var-lib-cni-multus\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690845 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65cfa46a-e5ea-4f75-b458-32c5dcaf43dc-iptables-alerter-script\") pod \"iptables-alerter-vkttb\" (UID: \"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc\") " pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690846 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60afc3da-8b47-4964-9997-ff5167095ed0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690888 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60afc3da-8b47-4964-9997-ff5167095ed0-system-cni-dir\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690849 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60afc3da-8b47-4964-9997-ff5167095ed0-cnibin\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690934 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65cfa46a-e5ea-4f75-b458-32c5dcaf43dc-host-slash\") pod \"iptables-alerter-vkttb\" (UID: \"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc\") " pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690947 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-socket-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690959 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-etc-selinux\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690937 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-etc-kubernetes\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690962 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690908 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60afc3da-8b47-4964-9997-ff5167095ed0-cnibin\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.690995 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-var-lib-cni-multus\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691004 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-cnibin\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691036 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-run-k8s-cni-cncf-io\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691065 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585473ab-86f2-4972-9108-19b67edd1a06-multus-daemon-config\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691070 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/226eea5f-c503-4768-8d16-38c12ae30781-socket-dir\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-run-multus-certs\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691113 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-run-k8s-cni-cncf-io\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691124 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-system-cni-dir\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691153 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-run-netns\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691154 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-run-multus-certs\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691181 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585473ab-86f2-4972-9108-19b67edd1a06-cni-binary-copy\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691208 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l29t8\" (UniqueName: \"kubernetes.io/projected/59056bf7-c39f-4b7a-add4-14b7cce7eaf4-kube-api-access-l29t8\") pod \"node-resolver-t5kv8\" (UID: \"59056bf7-c39f-4b7a-add4-14b7cce7eaf4\") " pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691219 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-host-run-netns\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691220 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585473ab-86f2-4972-9108-19b67edd1a06-system-cni-dir\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691152 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60afc3da-8b47-4964-9997-ff5167095ed0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.691401 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691437 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60afc3da-8b47-4964-9997-ff5167095ed0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.692797 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.691459 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret podName:39729577-e75a-4943-949c-647afac710e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:13.191442502 +0000 UTC m=+3.128353970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret") pod "global-pull-secret-syncer-66jvb" (UID: "39729577-e75a-4943-949c-647afac710e5") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:12.693538 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691587 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b63665a1-098c-4ed3-bbbf-216f1ea2bb8f-serviceca\") pod \"node-ca-t8k86\" (UID: \"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f\") " pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.693538 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691667 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585473ab-86f2-4972-9108-19b67edd1a06-multus-daemon-config\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.693538 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.691688 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585473ab-86f2-4972-9108-19b67edd1a06-cni-binary-copy\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.703075 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.703015 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:12.703075 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.703044 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:12.703075 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.703057 2555 projected.go:196] Error preparing data for projected volume kube-api-access-x67ns for pod openshift-network-diagnostics/network-check-target-pmsfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:12.703301 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:12.703116 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns podName:62deddbb-4d33-4337-a967-a45e6508cada nodeName:}" failed. No retries permitted until 2026-09-10 04:26:13.203098671 +0000 UTC m=+3.140010126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x67ns" (UniqueName: "kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns") pod "network-check-target-pmsfj" (UID: "62deddbb-4d33-4337-a967-a45e6508cada") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:12.704050 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.703991 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68qzv\" (UniqueName: \"kubernetes.io/projected/b63665a1-098c-4ed3-bbbf-216f1ea2bb8f-kube-api-access-68qzv\") pod \"node-ca-t8k86\" (UID: \"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f\") " pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.704136 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.704114 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr6s5\" (UniqueName: \"kubernetes.io/projected/60afc3da-8b47-4964-9997-ff5167095ed0-kube-api-access-fr6s5\") pod \"multus-additional-cni-plugins-6hxp2\" (UID: \"60afc3da-8b47-4964-9997-ff5167095ed0\") " pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.704493 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.704469 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l29t8\" (UniqueName: \"kubernetes.io/projected/59056bf7-c39f-4b7a-add4-14b7cce7eaf4-kube-api-access-l29t8\") pod \"node-resolver-t5kv8\" (UID: \"59056bf7-c39f-4b7a-add4-14b7cce7eaf4\") " pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:12.704605 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.704587 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7rlr\" (UniqueName: \"kubernetes.io/projected/585473ab-86f2-4972-9108-19b67edd1a06-kube-api-access-z7rlr\") pod \"multus-7cbwj\" (UID: \"585473ab-86f2-4972-9108-19b67edd1a06\") " pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.705805 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.705784 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2mww\" (UniqueName: \"kubernetes.io/projected/226eea5f-c503-4768-8d16-38c12ae30781-kube-api-access-c2mww\") pod \"aws-ebs-csi-driver-node-9v6sd\" (UID: \"226eea5f-c503-4768-8d16-38c12ae30781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.705890 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.705870 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtbp9\" (UniqueName: \"kubernetes.io/projected/65cfa46a-e5ea-4f75-b458-32c5dcaf43dc-kube-api-access-vtbp9\") pod \"iptables-alerter-vkttb\" (UID: \"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc\") " pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.778038 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.778009 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f59xr" Sep 10 04:26:12.791699 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.791673 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:12.802364 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.802340 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:12.807374 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.807347 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" Sep 10 04:26:12.810322 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.810306 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:12.814856 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.814839 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" Sep 10 04:26:12.823551 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.823533 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8k86" Sep 10 04:26:12.830562 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.830535 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7cbwj" Sep 10 04:26:12.839214 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.839191 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vkttb" Sep 10 04:26:12.849702 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.849683 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:12.853129 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:12.853104 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5kv8" Sep 10 04:26:13.093935 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:13.093841 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:13.094098 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:13.093981 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:13.094098 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:13.094051 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs podName:a348378a-58b7-43b0-9e14-76c8a8ba1679 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:14.09403251 +0000 UTC m=+4.030943962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs") pod "network-metrics-daemon-clrgs" (UID: "a348378a-58b7-43b0-9e14-76c8a8ba1679") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:13.194854 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:13.194824 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:13.195043 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:13.194951 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:13.195043 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:13.195006 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret podName:39729577-e75a-4943-949c-647afac710e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:14.194990154 +0000 UTC m=+4.131901607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret") pod "global-pull-secret-syncer-66jvb" (UID: "39729577-e75a-4943-949c-647afac710e5") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:13.295613 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:13.295577 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x67ns\" (UniqueName: \"kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns\") pod \"network-check-target-pmsfj\" (UID: \"62deddbb-4d33-4337-a967-a45e6508cada\") " pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:13.295784 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:13.295754 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:13.295784 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:13.295778 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:13.295893 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:13.295792 2555 projected.go:196] Error preparing data for projected volume kube-api-access-x67ns for pod openshift-network-diagnostics/network-check-target-pmsfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:13.295893 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:13.295856 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns podName:62deddbb-4d33-4337-a967-a45e6508cada nodeName:}" failed. No retries permitted until 2026-09-10 04:26:14.295835893 +0000 UTC m=+4.232747350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x67ns" (UniqueName: "kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns") pod "network-check-target-pmsfj" (UID: "62deddbb-4d33-4337-a967-a45e6508cada") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:13.526900 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:13.526824 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 04:21:12 +0000 UTC" deadline="2028-06-22 13:37:56.087677522 +0000 UTC" Sep 10 04:26:13.526900 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:13.526851 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15633h11m42.560829909s" Sep 10 04:26:13.564039 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:13.564005 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6423083_a77c_492f_b9eb_0cfb8da61729.slice/crio-4b36b83c610ca90fedb950acb681a06c00d155b1846f7c8edb4d78b8c03e14bf WatchSource:0}: Error finding container 4b36b83c610ca90fedb950acb681a06c00d155b1846f7c8edb4d78b8c03e14bf: Status 404 returned error can't find the container with id 4b36b83c610ca90fedb950acb681a06c00d155b1846f7c8edb4d78b8c03e14bf Sep 10 04:26:13.565393 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:13.565360 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6626249e_c36b_4d75_8756_59cb8b8a5198.slice/crio-721ff5daa55e1c93ac7e2a6d31b79900411a9685a3c5b5515044c71349fa9595 WatchSource:0}: Error finding container 721ff5daa55e1c93ac7e2a6d31b79900411a9685a3c5b5515044c71349fa9595: Status 404 returned error can't find the container with id 721ff5daa55e1c93ac7e2a6d31b79900411a9685a3c5b5515044c71349fa9595 Sep 10 04:26:13.570356 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:13.570263 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60afc3da_8b47_4964_9997_ff5167095ed0.slice/crio-4e92b4ee6040a6573526def6594bc1be2739dfa8a2d632a7a1f25e58db6fcc30 WatchSource:0}: Error finding container 4e92b4ee6040a6573526def6594bc1be2739dfa8a2d632a7a1f25e58db6fcc30: Status 404 returned error can't find the container with id 4e92b4ee6040a6573526def6594bc1be2739dfa8a2d632a7a1f25e58db6fcc30 Sep 10 04:26:13.570984 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:13.570962 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585473ab_86f2_4972_9108_19b67edd1a06.slice/crio-2ff6881ea4ae8a6ac5d21a3af246f3ee20b3c6ce332fa16c7323d1393cc14b03 WatchSource:0}: Error finding container 2ff6881ea4ae8a6ac5d21a3af246f3ee20b3c6ce332fa16c7323d1393cc14b03: Status 404 returned error can't find the container with id 2ff6881ea4ae8a6ac5d21a3af246f3ee20b3c6ce332fa16c7323d1393cc14b03 Sep 10 04:26:13.573111 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:13.572990 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65cfa46a_e5ea_4f75_b458_32c5dcaf43dc.slice/crio-e04bc1af79897eb4dc332bfa76fd73f659e7c7e65b1967777fd74523ace27e33 WatchSource:0}: Error finding container e04bc1af79897eb4dc332bfa76fd73f659e7c7e65b1967777fd74523ace27e33: Status 404 returned error can't find the container with id e04bc1af79897eb4dc332bfa76fd73f659e7c7e65b1967777fd74523ace27e33 Sep 10 04:26:14.104177 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.103561 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:14.104177 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.103713 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:14.104177 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.103780 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs podName:a348378a-58b7-43b0-9e14-76c8a8ba1679 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:16.103758119 +0000 UTC m=+6.040669578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs") pod "network-metrics-daemon-clrgs" (UID: "a348378a-58b7-43b0-9e14-76c8a8ba1679") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:14.204205 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.204153 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:14.204381 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.204351 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:14.204458 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.204416 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret podName:39729577-e75a-4943-949c-647afac710e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:16.204395474 +0000 UTC m=+6.141307002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret") pod "global-pull-secret-syncer-66jvb" (UID: "39729577-e75a-4943-949c-647afac710e5") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:14.309274 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.308511 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x67ns\" (UniqueName: \"kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns\") pod \"network-check-target-pmsfj\" (UID: \"62deddbb-4d33-4337-a967-a45e6508cada\") " pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:14.309274 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.308735 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:14.309274 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.308758 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:14.309274 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.308773 2555 projected.go:196] Error preparing data for projected volume kube-api-access-x67ns for pod openshift-network-diagnostics/network-check-target-pmsfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:14.309274 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.308834 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns podName:62deddbb-4d33-4337-a967-a45e6508cada nodeName:}" failed. No retries permitted until 2026-09-10 04:26:16.30881568 +0000 UTC m=+6.245727136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x67ns" (UniqueName: "kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns") pod "network-check-target-pmsfj" (UID: "62deddbb-4d33-4337-a967-a45e6508cada") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:14.527990 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.527860 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 04:21:12 +0000 UTC" deadline="2028-06-27 18:59:17.475446932 +0000 UTC" Sep 10 04:26:14.527990 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.527927 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15758h33m2.947525029s" Sep 10 04:26:14.545367 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.545339 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:14.545511 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.545365 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:14.545511 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.545489 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:14.545692 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.545660 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:14.545773 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.545740 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:14.545858 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:14.545834 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:14.562274 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.562225 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f59xr" event={"ID":"6626249e-c36b-4d75-8756-59cb8b8a5198","Type":"ContainerStarted","Data":"721ff5daa55e1c93ac7e2a6d31b79900411a9685a3c5b5515044c71349fa9595"} Sep 10 04:26:14.574278 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.573074 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" event={"ID":"9fdb93b4f2f56237d3ad52cebf5c1335","Type":"ContainerStarted","Data":"74d030a6d64dad34e16012cbcf8be442ccf22ec0fd460f28413495a4853f3a7b"} Sep 10 04:26:14.576022 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.575992 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5kv8" event={"ID":"59056bf7-c39f-4b7a-add4-14b7cce7eaf4","Type":"ContainerStarted","Data":"14eb7a7e50dad13dbb24bce78b56adc613161101beb4a0863f008cb509a697bc"} Sep 10 04:26:14.588749 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.588691 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" podStartSLOduration=2.588673781 podStartE2EDuration="2.588673781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:14.588135165 +0000 UTC m=+4.525046642" watchObservedRunningTime="2026-09-10 04:26:14.588673781 +0000 UTC m=+4.525585258" Sep 10 04:26:14.591563 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.591513 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8k86" event={"ID":"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f","Type":"ContainerStarted","Data":"9b04a4ddd1e9dacf27d0a9d88f0efe1fd0caa7cdadbc91ad14b61ed7f3c8415a"} Sep 10 04:26:14.599207 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.599162 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vkttb" event={"ID":"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc","Type":"ContainerStarted","Data":"e04bc1af79897eb4dc332bfa76fd73f659e7c7e65b1967777fd74523ace27e33"} Sep 10 04:26:14.604147 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.604073 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" event={"ID":"60afc3da-8b47-4964-9997-ff5167095ed0","Type":"ContainerStarted","Data":"4e92b4ee6040a6573526def6594bc1be2739dfa8a2d632a7a1f25e58db6fcc30"} Sep 10 04:26:14.614712 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.614681 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" event={"ID":"a6423083-a77c-492f-b9eb-0cfb8da61729","Type":"ContainerStarted","Data":"4b36b83c610ca90fedb950acb681a06c00d155b1846f7c8edb4d78b8c03e14bf"} Sep 10 04:26:14.629395 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.629366 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" event={"ID":"a8b25766694d6185c4f169c02becf28c","Type":"ContainerDied","Data":"ff65f94ca9363bc10757cbcb9f36aca090e235004e5bee2253ae11a59aeed754"} Sep 10 04:26:14.629930 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.629196 2555 generic.go:356] "Generic (PLEG): container finished" podID="a8b25766694d6185c4f169c02becf28c" containerID="ff65f94ca9363bc10757cbcb9f36aca090e235004e5bee2253ae11a59aeed754" exitCode=0 Sep 10 04:26:14.635284 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.635257 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7cbwj" event={"ID":"585473ab-86f2-4972-9108-19b67edd1a06","Type":"ContainerStarted","Data":"2ff6881ea4ae8a6ac5d21a3af246f3ee20b3c6ce332fa16c7323d1393cc14b03"} Sep 10 04:26:14.640735 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.640708 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rdj8n" event={"ID":"b86f871b-a02c-4026-a329-957bcce55301","Type":"ContainerStarted","Data":"fde4c9583b834e2791d6ef7a8fa507d613b51bce68556d350bee5ebcefc61d9f"} Sep 10 04:26:14.649609 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:14.649583 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" event={"ID":"226eea5f-c503-4768-8d16-38c12ae30781","Type":"ContainerStarted","Data":"2767515bf1b26b05cf1870e630a9723a94ccbbbcb4371dc2be588315fd6da497"} Sep 10 04:26:15.672596 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:15.672338 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" event={"ID":"a8b25766694d6185c4f169c02becf28c","Type":"ContainerStarted","Data":"128ab10d3c493a2100632e3ca18e872493475b4033ec323ea121a1e1e9c19fa7"} Sep 10 04:26:16.125639 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:16.125599 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:16.125906 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.125777 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:16.125906 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.125890 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs podName:a348378a-58b7-43b0-9e14-76c8a8ba1679 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:20.125868498 +0000 UTC m=+10.062779955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs") pod "network-metrics-daemon-clrgs" (UID: "a348378a-58b7-43b0-9e14-76c8a8ba1679") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:16.226556 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:16.226521 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:16.226734 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.226689 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:16.226814 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.226748 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret podName:39729577-e75a-4943-949c-647afac710e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:20.226730452 +0000 UTC m=+10.163641928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret") pod "global-pull-secret-syncer-66jvb" (UID: "39729577-e75a-4943-949c-647afac710e5") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:16.327933 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:16.327895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x67ns\" (UniqueName: \"kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns\") pod \"network-check-target-pmsfj\" (UID: \"62deddbb-4d33-4337-a967-a45e6508cada\") " pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:16.328138 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.328122 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:16.328207 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.328147 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:16.328207 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.328161 2555 projected.go:196] Error preparing data for projected volume kube-api-access-x67ns for pod openshift-network-diagnostics/network-check-target-pmsfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:16.328368 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.328239 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns podName:62deddbb-4d33-4337-a967-a45e6508cada nodeName:}" failed. No retries permitted until 2026-09-10 04:26:20.328202911 +0000 UTC m=+10.265114400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x67ns" (UniqueName: "kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns") pod "network-check-target-pmsfj" (UID: "62deddbb-4d33-4337-a967-a45e6508cada") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:16.548404 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:16.547329 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:16.548404 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.547475 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:16.548404 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:16.547557 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:16.548404 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.547634 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:16.548404 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:16.547691 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:16.548404 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:16.547763 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:18.542224 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:18.542190 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:18.542673 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:18.542337 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:18.542673 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:18.542536 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:18.542673 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:18.542626 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:18.542843 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:18.542675 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:18.542843 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:18.542739 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:20.160548 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:20.160514 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:20.161003 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.160680 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:20.161003 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.160740 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs podName:a348378a-58b7-43b0-9e14-76c8a8ba1679 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:28.160720969 +0000 UTC m=+18.097632437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs") pod "network-metrics-daemon-clrgs" (UID: "a348378a-58b7-43b0-9e14-76c8a8ba1679") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:20.261618 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:20.261587 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:20.261780 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.261750 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:20.261835 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.261824 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret podName:39729577-e75a-4943-949c-647afac710e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:28.261803513 +0000 UTC m=+18.198715002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret") pod "global-pull-secret-syncer-66jvb" (UID: "39729577-e75a-4943-949c-647afac710e5") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:20.362794 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:20.362758 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x67ns\" (UniqueName: \"kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns\") pod \"network-check-target-pmsfj\" (UID: \"62deddbb-4d33-4337-a967-a45e6508cada\") " pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:20.362964 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.362943 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:20.363039 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.362972 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:20.363039 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.363013 2555 projected.go:196] Error preparing data for projected volume kube-api-access-x67ns for pod openshift-network-diagnostics/network-check-target-pmsfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:20.363136 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.363084 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns podName:62deddbb-4d33-4337-a967-a45e6508cada nodeName:}" failed. No retries permitted until 2026-09-10 04:26:28.363062569 +0000 UTC m=+18.299974040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x67ns" (UniqueName: "kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns") pod "network-check-target-pmsfj" (UID: "62deddbb-4d33-4337-a967-a45e6508cada") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:20.542145 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:20.542065 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:20.542145 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:20.542115 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:20.542352 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:20.542232 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:20.542352 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.542305 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:20.542733 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.542707 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:20.542879 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:20.542753 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:22.543126 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:22.542653 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:22.543126 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:22.542789 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:22.543126 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:22.542863 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:22.543126 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:22.542993 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:22.543126 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:22.543026 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:22.543126 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:22.543097 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:24.545108 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:24.545077 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:24.545492 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:24.545119 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:24.545492 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:24.545073 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:24.545492 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:24.545214 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:24.545492 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:24.545326 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:24.545492 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:24.545393 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:26.542627 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:26.542592 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:26.542627 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:26.542611 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:26.543125 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:26.542619 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:26.543125 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:26.542702 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:26.543125 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:26.542767 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:26.543125 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:26.542852 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:28.219388 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:28.219301 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:28.219763 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.219474 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:28.219763 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.219540 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs podName:a348378a-58b7-43b0-9e14-76c8a8ba1679 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:44.219520744 +0000 UTC m=+34.156432195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs") pod "network-metrics-daemon-clrgs" (UID: "a348378a-58b7-43b0-9e14-76c8a8ba1679") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:28.320036 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:28.319998 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:28.320186 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.320136 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:28.320243 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.320213 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret podName:39729577-e75a-4943-949c-647afac710e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:44.320187534 +0000 UTC m=+34.257098993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret") pod "global-pull-secret-syncer-66jvb" (UID: "39729577-e75a-4943-949c-647afac710e5") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:28.420879 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:28.420843 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x67ns\" (UniqueName: \"kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns\") pod \"network-check-target-pmsfj\" (UID: \"62deddbb-4d33-4337-a967-a45e6508cada\") " pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:28.421028 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.420989 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:28.421028 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.421010 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:28.421028 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.421023 2555 projected.go:196] Error preparing data for projected volume kube-api-access-x67ns for pod openshift-network-diagnostics/network-check-target-pmsfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:28.421127 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.421071 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns podName:62deddbb-4d33-4337-a967-a45e6508cada nodeName:}" failed. No retries permitted until 2026-09-10 04:26:44.421055946 +0000 UTC m=+34.357967416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x67ns" (UniqueName: "kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns") pod "network-check-target-pmsfj" (UID: "62deddbb-4d33-4337-a967-a45e6508cada") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:28.558224 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:28.558198 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:28.558392 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:28.558228 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:28.558392 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.558308 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:28.558479 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.558379 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:28.558479 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:28.558423 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:28.558547 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:28.558522 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:30.543279 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:30.543249 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:30.543730 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:30.543408 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:30.543730 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:30.543421 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:30.543730 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:30.543538 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:30.543730 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:30.543595 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:30.543730 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:30.543664 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:31.708350 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.708217 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7cbwj" event={"ID":"585473ab-86f2-4972-9108-19b67edd1a06","Type":"ContainerStarted","Data":"a4f690b298410821c1c7d5402360464d73e13f59da8d0e8e9b6f1ff828798a54"} Sep 10 04:26:31.710018 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.709986 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rdj8n" event={"ID":"b86f871b-a02c-4026-a329-957bcce55301","Type":"ContainerStarted","Data":"19108771c704892870dc1a5548adc2828d3222d9c05f911cb8ac5d3c9d79f939"} Sep 10 04:26:31.711378 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.711356 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" event={"ID":"226eea5f-c503-4768-8d16-38c12ae30781","Type":"ContainerStarted","Data":"d2d98ecdccd2ce1365bc6a39d10e72aaa2564dfad30aa04f5527814c57a0f53b"} Sep 10 04:26:31.712847 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.712826 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f59xr" event={"ID":"6626249e-c36b-4d75-8756-59cb8b8a5198","Type":"ContainerStarted","Data":"6ee7abb144fa123944b213cca69ebd822fcbb1d8ecb9a3f335e7fb458cd381ef"} Sep 10 04:26:31.714556 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.714532 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5kv8" event={"ID":"59056bf7-c39f-4b7a-add4-14b7cce7eaf4","Type":"ContainerStarted","Data":"29dcde1f06391573b7454e424a2d5a4d66a68afe1f0e11fbe79b1dd36dce3ccb"} Sep 10 04:26:31.715956 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.715932 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8k86" event={"ID":"b63665a1-098c-4ed3-bbbf-216f1ea2bb8f","Type":"ContainerStarted","Data":"e0c4c6ff22a42124ae2ad064992ede1b9aa086368e9957df8edff9cbbe35538c"} Sep 10 04:26:31.717443 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.717422 2555 generic.go:356] "Generic (PLEG): container finished" podID="60afc3da-8b47-4964-9997-ff5167095ed0" containerID="1abff8298e60361d716056e2b74c62c2d8f53a1103683d1ce434a8bf4276b059" exitCode=0 Sep 10 04:26:31.717530 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.717503 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" event={"ID":"60afc3da-8b47-4964-9997-ff5167095ed0","Type":"ContainerDied","Data":"1abff8298e60361d716056e2b74c62c2d8f53a1103683d1ce434a8bf4276b059"} Sep 10 04:26:31.719632 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.719615 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:26:31.719985 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.719958 2555 generic.go:356] "Generic (PLEG): container finished" podID="a6423083-a77c-492f-b9eb-0cfb8da61729" containerID="faca6ce2373fc924a148d71b15a4fd7f56c0ab884fa14de8284bacc7c55d3eb9" exitCode=1 Sep 10 04:26:31.720079 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.719982 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" event={"ID":"a6423083-a77c-492f-b9eb-0cfb8da61729","Type":"ContainerDied","Data":"faca6ce2373fc924a148d71b15a4fd7f56c0ab884fa14de8284bacc7c55d3eb9"} Sep 10 04:26:31.720079 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.720055 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" event={"ID":"a6423083-a77c-492f-b9eb-0cfb8da61729","Type":"ContainerStarted","Data":"9fbffc65fc1f4e7d049457872a1be11dddc3f407507e76f2f941d793dc8be7a0"} Sep 10 04:26:31.725249 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.725213 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" podStartSLOduration=19.725198571 podStartE2EDuration="19.725198571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:15.695903003 +0000 UTC m=+5.632814482" watchObservedRunningTime="2026-09-10 04:26:31.725198571 +0000 UTC m=+21.662110045" Sep 10 04:26:31.725374 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.725356 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7cbwj" podStartSLOduration=2.689730888 podStartE2EDuration="20.725351751s" totalImagesPullingTime="18.035620863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:31.725064478 +0000 UTC m=+21.661975954" watchObservedRunningTime="2026-09-10 04:26:31.725351751 +0000 UTC m=+21.662263223" Sep 10 04:26:31.738729 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.738667 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t8k86" podStartSLOduration=2.9602209 podStartE2EDuration="20.738654796s" totalImagesPullingTime="17.778433896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:31.738638097 +0000 UTC m=+21.675549571" watchObservedRunningTime="2026-09-10 04:26:31.738654796 +0000 UTC m=+21.675566269" Sep 10 04:26:31.754916 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.754875 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f59xr" podStartSLOduration=2.964007328 podStartE2EDuration="20.754861924s" totalImagesPullingTime="17.790854596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:31.754744903 +0000 UTC m=+21.691656377" watchObservedRunningTime="2026-09-10 04:26:31.754861924 +0000 UTC m=+21.691773388" Sep 10 04:26:31.791878 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.791823 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rdj8n" podStartSLOduration=6.523288852 podStartE2EDuration="20.791807025s" totalImagesPullingTime="14.268518173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:31.770820719 +0000 UTC m=+21.707732193" watchObservedRunningTime="2026-09-10 04:26:31.791807025 +0000 UTC m=+21.728718499" Sep 10 04:26:31.812707 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:31.812665 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t5kv8" podStartSLOduration=3.043263739 podStartE2EDuration="20.812650222s" totalImagesPullingTime="17.769386483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:31.812378182 +0000 UTC m=+21.749289655" watchObservedRunningTime="2026-09-10 04:26:31.812650222 +0000 UTC m=+21.749561695" Sep 10 04:26:32.542877 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.542710 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:32.543063 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.542775 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:32.543119 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:32.543057 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:32.543119 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.542836 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:32.543221 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:32.542941 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:32.543221 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:32.543183 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:32.723391 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.723336 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vkttb" event={"ID":"65cfa46a-e5ea-4f75-b458-32c5dcaf43dc","Type":"ContainerStarted","Data":"f1f279bdea8758890773ad563e4dab8e182f87b4f91654a342a6c916cd9eb43b"} Sep 10 04:26:32.725982 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.725966 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:26:32.726392 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.726371 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" event={"ID":"a6423083-a77c-492f-b9eb-0cfb8da61729","Type":"ContainerStarted","Data":"f705e222c47bb68f8e44da4d33dce826afae15c7ab73cc60b424bc152cfdc21f"} Sep 10 04:26:32.726453 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.726435 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" event={"ID":"a6423083-a77c-492f-b9eb-0cfb8da61729","Type":"ContainerStarted","Data":"39b640d78c018e53f4518fb714166863f0e4010045c594215628ef8d70cd8663"} Sep 10 04:26:32.726488 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.726474 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" event={"ID":"a6423083-a77c-492f-b9eb-0cfb8da61729","Type":"ContainerStarted","Data":"02f951408ba32943baf7b21213780ca5dcfe226cfba5ff24a7f49aca288880b1"} Sep 10 04:26:32.726520 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.726503 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" event={"ID":"a6423083-a77c-492f-b9eb-0cfb8da61729","Type":"ContainerStarted","Data":"6fe91fcf6b9fcbe5a1b95f7e687c4bca371020ccdf69a489e0056a40e12f703f"} Sep 10 04:26:32.737714 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.737679 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vkttb" podStartSLOduration=3.978145086 podStartE2EDuration="21.737668042s" totalImagesPullingTime="17.759522956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:32.737132939 +0000 UTC m=+22.674044412" watchObservedRunningTime="2026-09-10 04:26:32.737668042 +0000 UTC m=+22.674579515" Sep 10 04:26:32.881423 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:32.881381 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 04:26:33.550215 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:33.550099 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T04:26:32.881408585Z","UUID":"0e85bdfb-100d-474b-bc0b-76e99862a011","Handler":null,"Name":"","Endpoint":""} Sep 10 04:26:33.551605 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:33.551585 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 04:26:33.551718 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:33.551616 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 04:26:33.730635 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:33.730600 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" event={"ID":"226eea5f-c503-4768-8d16-38c12ae30781","Type":"ContainerStarted","Data":"9f734ee82cd4be14a1c83ce14a14c08deab794ac835b8bceee44b73725c94685"} Sep 10 04:26:34.542234 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:34.542206 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:34.542234 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:34.542217 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:34.542234 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:34.542226 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:34.542535 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:34.542342 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:34.542535 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:34.542429 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:34.542616 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:34.542533 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:34.736174 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:34.736130 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:26:34.736598 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:34.736544 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" event={"ID":"a6423083-a77c-492f-b9eb-0cfb8da61729","Type":"ContainerStarted","Data":"b478a40f0b0564f2185131b08a8e3972b5dc1b6f636bacee066b11573a9009e9"} Sep 10 04:26:34.738426 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:34.738403 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" event={"ID":"226eea5f-c503-4768-8d16-38c12ae30781","Type":"ContainerStarted","Data":"11cee8b12c76029488adb0d0cef6ab5ca41333585aac515fb11a1f6044fe17d9"} Sep 10 04:26:34.754819 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:34.754776 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v6sd" podStartSLOduration=3.7097253329999997 podStartE2EDuration="23.754763051s" totalImagesPullingTime="20.045037718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:34.754225931 +0000 UTC m=+24.691137403" watchObservedRunningTime="2026-09-10 04:26:34.754763051 +0000 UTC m=+24.691674524" Sep 10 04:26:36.073028 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:36.072996 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:36.073611 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:36.073593 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:36.542807 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:36.542562 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:36.542961 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:36.542562 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:36.542961 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:36.542864 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:36.542961 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:36.542638 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:36.542961 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:36.542924 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:36.543180 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:36.543058 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:36.743702 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:36.743671 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:36.744235 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:36.744210 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rdj8n" Sep 10 04:26:37.747254 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:37.747153 2555 generic.go:356] "Generic (PLEG): container finished" podID="60afc3da-8b47-4964-9997-ff5167095ed0" containerID="8725d00ab0c8952f16e94cf22f83e2f9bb6a6c1bb0d6610c1edea1b5b1be2348" exitCode=0 Sep 10 04:26:37.747254 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:37.747193 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" event={"ID":"60afc3da-8b47-4964-9997-ff5167095ed0","Type":"ContainerDied","Data":"8725d00ab0c8952f16e94cf22f83e2f9bb6a6c1bb0d6610c1edea1b5b1be2348"} Sep 10 04:26:37.750789 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:37.750773 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:26:37.751118 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:37.751100 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" event={"ID":"a6423083-a77c-492f-b9eb-0cfb8da61729","Type":"ContainerStarted","Data":"27b73d5c8f047e0bb3cb2ce50413094e01c8d8fffda0a1710313d8f960fcde37"} Sep 10 04:26:37.751377 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:37.751354 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:37.751477 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:37.751424 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:37.751477 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:37.751475 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:37.751593 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:37.751488 2555 scope.go:117] "RemoveContainer" containerID="faca6ce2373fc924a148d71b15a4fd7f56c0ab884fa14de8284bacc7c55d3eb9" Sep 10 04:26:37.770523 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:37.770498 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:37.770615 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:37.770604 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:26:38.546182 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:38.545102 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:38.546182 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:38.545471 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:38.546182 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:38.545857 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:38.546182 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:38.545946 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:38.546182 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:38.546000 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:38.546182 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:38.546074 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:38.757854 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:38.757686 2555 generic.go:356] "Generic (PLEG): container finished" podID="60afc3da-8b47-4964-9997-ff5167095ed0" containerID="cc9c6894cacc4247a82d0e0430f88035974f0c63e89af48304294295752ff09b" exitCode=0 Sep 10 04:26:38.757854 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:38.757780 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" event={"ID":"60afc3da-8b47-4964-9997-ff5167095ed0","Type":"ContainerDied","Data":"cc9c6894cacc4247a82d0e0430f88035974f0c63e89af48304294295752ff09b"} Sep 10 04:26:38.762696 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:38.762675 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:26:38.763136 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:38.763090 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" event={"ID":"a6423083-a77c-492f-b9eb-0cfb8da61729","Type":"ContainerStarted","Data":"23af1fec5a08e0e500ad842f173dc3d66e1bce19fa504b4b2272cfe194c06b50"} Sep 10 04:26:38.811439 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:38.811393 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" podStartSLOduration=9.980514702 podStartE2EDuration="27.811377929s" totalImagesPullingTime="17.830863227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:38.811118346 +0000 UTC m=+28.748029818" watchObservedRunningTime="2026-09-10 04:26:38.811377929 +0000 UTC m=+28.748289401" Sep 10 04:26:39.245941 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:39.245647 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-66jvb"] Sep 10 04:26:39.245941 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:39.245825 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:39.246241 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:39.245955 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:39.246487 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:39.246464 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pmsfj"] Sep 10 04:26:39.246619 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:39.246542 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:39.246682 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:39.246633 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:39.247199 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:39.247175 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-clrgs"] Sep 10 04:26:39.247288 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:39.247275 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:39.247401 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:39.247380 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:40.543335 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:40.543263 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:40.543723 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:40.543413 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:40.543723 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:40.543457 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:40.543723 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:40.543529 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:40.769292 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:40.769261 2555 generic.go:356] "Generic (PLEG): container finished" podID="60afc3da-8b47-4964-9997-ff5167095ed0" containerID="2ffda0c7708b2fdf23861df5935786572c27f3ec126cf168e3c4bdac379ff342" exitCode=0 Sep 10 04:26:40.769417 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:40.769317 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" event={"ID":"60afc3da-8b47-4964-9997-ff5167095ed0","Type":"ContainerDied","Data":"2ffda0c7708b2fdf23861df5935786572c27f3ec126cf168e3c4bdac379ff342"} Sep 10 04:26:41.542497 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:41.542465 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:41.542654 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:41.542614 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:42.543109 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:42.543076 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:42.543525 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:42.543211 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:42.543525 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:42.543249 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:42.543525 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:42.543356 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:43.542356 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:43.542323 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:43.542537 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:43.542447 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-clrgs" podUID="a348378a-58b7-43b0-9e14-76c8a8ba1679" Sep 10 04:26:44.238407 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:44.238371 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:44.238931 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:44.238496 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:44.238931 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:44.238797 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs podName:a348378a-58b7-43b0-9e14-76c8a8ba1679 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:16.238546287 +0000 UTC m=+66.175457759 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs") pod "network-metrics-daemon-clrgs" (UID: "a348378a-58b7-43b0-9e14-76c8a8ba1679") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:44.338831 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:44.338790 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:44.339007 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:44.338929 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:44.339007 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:44.338999 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret podName:39729577-e75a-4943-949c-647afac710e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:16.338980821 +0000 UTC m=+66.275892277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret") pod "global-pull-secret-syncer-66jvb" (UID: "39729577-e75a-4943-949c-647afac710e5") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:44.440006 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:44.439969 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x67ns\" (UniqueName: \"kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns\") pod \"network-check-target-pmsfj\" (UID: \"62deddbb-4d33-4337-a967-a45e6508cada\") " pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:44.440189 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:44.440099 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:44.440189 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:44.440121 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:44.440189 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:44.440134 2555 projected.go:196] Error preparing data for projected volume kube-api-access-x67ns for pod openshift-network-diagnostics/network-check-target-pmsfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:44.440337 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:44.440201 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns podName:62deddbb-4d33-4337-a967-a45e6508cada nodeName:}" failed. No retries permitted until 2026-09-10 04:27:16.44018716 +0000 UTC m=+66.377098611 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x67ns" (UniqueName: "kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns") pod "network-check-target-pmsfj" (UID: "62deddbb-4d33-4337-a967-a45e6508cada") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:44.542827 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:44.542746 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:44.542978 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:44.542868 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmsfj" podUID="62deddbb-4d33-4337-a967-a45e6508cada" Sep 10 04:26:44.542978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:44.542923 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:44.543092 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:44.543037 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66jvb" podUID="39729577-e75a-4943-949c-647afac710e5" Sep 10 04:26:45.404289 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.404264 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeReady" Sep 10 04:26:45.404690 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.404382 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 04:26:45.445218 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.445192 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bb67w"] Sep 10 04:26:45.469455 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.469421 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-74gkc"] Sep 10 04:26:45.469577 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.469535 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.472594 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.472574 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 04:26:45.472765 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.472749 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w9vrw\"" Sep 10 04:26:45.472884 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.472863 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 04:26:45.493549 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.493516 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bb67w"] Sep 10 04:26:45.493549 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.493549 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-74gkc"] Sep 10 04:26:45.493735 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.493638 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-74gkc" Sep 10 04:26:45.496463 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.496444 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 04:26:45.496578 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.496464 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 04:26:45.496578 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.496484 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-228jb\"" Sep 10 04:26:45.496670 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.496616 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 04:26:45.543299 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.543106 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:26:45.546187 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.546156 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 04:26:45.546299 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.546228 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lmcvv\"" Sep 10 04:26:45.649550 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.649521 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk7w4\" (UniqueName: \"kubernetes.io/projected/dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9-kube-api-access-pk7w4\") pod \"ingress-canary-74gkc\" (UID: \"dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9\") " pod="openshift-ingress-canary/ingress-canary-74gkc" Sep 10 04:26:45.649646 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.649554 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5862c6-e214-40b4-ae41-d1a29f99f550-config-volume\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.649689 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.649638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9-cert\") pod \"ingress-canary-74gkc\" (UID: \"dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9\") " pod="openshift-ingress-canary/ingress-canary-74gkc" Sep 10 04:26:45.649736 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.649689 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5862c6-e214-40b4-ae41-d1a29f99f550-tmp-dir\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.649769 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.649742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s66sz\" (UniqueName: \"kubernetes.io/projected/4a5862c6-e214-40b4-ae41-d1a29f99f550-kube-api-access-s66sz\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.649803 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.649777 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.750746 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.750718 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9-cert\") pod \"ingress-canary-74gkc\" (UID: \"dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9\") " pod="openshift-ingress-canary/ingress-canary-74gkc" Sep 10 04:26:45.750904 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.750751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5862c6-e214-40b4-ae41-d1a29f99f550-tmp-dir\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.750904 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.750793 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s66sz\" (UniqueName: \"kubernetes.io/projected/4a5862c6-e214-40b4-ae41-d1a29f99f550-kube-api-access-s66sz\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.750904 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.750836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.750904 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.750885 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk7w4\" (UniqueName: \"kubernetes.io/projected/dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9-kube-api-access-pk7w4\") pod \"ingress-canary-74gkc\" (UID: \"dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9\") " pod="openshift-ingress-canary/ingress-canary-74gkc" Sep 10 04:26:45.751096 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.750908 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5862c6-e214-40b4-ae41-d1a29f99f550-config-volume\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.751096 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:45.750983 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:26:45.751096 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:45.751048 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls podName:4a5862c6-e214-40b4-ae41-d1a29f99f550 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:46.251029756 +0000 UTC m=+36.187941225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls") pod "dns-default-bb67w" (UID: "4a5862c6-e214-40b4-ae41-d1a29f99f550") : secret "dns-default-metrics-tls" not found Sep 10 04:26:45.751267 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.751132 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5862c6-e214-40b4-ae41-d1a29f99f550-tmp-dir\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.751441 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.751423 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5862c6-e214-40b4-ae41-d1a29f99f550-config-volume\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.754761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.754740 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9-cert\") pod \"ingress-canary-74gkc\" (UID: \"dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9\") " pod="openshift-ingress-canary/ingress-canary-74gkc" Sep 10 04:26:45.760225 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.760199 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s66sz\" (UniqueName: \"kubernetes.io/projected/4a5862c6-e214-40b4-ae41-d1a29f99f550-kube-api-access-s66sz\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:45.760314 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.760287 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk7w4\" (UniqueName: \"kubernetes.io/projected/dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9-kube-api-access-pk7w4\") pod \"ingress-canary-74gkc\" (UID: \"dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9\") " pod="openshift-ingress-canary/ingress-canary-74gkc" Sep 10 04:26:45.787150 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.787121 2555 generic.go:356] "Generic (PLEG): container finished" podID="60afc3da-8b47-4964-9997-ff5167095ed0" containerID="9b79bd8ebf419824eb3d6814c084838238f3c74f96c154702bd1527355b2d3b7" exitCode=0 Sep 10 04:26:45.787250 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.787186 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" event={"ID":"60afc3da-8b47-4964-9997-ff5167095ed0","Type":"ContainerDied","Data":"9b79bd8ebf419824eb3d6814c084838238f3c74f96c154702bd1527355b2d3b7"} Sep 10 04:26:45.801577 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:45.801560 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-74gkc" Sep 10 04:26:46.118125 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.117864 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-74gkc"] Sep 10 04:26:46.121867 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:26:46.121837 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2f2688_72b5_40bc_bdc6_c53a5ec76fb9.slice/crio-acdc1bccf316cd5322af674962d124757305ed35ed6796c5f8ba634f0cb79447 WatchSource:0}: Error finding container acdc1bccf316cd5322af674962d124757305ed35ed6796c5f8ba634f0cb79447: Status 404 returned error can't find the container with id acdc1bccf316cd5322af674962d124757305ed35ed6796c5f8ba634f0cb79447 Sep 10 04:26:46.255246 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.255214 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:46.255407 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:46.255312 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:26:46.255407 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:46.255361 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls podName:4a5862c6-e214-40b4-ae41-d1a29f99f550 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:47.255347666 +0000 UTC m=+37.192259117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls") pod "dns-default-bb67w" (UID: "4a5862c6-e214-40b4-ae41-d1a29f99f550") : secret "dns-default-metrics-tls" not found Sep 10 04:26:46.542307 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.542237 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:26:46.542889 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.542409 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:26:46.544873 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.544849 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 04:26:46.545000 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.544936 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9c7m\"" Sep 10 04:26:46.545138 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.545123 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 04:26:46.545206 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.545187 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 04:26:46.793458 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.793380 2555 generic.go:356] "Generic (PLEG): container finished" podID="60afc3da-8b47-4964-9997-ff5167095ed0" containerID="aaf3b98293fef7e8714399c31364a3d401d232fcc3ec5220374f7b91c491da28" exitCode=0 Sep 10 04:26:46.793606 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.793575 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" event={"ID":"60afc3da-8b47-4964-9997-ff5167095ed0","Type":"ContainerDied","Data":"aaf3b98293fef7e8714399c31364a3d401d232fcc3ec5220374f7b91c491da28"} Sep 10 04:26:46.795030 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:46.795011 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-74gkc" event={"ID":"dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9","Type":"ContainerStarted","Data":"acdc1bccf316cd5322af674962d124757305ed35ed6796c5f8ba634f0cb79447"} Sep 10 04:26:47.263708 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:47.263667 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:47.263876 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:47.263857 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:26:47.263983 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:47.263965 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls podName:4a5862c6-e214-40b4-ae41-d1a29f99f550 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:49.263935284 +0000 UTC m=+39.200846748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls") pod "dns-default-bb67w" (UID: "4a5862c6-e214-40b4-ae41-d1a29f99f550") : secret "dns-default-metrics-tls" not found Sep 10 04:26:47.802252 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:47.802202 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" event={"ID":"60afc3da-8b47-4964-9997-ff5167095ed0","Type":"ContainerStarted","Data":"c38a7c2617cf24e0f1900b708417105eb8bd846986615e4e9d5fb444a43a0fcc"} Sep 10 04:26:47.832767 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:47.832716 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6hxp2" podStartSLOduration=7.144183112 podStartE2EDuration="36.832696691s" totalImagesPullingTime="29.688513579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:47.830806016 +0000 UTC m=+37.767717488" watchObservedRunningTime="2026-09-10 04:26:47.832696691 +0000 UTC m=+37.769608167" Sep 10 04:26:48.805705 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:48.805676 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-74gkc" event={"ID":"dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9","Type":"ContainerStarted","Data":"fb4bede0d9f482ae6d65870143b1f43fe3ac596444e3c78afb97dc319060f207"} Sep 10 04:26:48.821960 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:48.821917 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-74gkc" podStartSLOduration=1.31590778 podStartE2EDuration="3.821897672s" totalImagesPullingTime="2.505989892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:48.821508519 +0000 UTC m=+38.758420003" watchObservedRunningTime="2026-09-10 04:26:48.821897672 +0000 UTC m=+38.758809146" Sep 10 04:26:49.278887 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:49.278712 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:49.278887 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:49.278849 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:26:49.279083 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:49.278941 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls podName:4a5862c6-e214-40b4-ae41-d1a29f99f550 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:53.278927111 +0000 UTC m=+43.215838561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls") pod "dns-default-bb67w" (UID: "4a5862c6-e214-40b4-ae41-d1a29f99f550") : secret "dns-default-metrics-tls" not found Sep 10 04:26:53.305443 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:26:53.305404 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:26:53.305884 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:53.305579 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:26:53.305884 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:26:53.305664 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls podName:4a5862c6-e214-40b4-ae41-d1a29f99f550 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:01.305641147 +0000 UTC m=+51.242552614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls") pod "dns-default-bb67w" (UID: "4a5862c6-e214-40b4-ae41-d1a29f99f550") : secret "dns-default-metrics-tls" not found Sep 10 04:27:01.363151 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:01.363113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:27:01.363611 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:01.363258 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:27:01.363611 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:01.363326 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls podName:4a5862c6-e214-40b4-ae41-d1a29f99f550 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:17.363310182 +0000 UTC m=+67.300221632 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls") pod "dns-default-bb67w" (UID: "4a5862c6-e214-40b4-ae41-d1a29f99f550") : secret "dns-default-metrics-tls" not found Sep 10 04:27:09.776279 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:09.776238 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcvsz" Sep 10 04:27:16.261987 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.261937 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:27:16.264909 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.264892 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 04:27:16.273128 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:16.273110 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 04:27:16.273199 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:16.273186 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs podName:a348378a-58b7-43b0-9e14-76c8a8ba1679 nodeName:}" failed. No retries permitted until 2026-09-10 04:28:20.273157205 +0000 UTC m=+130.210068655 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs") pod "network-metrics-daemon-clrgs" (UID: "a348378a-58b7-43b0-9e14-76c8a8ba1679") : secret "metrics-daemon-secret" not found Sep 10 04:27:16.363190 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.363144 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:27:16.366235 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.366218 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 04:27:16.377252 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.377228 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39729577-e75a-4943-949c-647afac710e5-original-pull-secret\") pod \"global-pull-secret-syncer-66jvb\" (UID: \"39729577-e75a-4943-949c-647afac710e5\") " pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:27:16.463956 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.463927 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x67ns\" (UniqueName: \"kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns\") pod \"network-check-target-pmsfj\" (UID: \"62deddbb-4d33-4337-a967-a45e6508cada\") " pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:27:16.467553 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.467530 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 04:27:16.476795 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.476778 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 04:27:16.487064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.487035 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x67ns\" (UniqueName: \"kubernetes.io/projected/62deddbb-4d33-4337-a967-a45e6508cada-kube-api-access-x67ns\") pod \"network-check-target-pmsfj\" (UID: \"62deddbb-4d33-4337-a967-a45e6508cada\") " pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:27:16.554871 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.554848 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9c7m\"" Sep 10 04:27:16.556878 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.556861 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66jvb" Sep 10 04:27:16.562380 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.562366 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:27:16.827695 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.827617 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-66jvb"] Sep 10 04:27:16.830466 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.830441 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pmsfj"] Sep 10 04:27:16.833539 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:27:16.833520 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62deddbb_4d33_4337_a967_a45e6508cada.slice/crio-2e352a7edc996cc76ff7778ab974f94d5d7724244f5d9a40e0b791c08812f8a6 WatchSource:0}: Error finding container 2e352a7edc996cc76ff7778ab974f94d5d7724244f5d9a40e0b791c08812f8a6: Status 404 returned error can't find the container with id 2e352a7edc996cc76ff7778ab974f94d5d7724244f5d9a40e0b791c08812f8a6 Sep 10 04:27:16.870552 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.870517 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-66jvb" event={"ID":"39729577-e75a-4943-949c-647afac710e5","Type":"ContainerStarted","Data":"8965066e4df1d87c79c146b214b4b9df29d93494c6bb69f1c71a6344735abb13"} Sep 10 04:27:16.871609 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:16.871587 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pmsfj" event={"ID":"62deddbb-4d33-4337-a967-a45e6508cada","Type":"ContainerStarted","Data":"2e352a7edc996cc76ff7778ab974f94d5d7724244f5d9a40e0b791c08812f8a6"} Sep 10 04:27:17.369568 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:17.369517 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:27:17.369955 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:17.369672 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:27:17.369955 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:17.369738 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls podName:4a5862c6-e214-40b4-ae41-d1a29f99f550 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:49.369720023 +0000 UTC m=+99.306631475 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls") pod "dns-default-bb67w" (UID: "4a5862c6-e214-40b4-ae41-d1a29f99f550") : secret "dns-default-metrics-tls" not found Sep 10 04:27:21.886622 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:21.886586 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-66jvb" event={"ID":"39729577-e75a-4943-949c-647afac710e5","Type":"ContainerStarted","Data":"080a9033b8118ad223b8084b4e795a9b26d73dea1b9be6c490ed97155b46c4c8"} Sep 10 04:27:21.888094 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:21.888068 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pmsfj" event={"ID":"62deddbb-4d33-4337-a967-a45e6508cada","Type":"ContainerStarted","Data":"46c24140114b01f9a718478ac78340950991166cca5f530701a7993c6f82de04"} Sep 10 04:27:21.888223 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:21.888200 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:27:21.902045 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:21.901998 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-66jvb" podStartSLOduration=66.353462588 podStartE2EDuration="1m10.901985443s" totalImagesPullingTime="4.548522855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:21.900979163 +0000 UTC m=+71.837890635" watchObservedRunningTime="2026-09-10 04:27:21.901985443 +0000 UTC m=+71.838896952" Sep 10 04:27:21.915351 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:21.915308 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pmsfj" podStartSLOduration=66.373415464 podStartE2EDuration="1m10.91529525s" totalImagesPullingTime="4.541879786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:21.914585624 +0000 UTC m=+71.851497097" watchObservedRunningTime="2026-09-10 04:27:21.91529525 +0000 UTC m=+71.852206722" Sep 10 04:27:26.075455 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.075425 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl"] Sep 10 04:27:26.077203 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.077187 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.078559 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.078533 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-g8vg7"] Sep 10 04:27:26.079973 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.079953 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 04:27:26.080068 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.080020 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 04:27:26.080068 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.080061 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.081366 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.081344 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-88vvq\"" Sep 10 04:27:26.081453 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.081405 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 04:27:26.081453 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.081413 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:27:26.085387 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.085368 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 10 04:27:26.085518 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.085499 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 10 04:27:26.085630 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.085607 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5hvpp\"" Sep 10 04:27:26.085742 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.085726 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 04:27:26.085818 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.085436 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 04:27:26.090407 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.090385 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl"] Sep 10 04:27:26.090611 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.090592 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 10 04:27:26.095503 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.095481 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-g8vg7"] Sep 10 04:27:26.129339 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.129316 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42008412-8080-44cc-b338-b5b1539b51e3-tmp\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.129432 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.129344 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42008412-8080-44cc-b338-b5b1539b51e3-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.129432 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.129366 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84vzb\" (UniqueName: \"kubernetes.io/projected/42008412-8080-44cc-b338-b5b1539b51e3-kube-api-access-84vzb\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.129432 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.129381 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbc3e870-876e-4ef7-9c07-7402473cc2ad-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g5xl\" (UID: \"fbc3e870-876e-4ef7-9c07-7402473cc2ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.129592 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.129497 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/42008412-8080-44cc-b338-b5b1539b51e3-snapshots\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.129592 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.129535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42008412-8080-44cc-b338-b5b1539b51e3-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.129656 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.129596 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42008412-8080-44cc-b338-b5b1539b51e3-serving-cert\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.129656 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.129625 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbc3e870-876e-4ef7-9c07-7402473cc2ad-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g5xl\" (UID: \"fbc3e870-876e-4ef7-9c07-7402473cc2ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.129656 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.129646 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqqfx\" (UniqueName: \"kubernetes.io/projected/fbc3e870-876e-4ef7-9c07-7402473cc2ad-kube-api-access-gqqfx\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g5xl\" (UID: \"fbc3e870-876e-4ef7-9c07-7402473cc2ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.186987 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.186960 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5587d886cb-b694w"] Sep 10 04:27:26.188690 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.188674 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.191817 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.191796 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 04:27:26.191898 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.191798 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 04:27:26.192064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.192051 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 04:27:26.192138 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.192122 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dz65p\"" Sep 10 04:27:26.192379 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.192361 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 04:27:26.192466 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.192393 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 04:27:26.192466 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.192412 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 04:27:26.205848 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.205828 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5587d886cb-b694w"] Sep 10 04:27:26.230135 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230106 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84vzb\" (UniqueName: \"kubernetes.io/projected/42008412-8080-44cc-b338-b5b1539b51e3-kube-api-access-84vzb\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.230251 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230144 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbc3e870-876e-4ef7-9c07-7402473cc2ad-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g5xl\" (UID: \"fbc3e870-876e-4ef7-9c07-7402473cc2ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.230251 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/42008412-8080-44cc-b338-b5b1539b51e3-snapshots\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.230251 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230237 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42008412-8080-44cc-b338-b5b1539b51e3-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.230409 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230278 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42008412-8080-44cc-b338-b5b1539b51e3-serving-cert\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.230409 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230304 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbc3e870-876e-4ef7-9c07-7402473cc2ad-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g5xl\" (UID: \"fbc3e870-876e-4ef7-9c07-7402473cc2ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.230409 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230328 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqqfx\" (UniqueName: \"kubernetes.io/projected/fbc3e870-876e-4ef7-9c07-7402473cc2ad-kube-api-access-gqqfx\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g5xl\" (UID: \"fbc3e870-876e-4ef7-9c07-7402473cc2ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.230409 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230359 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.230409 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wzds\" (UniqueName: \"kubernetes.io/projected/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-kube-api-access-5wzds\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.230645 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230437 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-default-certificate\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.230645 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230493 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42008412-8080-44cc-b338-b5b1539b51e3-tmp\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.230645 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230518 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42008412-8080-44cc-b338-b5b1539b51e3-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.230645 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230542 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-stats-auth\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.230645 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.230570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.231128 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.231034 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/42008412-8080-44cc-b338-b5b1539b51e3-snapshots\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.231248 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.231222 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbc3e870-876e-4ef7-9c07-7402473cc2ad-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g5xl\" (UID: \"fbc3e870-876e-4ef7-9c07-7402473cc2ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.231317 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.231267 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42008412-8080-44cc-b338-b5b1539b51e3-tmp\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.231432 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.231410 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42008412-8080-44cc-b338-b5b1539b51e3-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.231482 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.231417 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42008412-8080-44cc-b338-b5b1539b51e3-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.232519 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.232501 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbc3e870-876e-4ef7-9c07-7402473cc2ad-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g5xl\" (UID: \"fbc3e870-876e-4ef7-9c07-7402473cc2ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.232635 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.232616 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42008412-8080-44cc-b338-b5b1539b51e3-serving-cert\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.238048 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.238024 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84vzb\" (UniqueName: \"kubernetes.io/projected/42008412-8080-44cc-b338-b5b1539b51e3-kube-api-access-84vzb\") pod \"insights-operator-76bcd6ccf5-g8vg7\" (UID: \"42008412-8080-44cc-b338-b5b1539b51e3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.238571 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.238547 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqqfx\" (UniqueName: \"kubernetes.io/projected/fbc3e870-876e-4ef7-9c07-7402473cc2ad-kube-api-access-gqqfx\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g5xl\" (UID: \"fbc3e870-876e-4ef7-9c07-7402473cc2ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.281684 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.281668 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-jmk74"] Sep 10 04:27:26.283900 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.283886 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:26.285407 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.285388 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-746bcbfcc7-f2pkt"] Sep 10 04:27:26.286593 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.286572 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pz88v\"" Sep 10 04:27:26.287031 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.287015 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.287133 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.287120 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 10 04:27:26.287216 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.287187 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 10 04:27:26.289879 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.289861 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 04:27:26.290140 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.290028 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 04:27:26.290140 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.290082 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bgv6k\"" Sep 10 04:27:26.290709 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.290693 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 04:27:26.296625 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.296608 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 04:27:26.297045 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.297027 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-jmk74"] Sep 10 04:27:26.304060 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.304038 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-746bcbfcc7-f2pkt"] Sep 10 04:27:26.331515 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331469 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzds\" (UniqueName: \"kubernetes.io/projected/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-kube-api-access-5wzds\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.331515 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331505 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:26.331641 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331523 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-trusted-ca\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.331641 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331541 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-stats-auth\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.331641 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331566 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.331641 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331589 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30be0e41-dcec-426a-90c2-50bb57e8bba7-nginx-conf\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:26.331641 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331603 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-bound-sa-token\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.331641 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-certificates\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.331891 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.331891 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331674 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-default-certificate\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.331891 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331706 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4dd7f8a-5820-489a-a882-31812ab61b94-ca-trust-extracted\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.331891 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331747 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsrld\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-kube-api-access-vsrld\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.331891 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.331715 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 04:27:26.331891 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331774 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-installation-pull-secrets\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.331891 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.331799 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:26.831782781 +0000 UTC m=+76.768694234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : secret "router-metrics-certs-default" not found Sep 10 04:27:26.332194 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-image-registry-private-configuration\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.332194 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.331966 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.332194 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.332050 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:26.832038627 +0000 UTC m=+76.768950097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : configmap references non-existent config key: service-ca.crt Sep 10 04:27:26.333732 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.333714 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-stats-auth\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.333813 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.333755 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-default-certificate\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.345185 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.345155 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wzds\" (UniqueName: \"kubernetes.io/projected/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-kube-api-access-5wzds\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.389009 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.388991 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" Sep 10 04:27:26.394771 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.394756 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" Sep 10 04:27:26.433444 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.433215 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrld\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-kube-api-access-vsrld\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.433444 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.433264 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-installation-pull-secrets\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.433444 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.433328 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-image-registry-private-configuration\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.433444 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.433392 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:26.433444 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.433423 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-trusted-ca\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.434394 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.434049 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 04:27:26.434394 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.434130 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert podName:30be0e41-dcec-426a-90c2-50bb57e8bba7 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:26.934110674 +0000 UTC m=+76.871022140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-jmk74" (UID: "30be0e41-dcec-426a-90c2-50bb57e8bba7") : secret "networking-console-plugin-cert" not found Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.435029 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30be0e41-dcec-426a-90c2-50bb57e8bba7-nginx-conf\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.435389 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-trusted-ca\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.435455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30be0e41-dcec-426a-90c2-50bb57e8bba7-nginx-conf\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.435536 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-bound-sa-token\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.435609 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-certificates\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.436646 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-certificates\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.436698 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.436773 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4dd7f8a-5820-489a-a882-31812ab61b94-ca-trust-extracted\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.436989 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.437006 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-746bcbfcc7-f2pkt: secret "image-registry-tls" not found Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.437056 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls podName:f4dd7f8a-5820-489a-a882-31812ab61b94 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:26.937038434 +0000 UTC m=+76.873949904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls") pod "image-registry-746bcbfcc7-f2pkt" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94") : secret "image-registry-tls" not found Sep 10 04:27:26.437181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.437107 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4dd7f8a-5820-489a-a882-31812ab61b94-ca-trust-extracted\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.437969 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.437513 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-installation-pull-secrets\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.437969 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.437647 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-image-registry-private-configuration\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.442971 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.442948 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsrld\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-kube-api-access-vsrld\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.456822 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.456780 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-bound-sa-token\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.656584 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.656508 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl"] Sep 10 04:27:26.659305 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:27:26.659280 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc3e870_876e_4ef7_9c07_7402473cc2ad.slice/crio-00ee95b2a65954ffc3d2cec36b150fdd1f7fef23c966e413ba963f9f43c60794 WatchSource:0}: Error finding container 00ee95b2a65954ffc3d2cec36b150fdd1f7fef23c966e413ba963f9f43c60794: Status 404 returned error can't find the container with id 00ee95b2a65954ffc3d2cec36b150fdd1f7fef23c966e413ba963f9f43c60794 Sep 10 04:27:26.678896 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.678873 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-g8vg7"] Sep 10 04:27:26.681152 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:27:26.681129 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42008412_8080_44cc_b338_b5b1539b51e3.slice/crio-38fd70a1b12eab8a0a77645326755d4974639443b9dae9286bc7f103267e9700 WatchSource:0}: Error finding container 38fd70a1b12eab8a0a77645326755d4974639443b9dae9286bc7f103267e9700: Status 404 returned error can't find the container with id 38fd70a1b12eab8a0a77645326755d4974639443b9dae9286bc7f103267e9700 Sep 10 04:27:26.840168 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.840142 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.840324 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.840206 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:26.840324 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.840305 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:27.840288742 +0000 UTC m=+77.777200193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : configmap references non-existent config key: service-ca.crt Sep 10 04:27:26.840324 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.840306 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 04:27:26.840484 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.840342 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:27.84033496 +0000 UTC m=+77.777246412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : secret "router-metrics-certs-default" not found Sep 10 04:27:26.902070 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.902038 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" event={"ID":"42008412-8080-44cc-b338-b5b1539b51e3","Type":"ContainerStarted","Data":"38fd70a1b12eab8a0a77645326755d4974639443b9dae9286bc7f103267e9700"} Sep 10 04:27:26.903098 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.903080 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" event={"ID":"fbc3e870-876e-4ef7-9c07-7402473cc2ad","Type":"ContainerStarted","Data":"00ee95b2a65954ffc3d2cec36b150fdd1f7fef23c966e413ba963f9f43c60794"} Sep 10 04:27:26.940721 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.940675 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:26.940721 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:26.940714 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:26.940831 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.940820 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 04:27:26.940863 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.940835 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-746bcbfcc7-f2pkt: secret "image-registry-tls" not found Sep 10 04:27:26.940899 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.940873 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls podName:f4dd7f8a-5820-489a-a882-31812ab61b94 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:27.940861116 +0000 UTC m=+77.877772566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls") pod "image-registry-746bcbfcc7-f2pkt" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94") : secret "image-registry-tls" not found Sep 10 04:27:26.940937 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.940821 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 04:27:26.940968 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:26.940949 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert podName:30be0e41-dcec-426a-90c2-50bb57e8bba7 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:27.940937372 +0000 UTC m=+77.877848824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-jmk74" (UID: "30be0e41-dcec-426a-90c2-50bb57e8bba7") : secret "networking-console-plugin-cert" not found Sep 10 04:27:27.846771 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:27.846735 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:27.847193 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:27.846814 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:27.847193 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:27.846910 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:29.84688759 +0000 UTC m=+79.783799066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : configmap references non-existent config key: service-ca.crt Sep 10 04:27:27.847193 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:27.846953 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 04:27:27.847193 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:27.847008 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:29.846991925 +0000 UTC m=+79.783903380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : secret "router-metrics-certs-default" not found Sep 10 04:27:27.947250 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:27.947211 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:27.947401 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:27.947278 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:27.947401 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:27.947356 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 04:27:27.947495 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:27.947416 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert podName:30be0e41-dcec-426a-90c2-50bb57e8bba7 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:29.947400224 +0000 UTC m=+79.884311696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-jmk74" (UID: "30be0e41-dcec-426a-90c2-50bb57e8bba7") : secret "networking-console-plugin-cert" not found Sep 10 04:27:27.947495 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:27.947360 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 04:27:27.947495 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:27.947453 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-746bcbfcc7-f2pkt: secret "image-registry-tls" not found Sep 10 04:27:27.947495 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:27.947491 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls podName:f4dd7f8a-5820-489a-a882-31812ab61b94 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:29.947479555 +0000 UTC m=+79.884391013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls") pod "image-registry-746bcbfcc7-f2pkt" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94") : secret "image-registry-tls" not found Sep 10 04:27:29.864247 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:29.864203 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:29.864671 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:29.864276 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:29.864671 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:29.864394 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.86437593 +0000 UTC m=+83.801287402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : configmap references non-existent config key: service-ca.crt Sep 10 04:27:29.864671 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:29.864407 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 04:27:29.864671 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:29.864463 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.864446368 +0000 UTC m=+83.801357819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : secret "router-metrics-certs-default" not found Sep 10 04:27:29.913688 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:29.913648 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" event={"ID":"42008412-8080-44cc-b338-b5b1539b51e3","Type":"ContainerStarted","Data":"f8d24f61eeed0440a75ec91d5f53ffe3a5c75b661991bf3e7caf7d0906831cda"} Sep 10 04:27:29.915113 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:29.915080 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" event={"ID":"fbc3e870-876e-4ef7-9c07-7402473cc2ad","Type":"ContainerStarted","Data":"3c35ffe2a97535f1dd792654076ef817ee804d67e39e125bb5a60cf1f0b09746"} Sep 10 04:27:29.930800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:29.930743 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" podStartSLOduration=1.449105291 podStartE2EDuration="3.93072723s" totalImagesPullingTime="2.481621939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:29.929543281 +0000 UTC m=+79.866454765" watchObservedRunningTime="2026-09-10 04:27:29.93072723 +0000 UTC m=+79.867638680" Sep 10 04:27:29.951497 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:29.951455 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" podStartSLOduration=1.44638395 podStartE2EDuration="3.951438998s" totalImagesPullingTime="2.505055048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:29.950625226 +0000 UTC m=+79.887536700" watchObservedRunningTime="2026-09-10 04:27:29.951438998 +0000 UTC m=+79.888350472" Sep 10 04:27:29.965173 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:29.965136 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:29.965904 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:29.965478 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:29.965904 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:29.965825 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 04:27:29.965904 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:29.965843 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-746bcbfcc7-f2pkt: secret "image-registry-tls" not found Sep 10 04:27:29.966502 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:29.966483 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 04:27:29.966584 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:29.966494 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls podName:f4dd7f8a-5820-489a-a882-31812ab61b94 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.966462855 +0000 UTC m=+83.903374318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls") pod "image-registry-746bcbfcc7-f2pkt" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94") : secret "image-registry-tls" not found Sep 10 04:27:29.966584 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:29.966563 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert podName:30be0e41-dcec-426a-90c2-50bb57e8bba7 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.966545396 +0000 UTC m=+83.903456855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-jmk74" (UID: "30be0e41-dcec-426a-90c2-50bb57e8bba7") : secret "networking-console-plugin-cert" not found Sep 10 04:27:30.295856 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.295771 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kh2vv"] Sep 10 04:27:30.298127 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.298107 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.300693 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.300670 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2589\"" Sep 10 04:27:30.300899 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.300885 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 04:27:30.301052 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.301032 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 04:27:30.310940 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.310921 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kh2vv"] Sep 10 04:27:30.368014 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.367982 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnc7z\" (UniqueName: \"kubernetes.io/projected/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-api-access-lnc7z\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.368014 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.368012 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a83e291-e5e5-4bd0-b771-447b737c1540-crio-socket\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.368241 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.368043 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.368241 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.368084 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.368241 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.368126 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a83e291-e5e5-4bd0-b771-447b737c1540-data-volume\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.469016 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.468985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a83e291-e5e5-4bd0-b771-447b737c1540-data-volume\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.469185 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.469040 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnc7z\" (UniqueName: \"kubernetes.io/projected/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-api-access-lnc7z\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.469185 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.469060 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a83e291-e5e5-4bd0-b771-447b737c1540-crio-socket\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.469185 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.469090 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.469185 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.469129 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.469385 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:30.469213 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 04:27:30.469385 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.469228 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a83e291-e5e5-4bd0-b771-447b737c1540-crio-socket\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.469385 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:30.469247 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:30.469385 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:30.469274 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:30.969256386 +0000 UTC m=+80.906167850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : configmap "kube-rbac-proxy" not found Sep 10 04:27:30.469385 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:30.469320 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:30.969300518 +0000 UTC m=+80.906211982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:30.469385 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.469366 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a83e291-e5e5-4bd0-b771-447b737c1540-data-volume\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.480311 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.480286 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnc7z\" (UniqueName: \"kubernetes.io/projected/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-api-access-lnc7z\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.972826 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.972775 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.973324 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:30.972949 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:30.973324 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:30.973018 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 04:27:30.973324 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:30.973111 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:31.973094943 +0000 UTC m=+81.910006399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : configmap "kube-rbac-proxy" not found Sep 10 04:27:30.973324 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:30.973221 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:30.973324 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:30.973271 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:31.973257812 +0000 UTC m=+81.910169277 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:31.980881 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:31.980850 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:31.981259 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:31.980954 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:31.981259 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:31.980961 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 04:27:31.981259 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:31.981028 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:31.981259 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:31.981051 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.981034646 +0000 UTC m=+83.917946116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : configmap "kube-rbac-proxy" not found Sep 10 04:27:31.981259 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:31.981071 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.981058092 +0000 UTC m=+83.917969543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:33.254770 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:33.254657 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5kv8_59056bf7-c39f-4b7a-add4-14b7cce7eaf4/dns-node-resolver/0.log" Sep 10 04:27:33.896650 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:33.896620 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:33.896817 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:33.896671 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:33.896817 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.896764 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 04:27:33.896817 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.896781 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:41.896764705 +0000 UTC m=+91.833676156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : configmap references non-existent config key: service-ca.crt Sep 10 04:27:33.896817 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.896807 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:41.896795905 +0000 UTC m=+91.833707356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : secret "router-metrics-certs-default" not found Sep 10 04:27:33.996961 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:33.996920 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:33.997119 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:33.996973 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:33.997119 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:33.997039 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:33.997119 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:33.997088 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:33.997119 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.997041 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 04:27:33.997119 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.997121 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-746bcbfcc7-f2pkt: secret "image-registry-tls" not found Sep 10 04:27:33.997300 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.997094 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 04:27:33.997300 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.997190 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls podName:f4dd7f8a-5820-489a-a882-31812ab61b94 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:41.997155128 +0000 UTC m=+91.934066578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls") pod "image-registry-746bcbfcc7-f2pkt" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94") : secret "image-registry-tls" not found Sep 10 04:27:33.997300 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.997199 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 04:27:33.997300 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.997224 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:37.997211738 +0000 UTC m=+87.934123189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : configmap "kube-rbac-proxy" not found Sep 10 04:27:33.997300 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.997108 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:33.997300 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.997237 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert podName:30be0e41-dcec-426a-90c2-50bb57e8bba7 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:41.997231869 +0000 UTC m=+91.934143319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-jmk74" (UID: "30be0e41-dcec-426a-90c2-50bb57e8bba7") : secret "networking-console-plugin-cert" not found Sep 10 04:27:33.997300 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:33.997268 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:37.997258526 +0000 UTC m=+87.934169978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:34.055490 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:34.055463 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8k86_b63665a1-098c-4ed3-bbbf-216f1ea2bb8f/node-ca/0.log" Sep 10 04:27:34.658230 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:34.658197 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-74gkc_dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9/serve-healthcheck-canary/0.log" Sep 10 04:27:35.656261 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:35.656229 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-8g5xl_fbc3e870-876e-4ef7-9c07-7402473cc2ad/kube-storage-version-migrator-operator/0.log" Sep 10 04:27:38.028587 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:38.028546 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:38.028979 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:38.028609 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:38.028979 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:38.028701 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:38.028979 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:38.028714 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 04:27:38.028979 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:38.028764 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:46.028749986 +0000 UTC m=+95.965661437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : configmap "kube-rbac-proxy" not found Sep 10 04:27:38.028979 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:38.028777 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:46.028771492 +0000 UTC m=+95.965682943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:41.959345 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:41.959312 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:41.959724 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:41.959371 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:41.959724 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:41.959479 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 04:27:41.959724 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:41.959498 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:57.959480318 +0000 UTC m=+107.896391770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : configmap references non-existent config key: service-ca.crt Sep 10 04:27:41.959724 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:41.959536 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs podName:8331e93c-ec29-4f3b-98a9-9a03c8eab0e5 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:57.959512989 +0000 UTC m=+107.896424439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs") pod "router-default-5587d886cb-b694w" (UID: "8331e93c-ec29-4f3b-98a9-9a03c8eab0e5") : secret "router-metrics-certs-default" not found Sep 10 04:27:42.060666 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:42.060630 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:42.060803 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:42.060697 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:42.060843 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:42.060796 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 04:27:42.060876 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:42.060865 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert podName:30be0e41-dcec-426a-90c2-50bb57e8bba7 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:58.06084596 +0000 UTC m=+107.997757424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-jmk74" (UID: "30be0e41-dcec-426a-90c2-50bb57e8bba7") : secret "networking-console-plugin-cert" not found Sep 10 04:27:42.063040 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:42.063020 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls\") pod \"image-registry-746bcbfcc7-f2pkt\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:42.199328 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:42.199297 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:42.468428 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:42.468358 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-746bcbfcc7-f2pkt"] Sep 10 04:27:42.471261 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:27:42.471234 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dd7f8a_5820_489a_a882_31812ab61b94.slice/crio-1aef3ceb8a49e08e50ea01b7473f2c9490a5ef7752b2525077d7b788d6ae1ec1 WatchSource:0}: Error finding container 1aef3ceb8a49e08e50ea01b7473f2c9490a5ef7752b2525077d7b788d6ae1ec1: Status 404 returned error can't find the container with id 1aef3ceb8a49e08e50ea01b7473f2c9490a5ef7752b2525077d7b788d6ae1ec1 Sep 10 04:27:42.956324 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:42.956290 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" event={"ID":"f4dd7f8a-5820-489a-a882-31812ab61b94","Type":"ContainerStarted","Data":"97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13"} Sep 10 04:27:42.956483 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:42.956339 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" event={"ID":"f4dd7f8a-5820-489a-a882-31812ab61b94","Type":"ContainerStarted","Data":"1aef3ceb8a49e08e50ea01b7473f2c9490a5ef7752b2525077d7b788d6ae1ec1"} Sep 10 04:27:42.956483 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:42.956401 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:27:42.978236 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:42.978174 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" podStartSLOduration=16.978137689 podStartE2EDuration="16.978137689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:42.976492264 +0000 UTC m=+92.913403731" watchObservedRunningTime="2026-09-10 04:27:42.978137689 +0000 UTC m=+92.915049162" Sep 10 04:27:46.092810 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:46.092774 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:46.093233 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:46.092839 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:46.093233 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:46.092929 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:46.093233 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:27:46.093011 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls podName:1a83e291-e5e5-4bd0-b771-447b737c1540 nodeName:}" failed. No retries permitted until 2026-09-10 04:28:02.092991891 +0000 UTC m=+112.029903350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh2vv" (UID: "1a83e291-e5e5-4bd0-b771-447b737c1540") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:46.093512 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:46.093493 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a83e291-e5e5-4bd0-b771-447b737c1540-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:27:49.416243 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:49.416187 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:27:49.418585 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:49.418559 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5862c6-e214-40b4-ae41-d1a29f99f550-metrics-tls\") pod \"dns-default-bb67w\" (UID: \"4a5862c6-e214-40b4-ae41-d1a29f99f550\") " pod="openshift-dns/dns-default-bb67w" Sep 10 04:27:49.681295 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:49.681214 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w9vrw\"" Sep 10 04:27:49.689421 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:49.689400 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bb67w" Sep 10 04:27:49.956575 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:49.956478 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bb67w"] Sep 10 04:27:49.959052 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:27:49.959027 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5862c6_e214_40b4_ae41_d1a29f99f550.slice/crio-3b4f0983cd5e9abe7e141b22cad102fc0714ea5991935bcce683d9740afbff71 WatchSource:0}: Error finding container 3b4f0983cd5e9abe7e141b22cad102fc0714ea5991935bcce683d9740afbff71: Status 404 returned error can't find the container with id 3b4f0983cd5e9abe7e141b22cad102fc0714ea5991935bcce683d9740afbff71 Sep 10 04:27:49.978490 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:49.978462 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bb67w" event={"ID":"4a5862c6-e214-40b4-ae41-d1a29f99f550","Type":"ContainerStarted","Data":"3b4f0983cd5e9abe7e141b22cad102fc0714ea5991935bcce683d9740afbff71"} Sep 10 04:27:51.986956 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:51.986924 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bb67w" event={"ID":"4a5862c6-e214-40b4-ae41-d1a29f99f550","Type":"ContainerStarted","Data":"e69203d2a7c5726486e122fc9753b3a564f6c8b3f6533921bb8aaf63fbc7fff0"} Sep 10 04:27:51.987288 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:51.986979 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bb67w" event={"ID":"4a5862c6-e214-40b4-ae41-d1a29f99f550","Type":"ContainerStarted","Data":"e149688dcf485f51b5ce3a7a039062f837c76ca904af317a4e14db59f50e8c64"} Sep 10 04:27:51.987288 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:51.987046 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bb67w" Sep 10 04:27:52.006002 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:52.005953 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bb67w" podStartSLOduration=65.180449182 podStartE2EDuration="1m7.005938411s" totalImagesPullingTime="1.825489229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:52.004779781 +0000 UTC m=+101.941691253" watchObservedRunningTime="2026-09-10 04:27:52.005938411 +0000 UTC m=+101.942849884" Sep 10 04:27:52.893336 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:52.893305 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pmsfj" Sep 10 04:27:55.344101 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.344067 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-746bcbfcc7-f2pkt"] Sep 10 04:27:55.371779 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.371756 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c7b65bd4d-6scs2"] Sep 10 04:27:55.393742 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.393719 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c7b65bd4d-6scs2"] Sep 10 04:27:55.393863 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.393797 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.465959 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.465932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-installation-pull-secrets\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.466079 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.465972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-registry-tls\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.466079 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.465993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-image-registry-private-configuration\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.466079 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.466069 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-bound-sa-token\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.466271 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.466108 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-trusted-ca\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.466271 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.466205 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-ca-trust-extracted\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.466271 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.466249 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq4rn\" (UniqueName: \"kubernetes.io/projected/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-kube-api-access-tq4rn\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.466411 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.466275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-registry-certificates\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.567102 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.567080 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-image-registry-private-configuration\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.567223 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.567118 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-bound-sa-token\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.567223 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.567148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-trusted-ca\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.567347 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.567323 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-ca-trust-extracted\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.567401 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.567370 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq4rn\" (UniqueName: \"kubernetes.io/projected/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-kube-api-access-tq4rn\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.567401 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.567397 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-registry-certificates\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.567504 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.567474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-installation-pull-secrets\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.567563 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.567512 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-registry-tls\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.567752 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.567731 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-ca-trust-extracted\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.568226 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.568201 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-registry-certificates\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.568330 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.568290 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-trusted-ca\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.569585 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.569552 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-image-registry-private-configuration\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.569835 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.569817 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-registry-tls\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.569900 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.569821 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-installation-pull-secrets\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.576553 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.576533 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq4rn\" (UniqueName: \"kubernetes.io/projected/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-kube-api-access-tq4rn\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.576633 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.576601 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7e57983-7c68-4ca9-8471-f010fcaf3aeb-bound-sa-token\") pod \"image-registry-6c7b65bd4d-6scs2\" (UID: \"f7e57983-7c68-4ca9-8471-f010fcaf3aeb\") " pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.702360 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.702266 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:55.969266 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.969080 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c7b65bd4d-6scs2"] Sep 10 04:27:55.971663 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:27:55.971642 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e57983_7c68_4ca9_8471_f010fcaf3aeb.slice/crio-8bb4070ee6d37c7b5f441b43c781fa5eeacbfaa11e0cf27ff280dae18bba9b5d WatchSource:0}: Error finding container 8bb4070ee6d37c7b5f441b43c781fa5eeacbfaa11e0cf27ff280dae18bba9b5d: Status 404 returned error can't find the container with id 8bb4070ee6d37c7b5f441b43c781fa5eeacbfaa11e0cf27ff280dae18bba9b5d Sep 10 04:27:55.999772 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:55.999738 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" event={"ID":"f7e57983-7c68-4ca9-8471-f010fcaf3aeb","Type":"ContainerStarted","Data":"8bb4070ee6d37c7b5f441b43c781fa5eeacbfaa11e0cf27ff280dae18bba9b5d"} Sep 10 04:27:57.004096 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:57.004058 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" event={"ID":"f7e57983-7c68-4ca9-8471-f010fcaf3aeb","Type":"ContainerStarted","Data":"2cfcf086a117dfe57f0a8caee6c07c64ffcac422a41f6df588f8ef0846f7f897"} Sep 10 04:27:57.004525 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:57.004185 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:27:57.025140 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:57.025098 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" podStartSLOduration=2.025084714 podStartE2EDuration="2.025084714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:57.02292737 +0000 UTC m=+106.959838842" watchObservedRunningTime="2026-09-10 04:27:57.025084714 +0000 UTC m=+106.961996186" Sep 10 04:27:57.986708 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:57.986669 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:57.986847 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:57.986744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:57.987285 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:57.987266 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-service-ca-bundle\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:57.988823 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:57.988804 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8331e93c-ec29-4f3b-98a9-9a03c8eab0e5-metrics-certs\") pod \"router-default-5587d886cb-b694w\" (UID: \"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5\") " pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:57.996726 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:57.996697 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:27:58.087748 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:58.087694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:58.089882 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:58.089856 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30be0e41-dcec-426a-90c2-50bb57e8bba7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-jmk74\" (UID: \"30be0e41-dcec-426a-90c2-50bb57e8bba7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:58.093725 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:58.093699 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" Sep 10 04:27:58.281961 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:58.281938 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5587d886cb-b694w"] Sep 10 04:27:58.284312 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:27:58.284290 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8331e93c_ec29_4f3b_98a9_9a03c8eab0e5.slice/crio-1786d855480f55a586bcec60b4072173cfcf67a4985a55ed07d72825bbafdf3f WatchSource:0}: Error finding container 1786d855480f55a586bcec60b4072173cfcf67a4985a55ed07d72825bbafdf3f: Status 404 returned error can't find the container with id 1786d855480f55a586bcec60b4072173cfcf67a4985a55ed07d72825bbafdf3f Sep 10 04:27:58.358410 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:58.358385 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-jmk74"] Sep 10 04:27:58.360211 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:27:58.360182 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30be0e41_dcec_426a_90c2_50bb57e8bba7.slice/crio-423052f31e1c2486a445c7dd425d538754121c69ab14ef74bc30fa0b32cdd7d9 WatchSource:0}: Error finding container 423052f31e1c2486a445c7dd425d538754121c69ab14ef74bc30fa0b32cdd7d9: Status 404 returned error can't find the container with id 423052f31e1c2486a445c7dd425d538754121c69ab14ef74bc30fa0b32cdd7d9 Sep 10 04:27:59.013888 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:59.013851 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5587d886cb-b694w" event={"ID":"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5","Type":"ContainerStarted","Data":"4d9fa1b76fadf473162ad5213d1e0c137d09b993eef8db82593acba0826c4944"} Sep 10 04:27:59.014041 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:59.013910 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5587d886cb-b694w" event={"ID":"8331e93c-ec29-4f3b-98a9-9a03c8eab0e5","Type":"ContainerStarted","Data":"1786d855480f55a586bcec60b4072173cfcf67a4985a55ed07d72825bbafdf3f"} Sep 10 04:27:59.014974 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:59.014949 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" event={"ID":"30be0e41-dcec-426a-90c2-50bb57e8bba7","Type":"ContainerStarted","Data":"423052f31e1c2486a445c7dd425d538754121c69ab14ef74bc30fa0b32cdd7d9"} Sep 10 04:27:59.036626 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:59.036575 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5587d886cb-b694w" podStartSLOduration=33.036560744 podStartE2EDuration="33.036560744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:59.035636504 +0000 UTC m=+108.972547979" watchObservedRunningTime="2026-09-10 04:27:59.036560744 +0000 UTC m=+108.973472209" Sep 10 04:27:59.997788 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:27:59.997756 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:28:00.000241 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:00.000219 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:28:00.019322 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:00.019293 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" event={"ID":"30be0e41-dcec-426a-90c2-50bb57e8bba7","Type":"ContainerStarted","Data":"8dc3015ebb3414a2ce769726ade01751fed33e799e185ee2d341e23044f87732"} Sep 10 04:28:00.019515 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:00.019500 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:28:00.020597 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:00.020576 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5587d886cb-b694w" Sep 10 04:28:00.035005 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:00.034968 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-jmk74" podStartSLOduration=32.912731836 podStartE2EDuration="34.034955456s" totalImagesPullingTime="1.12222362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:00.03441242 +0000 UTC m=+109.971323892" watchObservedRunningTime="2026-09-10 04:28:00.034955456 +0000 UTC m=+109.971866908" Sep 10 04:28:01.992923 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:01.992884 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bb67w" Sep 10 04:28:02.122671 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:02.122634 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:28:02.124864 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:02.124839 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a83e291-e5e5-4bd0-b771-447b737c1540-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh2vv\" (UID: \"1a83e291-e5e5-4bd0-b771-447b737c1540\") " pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:28:02.406629 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:02.406604 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kh2vv" Sep 10 04:28:02.672184 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:02.672075 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kh2vv"] Sep 10 04:28:02.674524 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:28:02.674498 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a83e291_e5e5_4bd0_b771_447b737c1540.slice/crio-c66c86c97691766bbf8ec8329b62fc8ea95edb81243783bf740f6ae4efd67a64 WatchSource:0}: Error finding container c66c86c97691766bbf8ec8329b62fc8ea95edb81243783bf740f6ae4efd67a64: Status 404 returned error can't find the container with id c66c86c97691766bbf8ec8329b62fc8ea95edb81243783bf740f6ae4efd67a64 Sep 10 04:28:03.031271 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:03.031194 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh2vv" event={"ID":"1a83e291-e5e5-4bd0-b771-447b737c1540","Type":"ContainerStarted","Data":"b86123caca91527cf59a1d7f3a1bfe394cddb6d954e20062c398a788c8303f49"} Sep 10 04:28:03.031271 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:03.031254 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh2vv" event={"ID":"1a83e291-e5e5-4bd0-b771-447b737c1540","Type":"ContainerStarted","Data":"c66c86c97691766bbf8ec8329b62fc8ea95edb81243783bf740f6ae4efd67a64"} Sep 10 04:28:04.035569 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.035531 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh2vv" event={"ID":"1a83e291-e5e5-4bd0-b771-447b737c1540","Type":"ContainerStarted","Data":"d118447c1ce94d59404a34cce3488b2a3178b25d71a5d1d498e2a461432fe4f1"} Sep 10 04:28:04.224568 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.224535 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-gtqbl"] Sep 10 04:28:04.227378 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.227362 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.230024 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.230004 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 04:28:04.231326 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.231308 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 04:28:04.231418 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.231330 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 04:28:04.231479 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.231424 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 04:28:04.231479 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.231441 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9nnqh\"" Sep 10 04:28:04.231479 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.231440 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 04:28:04.235579 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.235561 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-gtqbl"] Sep 10 04:28:04.337804 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.337772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/599492a4-4be5-4470-b54d-ad4024fdf39a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.337968 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.337819 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/599492a4-4be5-4470-b54d-ad4024fdf39a-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.337968 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.337847 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6785\" (UniqueName: \"kubernetes.io/projected/599492a4-4be5-4470-b54d-ad4024fdf39a-kube-api-access-j6785\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.337968 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.337907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/599492a4-4be5-4470-b54d-ad4024fdf39a-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.439064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.439030 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/599492a4-4be5-4470-b54d-ad4024fdf39a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.439064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.439061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/599492a4-4be5-4470-b54d-ad4024fdf39a-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.439295 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.439081 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6785\" (UniqueName: \"kubernetes.io/projected/599492a4-4be5-4470-b54d-ad4024fdf39a-kube-api-access-j6785\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.439295 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.439124 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/599492a4-4be5-4470-b54d-ad4024fdf39a-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.439295 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:28:04.439272 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 10 04:28:04.439448 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:28:04.439334 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599492a4-4be5-4470-b54d-ad4024fdf39a-prometheus-operator-tls podName:599492a4-4be5-4470-b54d-ad4024fdf39a nodeName:}" failed. No retries permitted until 2026-09-10 04:28:04.93931307 +0000 UTC m=+114.876224521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/599492a4-4be5-4470-b54d-ad4024fdf39a-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-gtqbl" (UID: "599492a4-4be5-4470-b54d-ad4024fdf39a") : secret "prometheus-operator-tls" not found Sep 10 04:28:04.440031 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.440007 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/599492a4-4be5-4470-b54d-ad4024fdf39a-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.441793 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.441765 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/599492a4-4be5-4470-b54d-ad4024fdf39a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.448087 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.448068 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6785\" (UniqueName: \"kubernetes.io/projected/599492a4-4be5-4470-b54d-ad4024fdf39a-kube-api-access-j6785\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.941709 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.941666 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/599492a4-4be5-4470-b54d-ad4024fdf39a-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:04.944511 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:04.944480 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/599492a4-4be5-4470-b54d-ad4024fdf39a-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-gtqbl\" (UID: \"599492a4-4be5-4470-b54d-ad4024fdf39a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:05.136825 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.136803 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" Sep 10 04:28:05.348823 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.348801 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:28:05.407860 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.407832 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-gtqbl"] Sep 10 04:28:05.410603 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:28:05.410576 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599492a4_4be5_4470_b54d_ad4024fdf39a.slice/crio-4aff7a44f1ede4438dbba050c3926b56a87d0d4e08c3c84094a862243827429b WatchSource:0}: Error finding container 4aff7a44f1ede4438dbba050c3926b56a87d0d4e08c3c84094a862243827429b: Status 404 returned error can't find the container with id 4aff7a44f1ede4438dbba050c3926b56a87d0d4e08c3c84094a862243827429b Sep 10 04:28:05.554065 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.554040 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f98b97cfc-wsprt"] Sep 10 04:28:05.557095 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.557076 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.559928 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.559908 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 04:28:05.560032 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.559908 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 04:28:05.560032 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.559993 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 04:28:05.560175 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.560144 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 04:28:05.560240 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.560226 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w75vm\"" Sep 10 04:28:05.560286 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.560270 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 04:28:05.560468 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.560456 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 04:28:05.560510 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.560494 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 04:28:05.568108 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.568090 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f98b97cfc-wsprt"] Sep 10 04:28:05.647087 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.647032 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hj9z\" (UniqueName: \"kubernetes.io/projected/537669bf-e18c-485b-9a6b-058304d8f9f6-kube-api-access-4hj9z\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.647087 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.647060 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-oauth-config\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.647252 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.647089 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-serving-cert\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.647252 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.647115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-oauth-serving-cert\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.647252 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.647201 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-service-ca\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.647252 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.647223 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-console-config\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.747506 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.747482 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-service-ca\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.747594 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.747513 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-console-config\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.747594 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.747537 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hj9z\" (UniqueName: \"kubernetes.io/projected/537669bf-e18c-485b-9a6b-058304d8f9f6-kube-api-access-4hj9z\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.747594 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.747554 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-oauth-config\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.747594 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.747588 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-serving-cert\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.747734 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.747622 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-oauth-serving-cert\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.748323 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.748298 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-console-config\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.748415 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.748395 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-oauth-serving-cert\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.748469 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.748394 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-service-ca\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.749952 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.749930 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-serving-cert\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.750031 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.749934 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-oauth-config\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.756414 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.756391 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hj9z\" (UniqueName: \"kubernetes.io/projected/537669bf-e18c-485b-9a6b-058304d8f9f6-kube-api-access-4hj9z\") pod \"console-5f98b97cfc-wsprt\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:05.866674 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:05.866649 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:06.044541 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:06.044498 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" event={"ID":"599492a4-4be5-4470-b54d-ad4024fdf39a","Type":"ContainerStarted","Data":"4aff7a44f1ede4438dbba050c3926b56a87d0d4e08c3c84094a862243827429b"} Sep 10 04:28:06.047034 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:06.047005 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh2vv" event={"ID":"1a83e291-e5e5-4bd0-b771-447b737c1540","Type":"ContainerStarted","Data":"2a6f25090760cebbc0272c3c0907bd50c809c1a306f233530639b617ba964f7b"} Sep 10 04:28:06.066682 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:06.066638 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kh2vv" podStartSLOduration=33.756079767 podStartE2EDuration="36.066622247s" totalImagesPullingTime="2.31054248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:27:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:06.065312121 +0000 UTC m=+116.002223596" watchObservedRunningTime="2026-09-10 04:28:06.066622247 +0000 UTC m=+116.003533720" Sep 10 04:28:06.132726 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:06.132695 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f98b97cfc-wsprt"] Sep 10 04:28:06.135630 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:28:06.135598 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537669bf_e18c_485b_9a6b_058304d8f9f6.slice/crio-472e1de28af416d681521883ff837a217867dc067518be5deb58b2e7f9a00b36 WatchSource:0}: Error finding container 472e1de28af416d681521883ff837a217867dc067518be5deb58b2e7f9a00b36: Status 404 returned error can't find the container with id 472e1de28af416d681521883ff837a217867dc067518be5deb58b2e7f9a00b36 Sep 10 04:28:07.052235 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:07.052201 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f98b97cfc-wsprt" event={"ID":"537669bf-e18c-485b-9a6b-058304d8f9f6","Type":"ContainerStarted","Data":"472e1de28af416d681521883ff837a217867dc067518be5deb58b2e7f9a00b36"} Sep 10 04:28:07.054397 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:07.054357 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" event={"ID":"599492a4-4be5-4470-b54d-ad4024fdf39a","Type":"ContainerStarted","Data":"af5effc90e5c2abb8807a48a3be7904baece39a68f08560c208b0baefcb1e283"} Sep 10 04:28:07.054501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:07.054424 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" event={"ID":"599492a4-4be5-4470-b54d-ad4024fdf39a","Type":"ContainerStarted","Data":"efea7b2a53aec97930baed3a132d783b9395a474ed0649d7d9b121515943c526"} Sep 10 04:28:07.072155 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:07.072101 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-gtqbl" podStartSLOduration=1.692543624 podStartE2EDuration="3.072086597s" totalImagesPullingTime="1.379542973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:07.071124526 +0000 UTC m=+117.008035999" watchObservedRunningTime="2026-09-10 04:28:07.072086597 +0000 UTC m=+117.008998069" Sep 10 04:28:08.642112 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.642080 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nnzj5"] Sep 10 04:28:08.646014 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.645989 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.649894 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.649869 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 04:28:08.650012 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.649892 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 04:28:08.650012 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.649869 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sltvl\"" Sep 10 04:28:08.650012 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.649923 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 04:28:08.771572 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.771529 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-wtmp\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.771755 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.771586 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-textfile\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.771755 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.771644 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c689236-c827-4aab-a0fd-2fa35950729c-root\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.771755 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.771675 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.771921 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.771751 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c689236-c827-4aab-a0fd-2fa35950729c-metrics-client-ca\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.771921 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.771815 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.771921 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.771873 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-tls\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.771921 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.771899 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmxjx\" (UniqueName: \"kubernetes.io/projected/6c689236-c827-4aab-a0fd-2fa35950729c-kube-api-access-vmxjx\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.771921 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.771917 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c689236-c827-4aab-a0fd-2fa35950729c-sys\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.872940 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.872900 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-wtmp\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873089 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.872952 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-textfile\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873089 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.872991 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c689236-c827-4aab-a0fd-2fa35950729c-root\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873089 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873028 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873089 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873072 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c689236-c827-4aab-a0fd-2fa35950729c-root\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873315 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873099 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-wtmp\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873315 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873124 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c689236-c827-4aab-a0fd-2fa35950729c-metrics-client-ca\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873315 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873156 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873315 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873211 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-tls\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873315 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873236 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmxjx\" (UniqueName: \"kubernetes.io/projected/6c689236-c827-4aab-a0fd-2fa35950729c-kube-api-access-vmxjx\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873315 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873264 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c689236-c827-4aab-a0fd-2fa35950729c-sys\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873609 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873336 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-textfile\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873609 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:28:08.873351 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 04:28:08.873609 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873344 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c689236-c827-4aab-a0fd-2fa35950729c-sys\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873609 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:28:08.873421 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-tls podName:6c689236-c827-4aab-a0fd-2fa35950729c nodeName:}" failed. No retries permitted until 2026-09-10 04:28:09.37340069 +0000 UTC m=+119.310312155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-tls") pod "node-exporter-nnzj5" (UID: "6c689236-c827-4aab-a0fd-2fa35950729c") : secret "node-exporter-tls" not found Sep 10 04:28:08.873819 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873652 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.873819 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.873780 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c689236-c827-4aab-a0fd-2fa35950729c-metrics-client-ca\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.875892 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.875868 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:08.885355 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:08.885333 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmxjx\" (UniqueName: \"kubernetes.io/projected/6c689236-c827-4aab-a0fd-2fa35950729c-kube-api-access-vmxjx\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:09.378012 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:09.377984 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-tls\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:09.378155 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:28:09.378133 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 04:28:09.378237 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:28:09.378210 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-tls podName:6c689236-c827-4aab-a0fd-2fa35950729c nodeName:}" failed. No retries permitted until 2026-09-10 04:28:10.378193458 +0000 UTC m=+120.315104910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-tls") pod "node-exporter-nnzj5" (UID: "6c689236-c827-4aab-a0fd-2fa35950729c") : secret "node-exporter-tls" not found Sep 10 04:28:10.066584 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:10.066549 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f98b97cfc-wsprt" event={"ID":"537669bf-e18c-485b-9a6b-058304d8f9f6","Type":"ContainerStarted","Data":"80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9"} Sep 10 04:28:10.084645 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:10.084584 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f98b97cfc-wsprt" podStartSLOduration=1.889774324 podStartE2EDuration="5.084568332s" totalImagesPullingTime="3.194794008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:10.083309063 +0000 UTC m=+120.020220535" watchObservedRunningTime="2026-09-10 04:28:10.084568332 +0000 UTC m=+120.021479804" Sep 10 04:28:10.386625 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:10.386538 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-tls\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:10.389031 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:10.389006 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c689236-c827-4aab-a0fd-2fa35950729c-node-exporter-tls\") pod \"node-exporter-nnzj5\" (UID: \"6c689236-c827-4aab-a0fd-2fa35950729c\") " pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:10.459434 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:10.459405 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sltvl\"" Sep 10 04:28:10.466826 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:10.466806 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nnzj5" Sep 10 04:28:10.479791 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:28:10.479768 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c689236_c827_4aab_a0fd_2fa35950729c.slice/crio-c2a635cae97b5e3439841d1849b7dd6418de69b95b81a0e80e0f505b91328c7a WatchSource:0}: Error finding container c2a635cae97b5e3439841d1849b7dd6418de69b95b81a0e80e0f505b91328c7a: Status 404 returned error can't find the container with id c2a635cae97b5e3439841d1849b7dd6418de69b95b81a0e80e0f505b91328c7a Sep 10 04:28:11.071043 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.071011 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnzj5" event={"ID":"6c689236-c827-4aab-a0fd-2fa35950729c","Type":"ContainerStarted","Data":"c2a635cae97b5e3439841d1849b7dd6418de69b95b81a0e80e0f505b91328c7a"} Sep 10 04:28:11.190222 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.190189 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-755db59689-685vz"] Sep 10 04:28:11.195154 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.195121 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.205778 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.205749 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 04:28:11.206878 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.206837 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755db59689-685vz"] Sep 10 04:28:11.294455 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.294417 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-oauth-serving-cert\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.294607 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.294469 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-serving-cert\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.294607 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.294508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-config\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.294607 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.294535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvvpq\" (UniqueName: \"kubernetes.io/projected/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-kube-api-access-kvvpq\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.294607 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.294564 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-service-ca\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.294607 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.294587 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-trusted-ca-bundle\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.294803 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.294663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-oauth-config\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.395198 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.395116 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-serving-cert\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.395198 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.395157 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-config\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.395381 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.395198 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvpq\" (UniqueName: \"kubernetes.io/projected/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-kube-api-access-kvvpq\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.395381 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.395220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-service-ca\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.395381 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.395243 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-trusted-ca-bundle\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.395381 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.395322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-oauth-config\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.395381 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.395357 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-oauth-serving-cert\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.396402 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.396086 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-oauth-serving-cert\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.396402 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.396110 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-config\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.396402 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.396312 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-service-ca\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.396402 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.396337 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-trusted-ca-bundle\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.398362 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.398338 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-serving-cert\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.398443 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.398380 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-oauth-config\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.404905 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.404883 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvvpq\" (UniqueName: \"kubernetes.io/projected/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-kube-api-access-kvvpq\") pod \"console-755db59689-685vz\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.508103 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.508003 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:11.839676 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:11.839650 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755db59689-685vz"] Sep 10 04:28:11.841627 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:28:11.841602 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ce55e6_1c6e_40c4_8bc2_a9aac2480523.slice/crio-331c951ed0266eb6af7c97f5b2ab41d8502014aff71a1be68cb9d218b8840c28 WatchSource:0}: Error finding container 331c951ed0266eb6af7c97f5b2ab41d8502014aff71a1be68cb9d218b8840c28: Status 404 returned error can't find the container with id 331c951ed0266eb6af7c97f5b2ab41d8502014aff71a1be68cb9d218b8840c28 Sep 10 04:28:12.075897 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:12.075859 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755db59689-685vz" event={"ID":"34ce55e6-1c6e-40c4-8bc2-a9aac2480523","Type":"ContainerStarted","Data":"9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141"} Sep 10 04:28:12.076332 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:12.075912 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755db59689-685vz" event={"ID":"34ce55e6-1c6e-40c4-8bc2-a9aac2480523","Type":"ContainerStarted","Data":"331c951ed0266eb6af7c97f5b2ab41d8502014aff71a1be68cb9d218b8840c28"} Sep 10 04:28:12.077528 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:12.077504 2555 generic.go:356] "Generic (PLEG): container finished" podID="6c689236-c827-4aab-a0fd-2fa35950729c" containerID="b089c4927bda3aa922ffc8ff342f7377c0fe5723ddab1c1bf6e9407d93cec721" exitCode=0 Sep 10 04:28:12.077630 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:12.077539 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnzj5" event={"ID":"6c689236-c827-4aab-a0fd-2fa35950729c","Type":"ContainerDied","Data":"b089c4927bda3aa922ffc8ff342f7377c0fe5723ddab1c1bf6e9407d93cec721"} Sep 10 04:28:12.092964 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:12.092907 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-755db59689-685vz" podStartSLOduration=1.092890305 podStartE2EDuration="1.092890305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:12.092521346 +0000 UTC m=+122.029432823" watchObservedRunningTime="2026-09-10 04:28:12.092890305 +0000 UTC m=+122.029801779" Sep 10 04:28:13.083496 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:13.083460 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnzj5" event={"ID":"6c689236-c827-4aab-a0fd-2fa35950729c","Type":"ContainerStarted","Data":"a258427cc17e0f797eb13cc8ff8430412416688831c785ea849f54eb117db361"} Sep 10 04:28:13.083919 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:13.083517 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnzj5" event={"ID":"6c689236-c827-4aab-a0fd-2fa35950729c","Type":"ContainerStarted","Data":"efcb4477b5e39e25dc13a3a2a8a0aa69a6e58913819a981b24de0d8c82372ae8"} Sep 10 04:28:13.106179 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:13.106113 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nnzj5" podStartSLOduration=3.902336559 podStartE2EDuration="5.106097655s" totalImagesPullingTime="1.140777779s" totalInitContainerRuntime="62.983317ms" isStatefulPod=true podCreationTimestamp="2026-09-10 04:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:13.105250746 +0000 UTC m=+123.042162219" watchObservedRunningTime="2026-09-10 04:28:13.106097655 +0000 UTC m=+123.043009127" Sep 10 04:28:14.195627 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.195594 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f98b97cfc-wsprt"] Sep 10 04:28:14.222150 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.222121 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c7bc48678-fxzjr"] Sep 10 04:28:14.225348 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.225326 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.236290 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.236268 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7bc48678-fxzjr"] Sep 10 04:28:14.319567 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.319538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-serving-cert\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.319688 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.319572 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-trusted-ca-bundle\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.319688 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.319594 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-service-ca\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.319823 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.319694 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-config\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.319823 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.319728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkbcp\" (UniqueName: \"kubernetes.io/projected/7f1d2216-fbfe-4ee7-8059-6e6127d94474-kube-api-access-xkbcp\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.319823 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.319769 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-oauth-config\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.319823 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.319793 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-oauth-serving-cert\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.420483 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.420450 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-trusted-ca-bundle\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.420483 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.420485 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-service-ca\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.420646 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.420623 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-config\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.420683 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.420663 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkbcp\" (UniqueName: \"kubernetes.io/projected/7f1d2216-fbfe-4ee7-8059-6e6127d94474-kube-api-access-xkbcp\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.420716 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.420702 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-oauth-config\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.420746 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.420726 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-oauth-serving-cert\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.420785 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.420777 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-serving-cert\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.421279 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.421256 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-service-ca\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.421446 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.421424 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-trusted-ca-bundle\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.421503 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.421440 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-oauth-serving-cert\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.421503 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.421426 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-config\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.423242 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.423218 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-serving-cert\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.423316 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.423301 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-oauth-config\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.429219 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.429197 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkbcp\" (UniqueName: \"kubernetes.io/projected/7f1d2216-fbfe-4ee7-8059-6e6127d94474-kube-api-access-xkbcp\") pod \"console-7c7bc48678-fxzjr\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.534223 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.534129 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:14.814545 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:14.814499 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7bc48678-fxzjr"] Sep 10 04:28:15.094036 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:15.093943 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7bc48678-fxzjr" event={"ID":"7f1d2216-fbfe-4ee7-8059-6e6127d94474","Type":"ContainerStarted","Data":"cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef"} Sep 10 04:28:15.094036 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:15.093991 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7bc48678-fxzjr" event={"ID":"7f1d2216-fbfe-4ee7-8059-6e6127d94474","Type":"ContainerStarted","Data":"7e689eb741e662c46b4d5ab5eeb93f9a3dfa09990cd6303f6f2b4e9617b6643e"} Sep 10 04:28:15.112065 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:15.111999 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c7bc48678-fxzjr" podStartSLOduration=1.111975634 podStartE2EDuration="1.111975634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:15.111338134 +0000 UTC m=+125.048249620" watchObservedRunningTime="2026-09-10 04:28:15.111975634 +0000 UTC m=+125.048887112" Sep 10 04:28:15.866800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:15.866766 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:18.014053 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:18.014022 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c7b65bd4d-6scs2" Sep 10 04:28:20.274001 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.273966 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:28:20.276182 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.276150 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348378a-58b7-43b0-9e14-76c8a8ba1679-metrics-certs\") pod \"network-metrics-daemon-clrgs\" (UID: \"a348378a-58b7-43b0-9e14-76c8a8ba1679\") " pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:28:20.362896 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.362852 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" podUID="f4dd7f8a-5820-489a-a882-31812ab61b94" containerName="registry" containerID="cri-o://97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13" gracePeriod=30 Sep 10 04:28:20.396719 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.396700 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lmcvv\"" Sep 10 04:28:20.404002 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.403989 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-clrgs" Sep 10 04:28:20.592300 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.592279 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:28:20.667599 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.667567 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-clrgs"] Sep 10 04:28:20.670261 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:28:20.670231 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda348378a_58b7_43b0_9e14_76c8a8ba1679.slice/crio-b2792492a1fbb285951aa4eb8bbc4cdfac423105144ec402debe574353783bd7 WatchSource:0}: Error finding container b2792492a1fbb285951aa4eb8bbc4cdfac423105144ec402debe574353783bd7: Status 404 returned error can't find the container with id b2792492a1fbb285951aa4eb8bbc4cdfac423105144ec402debe574353783bd7 Sep 10 04:28:20.676713 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.676693 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-installation-pull-secrets\") pod \"f4dd7f8a-5820-489a-a882-31812ab61b94\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " Sep 10 04:28:20.676851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.676727 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls\") pod \"f4dd7f8a-5820-489a-a882-31812ab61b94\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " Sep 10 04:28:20.676851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.676748 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-certificates\") pod \"f4dd7f8a-5820-489a-a882-31812ab61b94\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " Sep 10 04:28:20.676851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.676786 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-bound-sa-token\") pod \"f4dd7f8a-5820-489a-a882-31812ab61b94\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " Sep 10 04:28:20.676851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.676819 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4dd7f8a-5820-489a-a882-31812ab61b94-ca-trust-extracted\") pod \"f4dd7f8a-5820-489a-a882-31812ab61b94\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " Sep 10 04:28:20.676851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.676844 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsrld\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-kube-api-access-vsrld\") pod \"f4dd7f8a-5820-489a-a882-31812ab61b94\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " Sep 10 04:28:20.677113 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.676878 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-trusted-ca\") pod \"f4dd7f8a-5820-489a-a882-31812ab61b94\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " Sep 10 04:28:20.677113 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.676915 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-image-registry-private-configuration\") pod \"f4dd7f8a-5820-489a-a882-31812ab61b94\" (UID: \"f4dd7f8a-5820-489a-a882-31812ab61b94\") " Sep 10 04:28:20.677646 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.677375 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f4dd7f8a-5820-489a-a882-31812ab61b94" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:28:20.677877 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.677853 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f4dd7f8a-5820-489a-a882-31812ab61b94" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:28:20.679371 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.679347 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f4dd7f8a-5820-489a-a882-31812ab61b94" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:28:20.679371 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.679336 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f4dd7f8a-5820-489a-a882-31812ab61b94" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:28:20.679524 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.679398 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f4dd7f8a-5820-489a-a882-31812ab61b94" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:28:20.679524 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.679476 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-kube-api-access-vsrld" (OuterVolumeSpecName: "kube-api-access-vsrld") pod "f4dd7f8a-5820-489a-a882-31812ab61b94" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94"). InnerVolumeSpecName "kube-api-access-vsrld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:28:20.679524 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.679495 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f4dd7f8a-5820-489a-a882-31812ab61b94" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:28:20.685344 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.685321 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4dd7f8a-5820-489a-a882-31812ab61b94-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f4dd7f8a-5820-489a-a882-31812ab61b94" (UID: "f4dd7f8a-5820-489a-a882-31812ab61b94"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:28:20.778010 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.777983 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-installation-pull-secrets\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:20.778010 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.778007 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-tls\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:20.778131 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.778023 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-registry-certificates\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:20.778131 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.778034 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-bound-sa-token\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:20.778131 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.778047 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4dd7f8a-5820-489a-a882-31812ab61b94-ca-trust-extracted\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:20.778131 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.778058 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsrld\" (UniqueName: \"kubernetes.io/projected/f4dd7f8a-5820-489a-a882-31812ab61b94-kube-api-access-vsrld\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:20.778131 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.778070 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4dd7f8a-5820-489a-a882-31812ab61b94-trusted-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:20.778131 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:20.778084 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4dd7f8a-5820-489a-a882-31812ab61b94-image-registry-private-configuration\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:21.119906 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.119861 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-clrgs" event={"ID":"a348378a-58b7-43b0-9e14-76c8a8ba1679","Type":"ContainerStarted","Data":"b2792492a1fbb285951aa4eb8bbc4cdfac423105144ec402debe574353783bd7"} Sep 10 04:28:21.121299 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.121264 2555 generic.go:356] "Generic (PLEG): container finished" podID="f4dd7f8a-5820-489a-a882-31812ab61b94" containerID="97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13" exitCode=0 Sep 10 04:28:21.121416 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.121309 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" event={"ID":"f4dd7f8a-5820-489a-a882-31812ab61b94","Type":"ContainerDied","Data":"97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13"} Sep 10 04:28:21.121416 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.121325 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" Sep 10 04:28:21.121416 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.121365 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-746bcbfcc7-f2pkt" event={"ID":"f4dd7f8a-5820-489a-a882-31812ab61b94","Type":"ContainerDied","Data":"1aef3ceb8a49e08e50ea01b7473f2c9490a5ef7752b2525077d7b788d6ae1ec1"} Sep 10 04:28:21.121416 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.121394 2555 scope.go:117] "RemoveContainer" containerID="97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13" Sep 10 04:28:21.131196 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.131121 2555 scope.go:117] "RemoveContainer" containerID="97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13" Sep 10 04:28:21.131507 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:28:21.131482 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13\": container with ID starting with 97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13 not found: ID does not exist" containerID="97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13" Sep 10 04:28:21.131604 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.131513 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13"} err="failed to get container status \"97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13\": rpc error: code = NotFound desc = could not find container \"97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13\": container with ID starting with 97dd2416048cae98bd6492659378ea82045e42f1a8a4b4d4f6613531410e8f13 not found: ID does not exist" Sep 10 04:28:21.151495 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.151467 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-746bcbfcc7-f2pkt"] Sep 10 04:28:21.154850 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.154826 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-746bcbfcc7-f2pkt"] Sep 10 04:28:21.509055 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.508976 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:21.509467 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.509071 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:21.515612 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:21.515586 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:22.129179 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:22.129132 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-clrgs" event={"ID":"a348378a-58b7-43b0-9e14-76c8a8ba1679","Type":"ContainerStarted","Data":"914cb2b43ee5cffc55d9f1e5168513a644bd45d75eba0d96b47bc442f749be0a"} Sep 10 04:28:22.129348 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:22.129218 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-clrgs" event={"ID":"a348378a-58b7-43b0-9e14-76c8a8ba1679","Type":"ContainerStarted","Data":"8f3ee04193f43bdcac14d619ea5e00ce9ab064d3c6387946adfca5b7f649a7c8"} Sep 10 04:28:22.133956 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:22.133931 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:22.157307 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:22.157265 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-clrgs" podStartSLOduration=130.22305263 podStartE2EDuration="2m11.157252344s" totalImagesPullingTime="934.199714ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:22.156332374 +0000 UTC m=+132.093243850" watchObservedRunningTime="2026-09-10 04:28:22.157252344 +0000 UTC m=+132.094163816" Sep 10 04:28:22.546687 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:22.546618 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4dd7f8a-5820-489a-a882-31812ab61b94" path="/var/lib/kubelet/pods/f4dd7f8a-5820-489a-a882-31812ab61b94/volumes" Sep 10 04:28:24.534668 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:24.534631 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:24.535045 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:24.534706 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:24.539530 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:24.539509 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:25.144507 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:25.144479 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:28:25.190968 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:25.190933 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755db59689-685vz"] Sep 10 04:28:35.184526 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:35.184432 2555 generic.go:356] "Generic (PLEG): container finished" podID="42008412-8080-44cc-b338-b5b1539b51e3" containerID="f8d24f61eeed0440a75ec91d5f53ffe3a5c75b661991bf3e7caf7d0906831cda" exitCode=0 Sep 10 04:28:35.184883 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:35.184514 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" event={"ID":"42008412-8080-44cc-b338-b5b1539b51e3","Type":"ContainerDied","Data":"f8d24f61eeed0440a75ec91d5f53ffe3a5c75b661991bf3e7caf7d0906831cda"} Sep 10 04:28:35.184883 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:35.184873 2555 scope.go:117] "RemoveContainer" containerID="f8d24f61eeed0440a75ec91d5f53ffe3a5c75b661991bf3e7caf7d0906831cda" Sep 10 04:28:36.189877 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:36.189844 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-g8vg7" event={"ID":"42008412-8080-44cc-b338-b5b1539b51e3","Type":"ContainerStarted","Data":"490654824e320de90aa2e34c3db1c31c6756d72ec9b57d892f75c7826fa42069"} Sep 10 04:28:39.214437 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.214386 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f98b97cfc-wsprt" podUID="537669bf-e18c-485b-9a6b-058304d8f9f6" containerName="console" containerID="cri-o://80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9" gracePeriod=15 Sep 10 04:28:39.518468 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.518443 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:39.620887 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.620857 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hj9z\" (UniqueName: \"kubernetes.io/projected/537669bf-e18c-485b-9a6b-058304d8f9f6-kube-api-access-4hj9z\") pod \"537669bf-e18c-485b-9a6b-058304d8f9f6\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " Sep 10 04:28:39.621034 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.620895 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-console-config\") pod \"537669bf-e18c-485b-9a6b-058304d8f9f6\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " Sep 10 04:28:39.621034 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.620920 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-service-ca\") pod \"537669bf-e18c-485b-9a6b-058304d8f9f6\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " Sep 10 04:28:39.621034 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.620944 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-oauth-serving-cert\") pod \"537669bf-e18c-485b-9a6b-058304d8f9f6\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " Sep 10 04:28:39.621034 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.620981 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-serving-cert\") pod \"537669bf-e18c-485b-9a6b-058304d8f9f6\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " Sep 10 04:28:39.621240 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.621041 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-oauth-config\") pod \"537669bf-e18c-485b-9a6b-058304d8f9f6\" (UID: \"537669bf-e18c-485b-9a6b-058304d8f9f6\") " Sep 10 04:28:39.621503 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.621355 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "537669bf-e18c-485b-9a6b-058304d8f9f6" (UID: "537669bf-e18c-485b-9a6b-058304d8f9f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:28:39.621503 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.621368 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-console-config" (OuterVolumeSpecName: "console-config") pod "537669bf-e18c-485b-9a6b-058304d8f9f6" (UID: "537669bf-e18c-485b-9a6b-058304d8f9f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:28:39.621503 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.621390 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "537669bf-e18c-485b-9a6b-058304d8f9f6" (UID: "537669bf-e18c-485b-9a6b-058304d8f9f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:28:39.623224 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.623201 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/537669bf-e18c-485b-9a6b-058304d8f9f6-kube-api-access-4hj9z" (OuterVolumeSpecName: "kube-api-access-4hj9z") pod "537669bf-e18c-485b-9a6b-058304d8f9f6" (UID: "537669bf-e18c-485b-9a6b-058304d8f9f6"). InnerVolumeSpecName "kube-api-access-4hj9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:28:39.623224 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.623210 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "537669bf-e18c-485b-9a6b-058304d8f9f6" (UID: "537669bf-e18c-485b-9a6b-058304d8f9f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:28:39.623322 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.623281 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "537669bf-e18c-485b-9a6b-058304d8f9f6" (UID: "537669bf-e18c-485b-9a6b-058304d8f9f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:28:39.722313 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.722290 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-oauth-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:39.722313 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.722313 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hj9z\" (UniqueName: \"kubernetes.io/projected/537669bf-e18c-485b-9a6b-058304d8f9f6-kube-api-access-4hj9z\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:39.722429 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.722323 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-console-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:39.722429 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.722331 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-service-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:39.722429 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.722339 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/537669bf-e18c-485b-9a6b-058304d8f9f6-oauth-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:39.722429 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:39.722347 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/537669bf-e18c-485b-9a6b-058304d8f9f6-console-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:40.205725 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.205685 2555 generic.go:356] "Generic (PLEG): container finished" podID="537669bf-e18c-485b-9a6b-058304d8f9f6" containerID="80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9" exitCode=0 Sep 10 04:28:40.205917 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.205734 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f98b97cfc-wsprt" Sep 10 04:28:40.205917 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.205772 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f98b97cfc-wsprt" event={"ID":"537669bf-e18c-485b-9a6b-058304d8f9f6","Type":"ContainerDied","Data":"80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9"} Sep 10 04:28:40.205917 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.205830 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f98b97cfc-wsprt" event={"ID":"537669bf-e18c-485b-9a6b-058304d8f9f6","Type":"ContainerDied","Data":"472e1de28af416d681521883ff837a217867dc067518be5deb58b2e7f9a00b36"} Sep 10 04:28:40.205917 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.205859 2555 scope.go:117] "RemoveContainer" containerID="80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9" Sep 10 04:28:40.207301 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.207278 2555 generic.go:356] "Generic (PLEG): container finished" podID="fbc3e870-876e-4ef7-9c07-7402473cc2ad" containerID="3c35ffe2a97535f1dd792654076ef817ee804d67e39e125bb5a60cf1f0b09746" exitCode=0 Sep 10 04:28:40.207402 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.207356 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" event={"ID":"fbc3e870-876e-4ef7-9c07-7402473cc2ad","Type":"ContainerDied","Data":"3c35ffe2a97535f1dd792654076ef817ee804d67e39e125bb5a60cf1f0b09746"} Sep 10 04:28:40.207729 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.207712 2555 scope.go:117] "RemoveContainer" containerID="3c35ffe2a97535f1dd792654076ef817ee804d67e39e125bb5a60cf1f0b09746" Sep 10 04:28:40.223128 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.223110 2555 scope.go:117] "RemoveContainer" containerID="80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9" Sep 10 04:28:40.223426 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:28:40.223403 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9\": container with ID starting with 80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9 not found: ID does not exist" containerID="80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9" Sep 10 04:28:40.223469 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.223438 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9"} err="failed to get container status \"80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9\": rpc error: code = NotFound desc = could not find container \"80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9\": container with ID starting with 80a3897446f8603f62ed79ae19ea35bf2329f8abdff7e18fee67af3f1abedea9 not found: ID does not exist" Sep 10 04:28:40.242785 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.242761 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f98b97cfc-wsprt"] Sep 10 04:28:40.249012 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.248990 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f98b97cfc-wsprt"] Sep 10 04:28:40.547452 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:40.547379 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="537669bf-e18c-485b-9a6b-058304d8f9f6" path="/var/lib/kubelet/pods/537669bf-e18c-485b-9a6b-058304d8f9f6/volumes" Sep 10 04:28:41.213221 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:41.213187 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g5xl" event={"ID":"fbc3e870-876e-4ef7-9c07-7402473cc2ad","Type":"ContainerStarted","Data":"afe6f8ba443db533a36d4dee0b78ff6fcaf959f9c21bfce7b7b1b2bfad47841f"} Sep 10 04:28:50.209604 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.209557 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-755db59689-685vz" podUID="34ce55e6-1c6e-40c4-8bc2-a9aac2480523" containerName="console" containerID="cri-o://9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141" gracePeriod=15 Sep 10 04:28:50.441616 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.441592 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:50.598606 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.598576 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-serving-cert\") pod \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " Sep 10 04:28:50.598735 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.598652 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-trusted-ca-bundle\") pod \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " Sep 10 04:28:50.598735 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.598687 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-service-ca\") pod \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " Sep 10 04:28:50.598735 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.598720 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-oauth-config\") pod \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " Sep 10 04:28:50.598901 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.598880 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvvpq\" (UniqueName: \"kubernetes.io/projected/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-kube-api-access-kvvpq\") pod \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " Sep 10 04:28:50.598960 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.598924 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-oauth-serving-cert\") pod \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " Sep 10 04:28:50.599004 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.598959 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-config\") pod \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\" (UID: \"34ce55e6-1c6e-40c4-8bc2-a9aac2480523\") " Sep 10 04:28:50.599109 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.599082 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-service-ca" (OuterVolumeSpecName: "service-ca") pod "34ce55e6-1c6e-40c4-8bc2-a9aac2480523" (UID: "34ce55e6-1c6e-40c4-8bc2-a9aac2480523"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:28:50.599238 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.599205 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "34ce55e6-1c6e-40c4-8bc2-a9aac2480523" (UID: "34ce55e6-1c6e-40c4-8bc2-a9aac2480523"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:28:50.599323 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.599305 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-trusted-ca-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:50.599477 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.599458 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-service-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:50.599477 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.599273 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "34ce55e6-1c6e-40c4-8bc2-a9aac2480523" (UID: "34ce55e6-1c6e-40c4-8bc2-a9aac2480523"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:28:50.599616 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.599413 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-config" (OuterVolumeSpecName: "console-config") pod "34ce55e6-1c6e-40c4-8bc2-a9aac2480523" (UID: "34ce55e6-1c6e-40c4-8bc2-a9aac2480523"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:28:50.600922 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.600898 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-kube-api-access-kvvpq" (OuterVolumeSpecName: "kube-api-access-kvvpq") pod "34ce55e6-1c6e-40c4-8bc2-a9aac2480523" (UID: "34ce55e6-1c6e-40c4-8bc2-a9aac2480523"). InnerVolumeSpecName "kube-api-access-kvvpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:28:50.601208 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.601188 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "34ce55e6-1c6e-40c4-8bc2-a9aac2480523" (UID: "34ce55e6-1c6e-40c4-8bc2-a9aac2480523"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:28:50.601278 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.601231 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "34ce55e6-1c6e-40c4-8bc2-a9aac2480523" (UID: "34ce55e6-1c6e-40c4-8bc2-a9aac2480523"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:28:50.700542 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.700512 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:50.700542 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.700538 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-oauth-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:50.700542 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.700548 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvvpq\" (UniqueName: \"kubernetes.io/projected/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-kube-api-access-kvvpq\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:50.700734 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.700556 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-oauth-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:50.700734 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:50.700565 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34ce55e6-1c6e-40c4-8bc2-a9aac2480523-console-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:28:51.252374 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:51.252331 2555 generic.go:356] "Generic (PLEG): container finished" podID="34ce55e6-1c6e-40c4-8bc2-a9aac2480523" containerID="9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141" exitCode=0 Sep 10 04:28:51.252820 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:51.252396 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755db59689-685vz" Sep 10 04:28:51.252820 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:51.252417 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755db59689-685vz" event={"ID":"34ce55e6-1c6e-40c4-8bc2-a9aac2480523","Type":"ContainerDied","Data":"9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141"} Sep 10 04:28:51.252820 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:51.252485 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755db59689-685vz" event={"ID":"34ce55e6-1c6e-40c4-8bc2-a9aac2480523","Type":"ContainerDied","Data":"331c951ed0266eb6af7c97f5b2ab41d8502014aff71a1be68cb9d218b8840c28"} Sep 10 04:28:51.252820 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:51.252517 2555 scope.go:117] "RemoveContainer" containerID="9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141" Sep 10 04:28:51.260745 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:51.260726 2555 scope.go:117] "RemoveContainer" containerID="9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141" Sep 10 04:28:51.261004 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:28:51.260985 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141\": container with ID starting with 9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141 not found: ID does not exist" containerID="9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141" Sep 10 04:28:51.261041 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:51.261012 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141"} err="failed to get container status \"9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141\": rpc error: code = NotFound desc = could not find container \"9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141\": container with ID starting with 9cfe0ec63cbee466215b005fba31883d869e20e343e83b03c4e4915f85735141 not found: ID does not exist" Sep 10 04:28:51.273070 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:51.273048 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755db59689-685vz"] Sep 10 04:28:51.275133 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:51.275112 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-755db59689-685vz"] Sep 10 04:28:52.547985 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:28:52.547952 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34ce55e6-1c6e-40c4-8bc2-a9aac2480523" path="/var/lib/kubelet/pods/34ce55e6-1c6e-40c4-8bc2-a9aac2480523/volumes" Sep 10 04:29:30.373351 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.373299 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 04:29:30.373866 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.373666 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4dd7f8a-5820-489a-a882-31812ab61b94" containerName="registry" Sep 10 04:29:30.373866 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.373686 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4dd7f8a-5820-489a-a882-31812ab61b94" containerName="registry" Sep 10 04:29:30.373866 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.373698 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ce55e6-1c6e-40c4-8bc2-a9aac2480523" containerName="console" Sep 10 04:29:30.373866 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.373706 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ce55e6-1c6e-40c4-8bc2-a9aac2480523" containerName="console" Sep 10 04:29:30.373866 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.373720 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="537669bf-e18c-485b-9a6b-058304d8f9f6" containerName="console" Sep 10 04:29:30.373866 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.373728 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="537669bf-e18c-485b-9a6b-058304d8f9f6" containerName="console" Sep 10 04:29:30.373866 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.373794 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="537669bf-e18c-485b-9a6b-058304d8f9f6" containerName="console" Sep 10 04:29:30.373866 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.373807 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ce55e6-1c6e-40c4-8bc2-a9aac2480523" containerName="console" Sep 10 04:29:30.373866 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.373816 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4dd7f8a-5820-489a-a882-31812ab61b94" containerName="registry" Sep 10 04:29:30.380286 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.380260 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.383142 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.383107 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 04:29:30.383142 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.383139 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 04:29:30.383331 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.383195 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 04:29:30.383386 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.383372 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 04:29:30.383441 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.383418 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 04:29:30.383541 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.383525 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zhmtz\"" Sep 10 04:29:30.383610 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.383540 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 04:29:30.383662 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.383629 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 04:29:30.383711 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.383682 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 04:29:30.386314 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386292 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386434 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386330 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386434 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386360 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc07d85f-758b-47be-b185-0fae5744d9c8-config-out\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386434 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386417 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc07d85f-758b-47be-b185-0fae5744d9c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386597 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386449 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc07d85f-758b-47be-b185-0fae5744d9c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386597 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386465 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386597 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386597 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386512 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386597 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386533 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc07d85f-758b-47be-b185-0fae5744d9c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386597 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386548 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07d85f-758b-47be-b185-0fae5744d9c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386597 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386594 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-web-config\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386929 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386613 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj7ct\" (UniqueName: \"kubernetes.io/projected/fc07d85f-758b-47be-b185-0fae5744d9c8-kube-api-access-rj7ct\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.386929 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.386628 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.388536 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.388520 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 04:29:30.395406 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.395384 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 04:29:30.487902 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.487877 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-web-config\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488017 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.487908 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj7ct\" (UniqueName: \"kubernetes.io/projected/fc07d85f-758b-47be-b185-0fae5744d9c8-kube-api-access-rj7ct\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488017 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.487927 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488017 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.487970 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488017 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.488007 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488187 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.488025 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc07d85f-758b-47be-b185-0fae5744d9c8-config-out\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488187 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.488053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc07d85f-758b-47be-b185-0fae5744d9c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488187 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.488094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc07d85f-758b-47be-b185-0fae5744d9c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488187 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.488119 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488187 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.488144 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488187 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.488180 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488460 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.488202 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc07d85f-758b-47be-b185-0fae5744d9c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488460 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.488222 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07d85f-758b-47be-b185-0fae5744d9c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.488720 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.488694 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc07d85f-758b-47be-b185-0fae5744d9c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.489613 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.489204 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07d85f-758b-47be-b185-0fae5744d9c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.491042 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.491017 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc07d85f-758b-47be-b185-0fae5744d9c8-config-out\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.491199 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.491080 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-web-config\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.491308 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.491122 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.491418 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.491211 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc07d85f-758b-47be-b185-0fae5744d9c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.491418 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.491363 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.491608 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.491513 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.492002 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.491973 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.492078 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.491987 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.492362 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.492340 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc07d85f-758b-47be-b185-0fae5744d9c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.492616 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.492597 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc07d85f-758b-47be-b185-0fae5744d9c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.496824 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.496801 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj7ct\" (UniqueName: \"kubernetes.io/projected/fc07d85f-758b-47be-b185-0fae5744d9c8-kube-api-access-rj7ct\") pod \"alertmanager-main-0\" (UID: \"fc07d85f-758b-47be-b185-0fae5744d9c8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.690998 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.690916 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.969104 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:30.969081 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 04:29:30.970904 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:29:30.970876 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc07d85f_758b_47be_b185_0fae5744d9c8.slice/crio-a640440baf5226205d88e968e6bdb7f32b6297df031a5955e232240fca6c5df2 WatchSource:0}: Error finding container a640440baf5226205d88e968e6bdb7f32b6297df031a5955e232240fca6c5df2: Status 404 returned error can't find the container with id a640440baf5226205d88e968e6bdb7f32b6297df031a5955e232240fca6c5df2 Sep 10 04:29:31.396548 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:31.396511 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc07d85f-758b-47be-b185-0fae5744d9c8","Type":"ContainerStarted","Data":"a640440baf5226205d88e968e6bdb7f32b6297df031a5955e232240fca6c5df2"} Sep 10 04:29:32.401016 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.400988 2555 generic.go:356] "Generic (PLEG): container finished" podID="fc07d85f-758b-47be-b185-0fae5744d9c8" containerID="b82f6f44a6ff97a746e073a5b90b2126665c185bcdb9c4d62e901c29062725b2" exitCode=0 Sep 10 04:29:32.401314 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.401025 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc07d85f-758b-47be-b185-0fae5744d9c8","Type":"ContainerDied","Data":"b82f6f44a6ff97a746e073a5b90b2126665c185bcdb9c4d62e901c29062725b2"} Sep 10 04:29:32.862645 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.862613 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj"] Sep 10 04:29:32.865903 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.865885 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:32.869496 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.869470 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h6l8m\"" Sep 10 04:29:32.869627 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.869528 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 04:29:32.869627 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.869470 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 04:29:32.869627 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.869563 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 04:29:32.869810 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.869714 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 04:29:32.869810 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.869805 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 04:29:32.874603 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.874584 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 04:29:32.880249 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.880226 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj"] Sep 10 04:29:32.905676 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.905638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:32.905788 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.905718 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-telemeter-client-tls\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:32.905788 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.905753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38263b90-c9a1-44b4-b303-f8c5932c475c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:32.905907 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.905882 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-secret-telemeter-client\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:32.905956 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.905940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5xbp\" (UniqueName: \"kubernetes.io/projected/38263b90-c9a1-44b4-b303-f8c5932c475c-kube-api-access-w5xbp\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:32.906005 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.905990 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-federate-client-tls\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:32.906047 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.906028 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38263b90-c9a1-44b4-b303-f8c5932c475c-metrics-client-ca\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:32.906086 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:32.906049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38263b90-c9a1-44b4-b303-f8c5932c475c-serving-certs-ca-bundle\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.006840 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.006799 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-federate-client-tls\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.007059 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.006862 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38263b90-c9a1-44b4-b303-f8c5932c475c-metrics-client-ca\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.007059 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.006888 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38263b90-c9a1-44b4-b303-f8c5932c475c-serving-certs-ca-bundle\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.007059 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.006920 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.007059 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.006959 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-telemeter-client-tls\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.007059 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.006984 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38263b90-c9a1-44b4-b303-f8c5932c475c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.007344 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.007079 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-secret-telemeter-client\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.007344 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.007119 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5xbp\" (UniqueName: \"kubernetes.io/projected/38263b90-c9a1-44b4-b303-f8c5932c475c-kube-api-access-w5xbp\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.007991 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.007925 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38263b90-c9a1-44b4-b303-f8c5932c475c-metrics-client-ca\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.008116 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.008029 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38263b90-c9a1-44b4-b303-f8c5932c475c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.008539 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.008520 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38263b90-c9a1-44b4-b303-f8c5932c475c-serving-certs-ca-bundle\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.010021 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.009991 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-federate-client-tls\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.010118 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.010031 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.010534 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.010493 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-telemeter-client-tls\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.011132 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.011108 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/38263b90-c9a1-44b4-b303-f8c5932c475c-secret-telemeter-client\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.016980 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.016960 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5xbp\" (UniqueName: \"kubernetes.io/projected/38263b90-c9a1-44b4-b303-f8c5932c475c-kube-api-access-w5xbp\") pod \"telemeter-client-7d9556c6c4-v9pxj\" (UID: \"38263b90-c9a1-44b4-b303-f8c5932c475c\") " pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.177700 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.177612 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" Sep 10 04:29:33.467687 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:33.467048 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj"] Sep 10 04:29:33.471494 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:29:33.471459 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38263b90_c9a1_44b4_b303_f8c5932c475c.slice/crio-819bae17485ca2d8a76cf2220feea876823dd7e1c027fee525572d651b204e89 WatchSource:0}: Error finding container 819bae17485ca2d8a76cf2220feea876823dd7e1c027fee525572d651b204e89: Status 404 returned error can't find the container with id 819bae17485ca2d8a76cf2220feea876823dd7e1c027fee525572d651b204e89 Sep 10 04:29:34.410934 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:34.410898 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" event={"ID":"38263b90-c9a1-44b4-b303-f8c5932c475c","Type":"ContainerStarted","Data":"819bae17485ca2d8a76cf2220feea876823dd7e1c027fee525572d651b204e89"} Sep 10 04:29:34.413994 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:34.413930 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc07d85f-758b-47be-b185-0fae5744d9c8","Type":"ContainerStarted","Data":"70d70ab3f89f577a6246336a1e26f2a441d0c812de900948291cd5f36f90a5c6"} Sep 10 04:29:34.413994 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:34.413987 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc07d85f-758b-47be-b185-0fae5744d9c8","Type":"ContainerStarted","Data":"3f6018e91143a47d3132c2dbfbf0df0547fcf530d2c3f72d1c0d1ea2962172ae"} Sep 10 04:29:34.414137 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:34.414013 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc07d85f-758b-47be-b185-0fae5744d9c8","Type":"ContainerStarted","Data":"fcaf97d50cf2a71d931bc6fdd291126cfa40810862b202d3158cda73e6d2a58d"} Sep 10 04:29:34.414137 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:34.414037 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc07d85f-758b-47be-b185-0fae5744d9c8","Type":"ContainerStarted","Data":"72df0029a76163f72e661fc3f1759f74f8eb1721eb5799b37cca9ecabd72ce1e"} Sep 10 04:29:34.414137 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:34.414061 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc07d85f-758b-47be-b185-0fae5744d9c8","Type":"ContainerStarted","Data":"b9fb24f925a5f5cc787bc0ea42a3ccd6dda866a318ac0bcba08ff9d136608887"} Sep 10 04:29:36.423308 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.423270 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" event={"ID":"38263b90-c9a1-44b4-b303-f8c5932c475c","Type":"ContainerStarted","Data":"41042a1a5fcedacf2e988386dbe9fa475b394bf29107d5f909af38c0640b32a2"} Sep 10 04:29:36.423731 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.423340 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" event={"ID":"38263b90-c9a1-44b4-b303-f8c5932c475c","Type":"ContainerStarted","Data":"e69a72b12021d2b8bcb3d9b33ca237cbc1306608209420dd137c1bd08f04759b"} Sep 10 04:29:36.423731 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.423371 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" event={"ID":"38263b90-c9a1-44b4-b303-f8c5932c475c","Type":"ContainerStarted","Data":"23dc22d9ac5f3f0b66f85bbb12bc6e0b18834fb63bce6901f9fff7cd580b239b"} Sep 10 04:29:36.426441 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.426414 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc07d85f-758b-47be-b185-0fae5744d9c8","Type":"ContainerStarted","Data":"0b5e5a42f0dfd5e8e4bcf619f5afbdf6c21fd8ba2f8dd9d37511b29bcbfa0443"} Sep 10 04:29:36.448406 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.448362 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d9556c6c4-v9pxj" podStartSLOduration=2.337008643 podStartE2EDuration="4.448349635s" totalImagesPullingTime="2.111340992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:29:36.448016913 +0000 UTC m=+206.384928386" watchObservedRunningTime="2026-09-10 04:29:36.448349635 +0000 UTC m=+206.385261108" Sep 10 04:29:36.477346 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.477296 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.323186974 podStartE2EDuration="6.477277062s" totalImagesPullingTime="4.140552372s" totalInitContainerRuntime="13.537716ms" isStatefulPod=false podCreationTimestamp="2026-09-10 04:29:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:29:36.474029777 +0000 UTC m=+206.410941251" watchObservedRunningTime="2026-09-10 04:29:36.477277062 +0000 UTC m=+206.414188535" Sep 10 04:29:36.527424 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.527397 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-585cd796c4-f4mlx"] Sep 10 04:29:36.530591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.530570 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.550074 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.550046 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585cd796c4-f4mlx"] Sep 10 04:29:36.637715 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.637688 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdrfd\" (UniqueName: \"kubernetes.io/projected/4d2cca6e-91ef-4648-95e0-88accef16327-kube-api-access-jdrfd\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.637838 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.637791 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-console-config\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.637914 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.637894 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-oauth-serving-cert\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.638036 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.638015 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-serving-cert\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.638123 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.638098 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-trusted-ca-bundle\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.638195 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.638133 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-service-ca\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.638243 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.638197 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-oauth-config\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.738745 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.738688 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdrfd\" (UniqueName: \"kubernetes.io/projected/4d2cca6e-91ef-4648-95e0-88accef16327-kube-api-access-jdrfd\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.738745 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.738730 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-console-config\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.738865 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.738756 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-oauth-serving-cert\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.738865 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.738797 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-serving-cert\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.738865 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.738837 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-trusted-ca-bundle\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.738865 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.738861 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-service-ca\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.739045 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.738891 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-oauth-config\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.739448 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.739417 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-console-config\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.739546 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.739500 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-oauth-serving-cert\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.739602 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.739559 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-service-ca\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.739959 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.739928 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-trusted-ca-bundle\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.741211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.741192 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-oauth-config\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.741482 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.741462 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-serving-cert\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.746877 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.746856 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdrfd\" (UniqueName: \"kubernetes.io/projected/4d2cca6e-91ef-4648-95e0-88accef16327-kube-api-access-jdrfd\") pod \"console-585cd796c4-f4mlx\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:36.844579 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:36.844552 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:37.130183 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:37.130132 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585cd796c4-f4mlx"] Sep 10 04:29:37.132851 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:29:37.132822 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2cca6e_91ef_4648_95e0_88accef16327.slice/crio-8230b28ea24ada8a25666da128afbcd07c40614875fed013c75e294e3f49cc74 WatchSource:0}: Error finding container 8230b28ea24ada8a25666da128afbcd07c40614875fed013c75e294e3f49cc74: Status 404 returned error can't find the container with id 8230b28ea24ada8a25666da128afbcd07c40614875fed013c75e294e3f49cc74 Sep 10 04:29:37.432617 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:37.432519 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585cd796c4-f4mlx" event={"ID":"4d2cca6e-91ef-4648-95e0-88accef16327","Type":"ContainerStarted","Data":"0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032"} Sep 10 04:29:37.432617 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:37.432574 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585cd796c4-f4mlx" event={"ID":"4d2cca6e-91ef-4648-95e0-88accef16327","Type":"ContainerStarted","Data":"8230b28ea24ada8a25666da128afbcd07c40614875fed013c75e294e3f49cc74"} Sep 10 04:29:37.451359 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:37.451308 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-585cd796c4-f4mlx" podStartSLOduration=1.451292187 podStartE2EDuration="1.451292187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:29:37.450118096 +0000 UTC m=+207.387029570" watchObservedRunningTime="2026-09-10 04:29:37.451292187 +0000 UTC m=+207.388203660" Sep 10 04:29:46.844725 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:46.844670 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:46.845362 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:46.844748 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:46.849457 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:46.849434 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:47.474148 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:47.474120 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:29:47.521651 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:29:47.521613 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7bc48678-fxzjr"] Sep 10 04:30:12.543382 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.543327 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c7bc48678-fxzjr" podUID="7f1d2216-fbfe-4ee7-8059-6e6127d94474" containerName="console" containerID="cri-o://cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef" gracePeriod=15 Sep 10 04:30:12.783922 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.783898 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:30:12.912780 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.912741 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-oauth-config\") pod \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " Sep 10 04:30:12.912941 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.912817 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-config\") pod \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " Sep 10 04:30:12.912941 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.912910 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkbcp\" (UniqueName: \"kubernetes.io/projected/7f1d2216-fbfe-4ee7-8059-6e6127d94474-kube-api-access-xkbcp\") pod \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " Sep 10 04:30:12.913072 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.912974 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-serving-cert\") pod \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " Sep 10 04:30:12.913072 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.912996 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-oauth-serving-cert\") pod \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " Sep 10 04:30:12.913072 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.913014 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-trusted-ca-bundle\") pod \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " Sep 10 04:30:12.913072 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.913043 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-service-ca\") pod \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\" (UID: \"7f1d2216-fbfe-4ee7-8059-6e6127d94474\") " Sep 10 04:30:12.913330 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.913215 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-config" (OuterVolumeSpecName: "console-config") pod "7f1d2216-fbfe-4ee7-8059-6e6127d94474" (UID: "7f1d2216-fbfe-4ee7-8059-6e6127d94474"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:30:12.913458 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.913430 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7f1d2216-fbfe-4ee7-8059-6e6127d94474" (UID: "7f1d2216-fbfe-4ee7-8059-6e6127d94474"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:30:12.913495 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.913442 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7f1d2216-fbfe-4ee7-8059-6e6127d94474" (UID: "7f1d2216-fbfe-4ee7-8059-6e6127d94474"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:30:12.913562 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.913539 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-service-ca" (OuterVolumeSpecName: "service-ca") pod "7f1d2216-fbfe-4ee7-8059-6e6127d94474" (UID: "7f1d2216-fbfe-4ee7-8059-6e6127d94474"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:30:12.914787 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.914767 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7f1d2216-fbfe-4ee7-8059-6e6127d94474" (UID: "7f1d2216-fbfe-4ee7-8059-6e6127d94474"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:30:12.914870 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.914851 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1d2216-fbfe-4ee7-8059-6e6127d94474-kube-api-access-xkbcp" (OuterVolumeSpecName: "kube-api-access-xkbcp") pod "7f1d2216-fbfe-4ee7-8059-6e6127d94474" (UID: "7f1d2216-fbfe-4ee7-8059-6e6127d94474"). InnerVolumeSpecName "kube-api-access-xkbcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:30:12.915049 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:12.915027 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7f1d2216-fbfe-4ee7-8059-6e6127d94474" (UID: "7f1d2216-fbfe-4ee7-8059-6e6127d94474"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:30:13.014459 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.014421 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:30:13.014459 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.014455 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-oauth-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:30:13.014604 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.014469 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-trusted-ca-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:30:13.014604 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.014481 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-service-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:30:13.014604 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.014494 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-oauth-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:30:13.014604 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.014505 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f1d2216-fbfe-4ee7-8059-6e6127d94474-console-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:30:13.014604 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.014517 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkbcp\" (UniqueName: \"kubernetes.io/projected/7f1d2216-fbfe-4ee7-8059-6e6127d94474-kube-api-access-xkbcp\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:30:13.567722 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.567683 2555 generic.go:356] "Generic (PLEG): container finished" podID="7f1d2216-fbfe-4ee7-8059-6e6127d94474" containerID="cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef" exitCode=0 Sep 10 04:30:13.568156 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.567725 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7bc48678-fxzjr" Sep 10 04:30:13.568156 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.567731 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7bc48678-fxzjr" event={"ID":"7f1d2216-fbfe-4ee7-8059-6e6127d94474","Type":"ContainerDied","Data":"cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef"} Sep 10 04:30:13.568156 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.567775 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7bc48678-fxzjr" event={"ID":"7f1d2216-fbfe-4ee7-8059-6e6127d94474","Type":"ContainerDied","Data":"7e689eb741e662c46b4d5ab5eeb93f9a3dfa09990cd6303f6f2b4e9617b6643e"} Sep 10 04:30:13.568156 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.567802 2555 scope.go:117] "RemoveContainer" containerID="cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef" Sep 10 04:30:13.577052 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.577035 2555 scope.go:117] "RemoveContainer" containerID="cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef" Sep 10 04:30:13.577357 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:30:13.577335 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef\": container with ID starting with cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef not found: ID does not exist" containerID="cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef" Sep 10 04:30:13.577430 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.577369 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef"} err="failed to get container status \"cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef\": rpc error: code = NotFound desc = could not find container \"cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef\": container with ID starting with cf0c643cb8149eb89149de3ab0bba2b6d33065917267d44e95d0260658d7c7ef not found: ID does not exist" Sep 10 04:30:13.587994 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.587973 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7bc48678-fxzjr"] Sep 10 04:30:13.590156 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:13.590130 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c7bc48678-fxzjr"] Sep 10 04:30:14.547612 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:14.547572 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f1d2216-fbfe-4ee7-8059-6e6127d94474" path="/var/lib/kubelet/pods/7f1d2216-fbfe-4ee7-8059-6e6127d94474/volumes" Sep 10 04:30:44.673967 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.673896 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8447f65f87-bk8wn"] Sep 10 04:30:44.674399 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.674242 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1d2216-fbfe-4ee7-8059-6e6127d94474" containerName="console" Sep 10 04:30:44.674399 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.674255 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1d2216-fbfe-4ee7-8059-6e6127d94474" containerName="console" Sep 10 04:30:44.674399 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.674305 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f1d2216-fbfe-4ee7-8059-6e6127d94474" containerName="console" Sep 10 04:30:44.678302 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.678286 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.687101 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.687074 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8447f65f87-bk8wn"] Sep 10 04:30:44.846697 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.846657 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-console-config\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.846697 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.846701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-serving-cert\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.846900 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.846727 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztd8d\" (UniqueName: \"kubernetes.io/projected/1985e4eb-f798-4c24-8a09-1732d0088e56-kube-api-access-ztd8d\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.846900 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.846784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-oauth-config\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.846900 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.846807 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-trusted-ca-bundle\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.846900 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.846857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-service-ca\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.846900 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.846892 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-oauth-serving-cert\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.948053 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.947974 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-oauth-config\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.948053 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.948015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-trusted-ca-bundle\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.948053 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.948058 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-service-ca\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.948325 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.948083 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-oauth-serving-cert\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.948325 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.948106 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-console-config\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.948325 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.948139 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-serving-cert\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.948325 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.948193 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztd8d\" (UniqueName: \"kubernetes.io/projected/1985e4eb-f798-4c24-8a09-1732d0088e56-kube-api-access-ztd8d\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.948862 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.948832 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-console-config\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.948969 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.948909 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-oauth-serving-cert\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.948969 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.948947 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-trusted-ca-bundle\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.949045 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.949009 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-service-ca\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.950581 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.950557 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-oauth-config\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.950701 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.950680 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-serving-cert\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.955773 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.955749 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztd8d\" (UniqueName: \"kubernetes.io/projected/1985e4eb-f798-4c24-8a09-1732d0088e56-kube-api-access-ztd8d\") pod \"console-8447f65f87-bk8wn\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:44.986676 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:44.986655 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:45.259039 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:45.258917 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8447f65f87-bk8wn"] Sep 10 04:30:45.261544 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:30:45.261516 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1985e4eb_f798_4c24_8a09_1732d0088e56.slice/crio-6da9da7cc78bef7bcfdd65a55094a5f35da990bdf7562d732c722517c361682d WatchSource:0}: Error finding container 6da9da7cc78bef7bcfdd65a55094a5f35da990bdf7562d732c722517c361682d: Status 404 returned error can't find the container with id 6da9da7cc78bef7bcfdd65a55094a5f35da990bdf7562d732c722517c361682d Sep 10 04:30:45.676212 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:45.676158 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8447f65f87-bk8wn" event={"ID":"1985e4eb-f798-4c24-8a09-1732d0088e56","Type":"ContainerStarted","Data":"722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27"} Sep 10 04:30:45.676621 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:45.676229 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8447f65f87-bk8wn" event={"ID":"1985e4eb-f798-4c24-8a09-1732d0088e56","Type":"ContainerStarted","Data":"6da9da7cc78bef7bcfdd65a55094a5f35da990bdf7562d732c722517c361682d"} Sep 10 04:30:45.693828 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:45.693774 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8447f65f87-bk8wn" podStartSLOduration=1.693756957 podStartE2EDuration="1.693756957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:30:45.692850851 +0000 UTC m=+275.629762323" watchObservedRunningTime="2026-09-10 04:30:45.693756957 +0000 UTC m=+275.630668429" Sep 10 04:30:54.987299 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:54.987265 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:54.987674 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:54.987320 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:54.991986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:54.991965 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:55.721676 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:55.721647 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:30:55.769593 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:30:55.769566 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585cd796c4-f4mlx"] Sep 10 04:31:10.492420 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:10.492386 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:31:10.493289 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:10.493267 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:31:10.495713 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:10.495695 2555 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 04:31:20.794009 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:20.793960 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-585cd796c4-f4mlx" podUID="4d2cca6e-91ef-4648-95e0-88accef16327" containerName="console" containerID="cri-o://0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032" gracePeriod=15 Sep 10 04:31:21.034370 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.034347 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:31:21.115086 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115051 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-trusted-ca-bundle\") pod \"4d2cca6e-91ef-4648-95e0-88accef16327\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " Sep 10 04:31:21.115257 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115115 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-oauth-serving-cert\") pod \"4d2cca6e-91ef-4648-95e0-88accef16327\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " Sep 10 04:31:21.115257 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115156 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdrfd\" (UniqueName: \"kubernetes.io/projected/4d2cca6e-91ef-4648-95e0-88accef16327-kube-api-access-jdrfd\") pod \"4d2cca6e-91ef-4648-95e0-88accef16327\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " Sep 10 04:31:21.115257 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115201 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-service-ca\") pod \"4d2cca6e-91ef-4648-95e0-88accef16327\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " Sep 10 04:31:21.115405 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115257 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-serving-cert\") pod \"4d2cca6e-91ef-4648-95e0-88accef16327\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " Sep 10 04:31:21.115405 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115290 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-console-config\") pod \"4d2cca6e-91ef-4648-95e0-88accef16327\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " Sep 10 04:31:21.115405 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115319 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-oauth-config\") pod \"4d2cca6e-91ef-4648-95e0-88accef16327\" (UID: \"4d2cca6e-91ef-4648-95e0-88accef16327\") " Sep 10 04:31:21.115551 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115493 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4d2cca6e-91ef-4648-95e0-88accef16327" (UID: "4d2cca6e-91ef-4648-95e0-88accef16327"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:31:21.115658 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115572 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4d2cca6e-91ef-4648-95e0-88accef16327" (UID: "4d2cca6e-91ef-4648-95e0-88accef16327"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:31:21.115773 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115662 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-console-config" (OuterVolumeSpecName: "console-config") pod "4d2cca6e-91ef-4648-95e0-88accef16327" (UID: "4d2cca6e-91ef-4648-95e0-88accef16327"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:31:21.115841 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.115816 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-service-ca" (OuterVolumeSpecName: "service-ca") pod "4d2cca6e-91ef-4648-95e0-88accef16327" (UID: "4d2cca6e-91ef-4648-95e0-88accef16327"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:31:21.117502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.117473 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4d2cca6e-91ef-4648-95e0-88accef16327" (UID: "4d2cca6e-91ef-4648-95e0-88accef16327"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:31:21.117914 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.117892 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2cca6e-91ef-4648-95e0-88accef16327-kube-api-access-jdrfd" (OuterVolumeSpecName: "kube-api-access-jdrfd") pod "4d2cca6e-91ef-4648-95e0-88accef16327" (UID: "4d2cca6e-91ef-4648-95e0-88accef16327"). InnerVolumeSpecName "kube-api-access-jdrfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:31:21.117914 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.117896 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4d2cca6e-91ef-4648-95e0-88accef16327" (UID: "4d2cca6e-91ef-4648-95e0-88accef16327"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:31:21.216132 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.216104 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-console-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:31:21.216132 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.216127 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-oauth-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:31:21.216132 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.216137 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-trusted-ca-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:31:21.216354 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.216146 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-oauth-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:31:21.216354 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.216155 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdrfd\" (UniqueName: \"kubernetes.io/projected/4d2cca6e-91ef-4648-95e0-88accef16327-kube-api-access-jdrfd\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:31:21.216354 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.216178 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d2cca6e-91ef-4648-95e0-88accef16327-service-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:31:21.216354 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.216187 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d2cca6e-91ef-4648-95e0-88accef16327-console-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:31:21.813943 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.813912 2555 generic.go:356] "Generic (PLEG): container finished" podID="4d2cca6e-91ef-4648-95e0-88accef16327" containerID="0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032" exitCode=0 Sep 10 04:31:21.814349 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.813957 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585cd796c4-f4mlx" Sep 10 04:31:21.814349 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.813997 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585cd796c4-f4mlx" event={"ID":"4d2cca6e-91ef-4648-95e0-88accef16327","Type":"ContainerDied","Data":"0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032"} Sep 10 04:31:21.814349 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.814037 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585cd796c4-f4mlx" event={"ID":"4d2cca6e-91ef-4648-95e0-88accef16327","Type":"ContainerDied","Data":"8230b28ea24ada8a25666da128afbcd07c40614875fed013c75e294e3f49cc74"} Sep 10 04:31:21.814349 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.814056 2555 scope.go:117] "RemoveContainer" containerID="0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032" Sep 10 04:31:21.822653 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.822637 2555 scope.go:117] "RemoveContainer" containerID="0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032" Sep 10 04:31:21.822939 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:31:21.822918 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032\": container with ID starting with 0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032 not found: ID does not exist" containerID="0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032" Sep 10 04:31:21.822986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.822948 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032"} err="failed to get container status \"0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032\": rpc error: code = NotFound desc = could not find container \"0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032\": container with ID starting with 0ac80d5793d8cfff2ca730d8dcc7db9373ba2cc49dd545fade3a78b5efc83032 not found: ID does not exist" Sep 10 04:31:21.833895 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.833875 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585cd796c4-f4mlx"] Sep 10 04:31:21.837903 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:21.837880 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-585cd796c4-f4mlx"] Sep 10 04:31:22.547708 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:31:22.547671 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d2cca6e-91ef-4648-95e0-88accef16327" path="/var/lib/kubelet/pods/4d2cca6e-91ef-4648-95e0-88accef16327/volumes" Sep 10 04:32:03.408874 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.408791 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729"] Sep 10 04:32:03.409329 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.409078 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2cca6e-91ef-4648-95e0-88accef16327" containerName="console" Sep 10 04:32:03.409329 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.409088 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2cca6e-91ef-4648-95e0-88accef16327" containerName="console" Sep 10 04:32:03.409329 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.409131 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d2cca6e-91ef-4648-95e0-88accef16327" containerName="console" Sep 10 04:32:03.412117 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.412099 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.415104 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.415081 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 04:32:03.416370 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.416350 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8862r\"" Sep 10 04:32:03.416489 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.416352 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 04:32:03.422954 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.422932 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729"] Sep 10 04:32:03.445118 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.445092 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.445280 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.445142 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzfpp\" (UniqueName: \"kubernetes.io/projected/283f7c82-a382-4bcf-b12b-03dc9d80ef80-kube-api-access-gzfpp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.445280 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.445219 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.545978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.545941 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.545978 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.545984 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfpp\" (UniqueName: \"kubernetes.io/projected/283f7c82-a382-4bcf-b12b-03dc9d80ef80-kube-api-access-gzfpp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.546224 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.546009 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.546341 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.546324 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.546435 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.546416 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.554506 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.554485 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzfpp\" (UniqueName: \"kubernetes.io/projected/283f7c82-a382-4bcf-b12b-03dc9d80ef80-kube-api-access-gzfpp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.721711 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.721635 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:03.991116 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:03.991022 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729"] Sep 10 04:32:03.999294 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:32:03.999260 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod283f7c82_a382_4bcf_b12b_03dc9d80ef80.slice/crio-8c4621b5f653102737344ddf8cf5079c04193298f595eba5e7620cdb88979dca WatchSource:0}: Error finding container 8c4621b5f653102737344ddf8cf5079c04193298f595eba5e7620cdb88979dca: Status 404 returned error can't find the container with id 8c4621b5f653102737344ddf8cf5079c04193298f595eba5e7620cdb88979dca Sep 10 04:32:04.001237 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:04.001219 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 04:32:04.974250 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:04.974214 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" event={"ID":"283f7c82-a382-4bcf-b12b-03dc9d80ef80","Type":"ContainerStarted","Data":"8c4621b5f653102737344ddf8cf5079c04193298f595eba5e7620cdb88979dca"} Sep 10 04:32:11.001223 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:11.001187 2555 generic.go:356] "Generic (PLEG): container finished" podID="283f7c82-a382-4bcf-b12b-03dc9d80ef80" containerID="0e7724270bd29941f98167c725f7a1b89ea183f1b55b165070cbbd1cd6294995" exitCode=0 Sep 10 04:32:11.001595 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:11.001284 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" event={"ID":"283f7c82-a382-4bcf-b12b-03dc9d80ef80","Type":"ContainerDied","Data":"0e7724270bd29941f98167c725f7a1b89ea183f1b55b165070cbbd1cd6294995"} Sep 10 04:32:14.016707 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:14.016672 2555 generic.go:356] "Generic (PLEG): container finished" podID="283f7c82-a382-4bcf-b12b-03dc9d80ef80" containerID="ddf644a479006909d7fdd54bff48ff8092f39250ca6ac93da6c5e926cd8d25af" exitCode=0 Sep 10 04:32:14.017076 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:14.016731 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" event={"ID":"283f7c82-a382-4bcf-b12b-03dc9d80ef80","Type":"ContainerDied","Data":"ddf644a479006909d7fdd54bff48ff8092f39250ca6ac93da6c5e926cd8d25af"} Sep 10 04:32:22.051361 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:22.051320 2555 generic.go:356] "Generic (PLEG): container finished" podID="283f7c82-a382-4bcf-b12b-03dc9d80ef80" containerID="eeca735743acc0ecd4b572a35ced5b202a26e0dfb8332de0357c42c4bdc52b7d" exitCode=0 Sep 10 04:32:22.051781 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:22.051387 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" event={"ID":"283f7c82-a382-4bcf-b12b-03dc9d80ef80","Type":"ContainerDied","Data":"eeca735743acc0ecd4b572a35ced5b202a26e0dfb8332de0357c42c4bdc52b7d"} Sep 10 04:32:23.174640 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:23.174614 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:23.215213 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:23.215178 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-bundle\") pod \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " Sep 10 04:32:23.215368 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:23.215243 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzfpp\" (UniqueName: \"kubernetes.io/projected/283f7c82-a382-4bcf-b12b-03dc9d80ef80-kube-api-access-gzfpp\") pod \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " Sep 10 04:32:23.215368 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:23.215260 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-util\") pod \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\" (UID: \"283f7c82-a382-4bcf-b12b-03dc9d80ef80\") " Sep 10 04:32:23.215915 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:23.215885 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-bundle" (OuterVolumeSpecName: "bundle") pod "283f7c82-a382-4bcf-b12b-03dc9d80ef80" (UID: "283f7c82-a382-4bcf-b12b-03dc9d80ef80"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:32:23.217502 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:23.217470 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/283f7c82-a382-4bcf-b12b-03dc9d80ef80-kube-api-access-gzfpp" (OuterVolumeSpecName: "kube-api-access-gzfpp") pod "283f7c82-a382-4bcf-b12b-03dc9d80ef80" (UID: "283f7c82-a382-4bcf-b12b-03dc9d80ef80"). InnerVolumeSpecName "kube-api-access-gzfpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:32:23.220009 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:23.219980 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-util" (OuterVolumeSpecName: "util") pod "283f7c82-a382-4bcf-b12b-03dc9d80ef80" (UID: "283f7c82-a382-4bcf-b12b-03dc9d80ef80"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:32:23.316067 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:23.315990 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:32:23.316067 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:23.316019 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzfpp\" (UniqueName: \"kubernetes.io/projected/283f7c82-a382-4bcf-b12b-03dc9d80ef80-kube-api-access-gzfpp\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:32:23.316067 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:23.316029 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/283f7c82-a382-4bcf-b12b-03dc9d80ef80-util\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:32:24.060641 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:24.060609 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" Sep 10 04:32:24.060641 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:24.060620 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g9729" event={"ID":"283f7c82-a382-4bcf-b12b-03dc9d80ef80","Type":"ContainerDied","Data":"8c4621b5f653102737344ddf8cf5079c04193298f595eba5e7620cdb88979dca"} Sep 10 04:32:24.060836 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:24.060661 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c4621b5f653102737344ddf8cf5079c04193298f595eba5e7620cdb88979dca" Sep 10 04:32:31.191293 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.191259 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h"] Sep 10 04:32:31.191766 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.191532 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="283f7c82-a382-4bcf-b12b-03dc9d80ef80" containerName="extract" Sep 10 04:32:31.191766 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.191543 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="283f7c82-a382-4bcf-b12b-03dc9d80ef80" containerName="extract" Sep 10 04:32:31.191766 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.191552 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="283f7c82-a382-4bcf-b12b-03dc9d80ef80" containerName="util" Sep 10 04:32:31.191766 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.191557 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="283f7c82-a382-4bcf-b12b-03dc9d80ef80" containerName="util" Sep 10 04:32:31.191766 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.191570 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="283f7c82-a382-4bcf-b12b-03dc9d80ef80" containerName="pull" Sep 10 04:32:31.191766 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.191576 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="283f7c82-a382-4bcf-b12b-03dc9d80ef80" containerName="pull" Sep 10 04:32:31.191766 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.191624 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="283f7c82-a382-4bcf-b12b-03dc9d80ef80" containerName="extract" Sep 10 04:32:31.195189 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.195155 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" Sep 10 04:32:31.198673 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.198652 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 04:32:31.198869 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.198836 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:32:31.198979 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.198958 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nn96m\"" Sep 10 04:32:31.207924 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.207901 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h"] Sep 10 04:32:31.282700 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.282672 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d2wb\" (UniqueName: \"kubernetes.io/projected/6abb808c-456d-4a1c-b762-c7e816d1f60a-kube-api-access-7d2wb\") pod \"cert-manager-operator-controller-manager-55c444bf86-x2n2h\" (UID: \"6abb808c-456d-4a1c-b762-c7e816d1f60a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" Sep 10 04:32:31.282851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.282742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6abb808c-456d-4a1c-b762-c7e816d1f60a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x2n2h\" (UID: \"6abb808c-456d-4a1c-b762-c7e816d1f60a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" Sep 10 04:32:31.383893 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.383861 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d2wb\" (UniqueName: \"kubernetes.io/projected/6abb808c-456d-4a1c-b762-c7e816d1f60a-kube-api-access-7d2wb\") pod \"cert-manager-operator-controller-manager-55c444bf86-x2n2h\" (UID: \"6abb808c-456d-4a1c-b762-c7e816d1f60a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" Sep 10 04:32:31.384045 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.383948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6abb808c-456d-4a1c-b762-c7e816d1f60a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x2n2h\" (UID: \"6abb808c-456d-4a1c-b762-c7e816d1f60a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" Sep 10 04:32:31.384351 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.384335 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6abb808c-456d-4a1c-b762-c7e816d1f60a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x2n2h\" (UID: \"6abb808c-456d-4a1c-b762-c7e816d1f60a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" Sep 10 04:32:31.393760 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.393735 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d2wb\" (UniqueName: \"kubernetes.io/projected/6abb808c-456d-4a1c-b762-c7e816d1f60a-kube-api-access-7d2wb\") pod \"cert-manager-operator-controller-manager-55c444bf86-x2n2h\" (UID: \"6abb808c-456d-4a1c-b762-c7e816d1f60a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" Sep 10 04:32:31.504605 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.504531 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" Sep 10 04:32:31.779317 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:31.779237 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h"] Sep 10 04:32:31.782861 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:32:31.782823 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6abb808c_456d_4a1c_b762_c7e816d1f60a.slice/crio-a91205a9bc4b631215a4a6f286bc96334cb5b785c377208cb3553b1e056f2d96 WatchSource:0}: Error finding container a91205a9bc4b631215a4a6f286bc96334cb5b785c377208cb3553b1e056f2d96: Status 404 returned error can't find the container with id a91205a9bc4b631215a4a6f286bc96334cb5b785c377208cb3553b1e056f2d96 Sep 10 04:32:32.092895 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:32.092856 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" event={"ID":"6abb808c-456d-4a1c-b762-c7e816d1f60a","Type":"ContainerStarted","Data":"a91205a9bc4b631215a4a6f286bc96334cb5b785c377208cb3553b1e056f2d96"} Sep 10 04:32:34.103575 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:34.103537 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" event={"ID":"6abb808c-456d-4a1c-b762-c7e816d1f60a","Type":"ContainerStarted","Data":"d8735c6dca843eee125d834199923a72824a50f9e020d4e6d46caabc37f8cf5f"} Sep 10 04:32:34.124522 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:34.124473 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x2n2h" podStartSLOduration=1.517590387 podStartE2EDuration="3.124457942s" totalImagesPullingTime="1.606867555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:32:34.122623941 +0000 UTC m=+384.059535414" watchObservedRunningTime="2026-09-10 04:32:34.124457942 +0000 UTC m=+384.061369415" Sep 10 04:32:35.111476 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.111439 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8"] Sep 10 04:32:35.114040 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.114017 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.116934 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.116912 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8862r\"" Sep 10 04:32:35.117035 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.116959 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 04:32:35.118201 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.118181 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 04:32:35.122386 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.122357 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8"] Sep 10 04:32:35.215629 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.215595 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6trp\" (UniqueName: \"kubernetes.io/projected/e3ec6d58-9f97-45a6-973f-fab02a358c94-kube-api-access-c6trp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.215629 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.215640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.215842 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.215768 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.273200 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.273154 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lbddh"] Sep 10 04:32:35.275646 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.275627 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" Sep 10 04:32:35.279296 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.279271 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 04:32:35.279597 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.279575 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 04:32:35.279845 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.279830 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4zknd\"" Sep 10 04:32:35.290141 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.290120 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lbddh"] Sep 10 04:32:35.316352 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.316325 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6trp\" (UniqueName: \"kubernetes.io/projected/e3ec6d58-9f97-45a6-973f-fab02a358c94-kube-api-access-c6trp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.316475 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.316383 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.316526 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.316500 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.316772 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.316755 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.316836 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.316820 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.329947 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.329919 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6trp\" (UniqueName: \"kubernetes.io/projected/e3ec6d58-9f97-45a6-973f-fab02a358c94-kube-api-access-c6trp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.417551 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.417483 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r7cd\" (UniqueName: \"kubernetes.io/projected/ee6f4a36-6cc1-4b87-9d39-b992a18a4173-kube-api-access-8r7cd\") pod \"cert-manager-webhook-6486ffd997-lbddh\" (UID: \"ee6f4a36-6cc1-4b87-9d39-b992a18a4173\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" Sep 10 04:32:35.417551 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.417537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee6f4a36-6cc1-4b87-9d39-b992a18a4173-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lbddh\" (UID: \"ee6f4a36-6cc1-4b87-9d39-b992a18a4173\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" Sep 10 04:32:35.423459 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.423441 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:35.518501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.518468 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee6f4a36-6cc1-4b87-9d39-b992a18a4173-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lbddh\" (UID: \"ee6f4a36-6cc1-4b87-9d39-b992a18a4173\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" Sep 10 04:32:35.518676 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.518526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r7cd\" (UniqueName: \"kubernetes.io/projected/ee6f4a36-6cc1-4b87-9d39-b992a18a4173-kube-api-access-8r7cd\") pod \"cert-manager-webhook-6486ffd997-lbddh\" (UID: \"ee6f4a36-6cc1-4b87-9d39-b992a18a4173\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" Sep 10 04:32:35.527433 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.527401 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee6f4a36-6cc1-4b87-9d39-b992a18a4173-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lbddh\" (UID: \"ee6f4a36-6cc1-4b87-9d39-b992a18a4173\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" Sep 10 04:32:35.527569 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.527550 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r7cd\" (UniqueName: \"kubernetes.io/projected/ee6f4a36-6cc1-4b87-9d39-b992a18a4173-kube-api-access-8r7cd\") pod \"cert-manager-webhook-6486ffd997-lbddh\" (UID: \"ee6f4a36-6cc1-4b87-9d39-b992a18a4173\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" Sep 10 04:32:35.597343 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.597292 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" Sep 10 04:32:35.689030 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.689006 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8"] Sep 10 04:32:35.690794 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:32:35.690762 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ec6d58_9f97_45a6_973f_fab02a358c94.slice/crio-29e228f54c6a2d63a0a42b5e0ed0ef6f3f511c232189d92ff7eced27ea5580bf WatchSource:0}: Error finding container 29e228f54c6a2d63a0a42b5e0ed0ef6f3f511c232189d92ff7eced27ea5580bf: Status 404 returned error can't find the container with id 29e228f54c6a2d63a0a42b5e0ed0ef6f3f511c232189d92ff7eced27ea5580bf Sep 10 04:32:35.863414 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:35.863384 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lbddh"] Sep 10 04:32:35.866431 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:32:35.866396 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee6f4a36_6cc1_4b87_9d39_b992a18a4173.slice/crio-e9343819d21d3d48041d73be8e70d7913a239f55378a29cdd283ae40e9b1ee0d WatchSource:0}: Error finding container e9343819d21d3d48041d73be8e70d7913a239f55378a29cdd283ae40e9b1ee0d: Status 404 returned error can't find the container with id e9343819d21d3d48041d73be8e70d7913a239f55378a29cdd283ae40e9b1ee0d Sep 10 04:32:36.112232 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:36.112195 2555 generic.go:356] "Generic (PLEG): container finished" podID="e3ec6d58-9f97-45a6-973f-fab02a358c94" containerID="b8cf7105ad3d1f31c76b8ec3528b8a80d7e5968a980568cb22725c7e80b3bc9b" exitCode=0 Sep 10 04:32:36.112695 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:36.112303 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" event={"ID":"e3ec6d58-9f97-45a6-973f-fab02a358c94","Type":"ContainerDied","Data":"b8cf7105ad3d1f31c76b8ec3528b8a80d7e5968a980568cb22725c7e80b3bc9b"} Sep 10 04:32:36.112695 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:36.112352 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" event={"ID":"e3ec6d58-9f97-45a6-973f-fab02a358c94","Type":"ContainerStarted","Data":"29e228f54c6a2d63a0a42b5e0ed0ef6f3f511c232189d92ff7eced27ea5580bf"} Sep 10 04:32:36.113547 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:36.113526 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" event={"ID":"ee6f4a36-6cc1-4b87-9d39-b992a18a4173","Type":"ContainerStarted","Data":"e9343819d21d3d48041d73be8e70d7913a239f55378a29cdd283ae40e9b1ee0d"} Sep 10 04:32:39.130400 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:39.130369 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" event={"ID":"ee6f4a36-6cc1-4b87-9d39-b992a18a4173","Type":"ContainerStarted","Data":"7ad12a0e6770ab36ed3fd066d7b0f71a381e81f40d7d1e1f964c7058bbbf6e2c"} Sep 10 04:32:39.130760 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:39.130528 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" Sep 10 04:32:39.132306 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:39.132279 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" event={"ID":"e3ec6d58-9f97-45a6-973f-fab02a358c94","Type":"ContainerStarted","Data":"f252a5181258850d9cdd12348ba338f63f497b27891ab99d495549cf0b6e2a9d"} Sep 10 04:32:39.148345 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:39.148309 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" podStartSLOduration=1.011800285 podStartE2EDuration="4.148297004s" totalImagesPullingTime="3.136496719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:32:39.145922143 +0000 UTC m=+389.082833626" watchObservedRunningTime="2026-09-10 04:32:39.148297004 +0000 UTC m=+389.085208476" Sep 10 04:32:40.138733 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:40.138695 2555 generic.go:356] "Generic (PLEG): container finished" podID="e3ec6d58-9f97-45a6-973f-fab02a358c94" containerID="f252a5181258850d9cdd12348ba338f63f497b27891ab99d495549cf0b6e2a9d" exitCode=0 Sep 10 04:32:40.138733 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:40.138729 2555 generic.go:356] "Generic (PLEG): container finished" podID="e3ec6d58-9f97-45a6-973f-fab02a358c94" containerID="2dfb5479ededf93a435570c2aee88a23fb74703dac4ce8ee962afa56994ff723" exitCode=0 Sep 10 04:32:40.139128 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:40.138788 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" event={"ID":"e3ec6d58-9f97-45a6-973f-fab02a358c94","Type":"ContainerDied","Data":"f252a5181258850d9cdd12348ba338f63f497b27891ab99d495549cf0b6e2a9d"} Sep 10 04:32:40.139128 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:40.138848 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" event={"ID":"e3ec6d58-9f97-45a6-973f-fab02a358c94","Type":"ContainerDied","Data":"2dfb5479ededf93a435570c2aee88a23fb74703dac4ce8ee962afa56994ff723"} Sep 10 04:32:41.267044 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:41.267022 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:41.367646 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:41.367621 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-util\") pod \"e3ec6d58-9f97-45a6-973f-fab02a358c94\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " Sep 10 04:32:41.367818 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:41.367697 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6trp\" (UniqueName: \"kubernetes.io/projected/e3ec6d58-9f97-45a6-973f-fab02a358c94-kube-api-access-c6trp\") pod \"e3ec6d58-9f97-45a6-973f-fab02a358c94\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " Sep 10 04:32:41.367818 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:41.367734 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-bundle\") pod \"e3ec6d58-9f97-45a6-973f-fab02a358c94\" (UID: \"e3ec6d58-9f97-45a6-973f-fab02a358c94\") " Sep 10 04:32:41.368198 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:41.368146 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-bundle" (OuterVolumeSpecName: "bundle") pod "e3ec6d58-9f97-45a6-973f-fab02a358c94" (UID: "e3ec6d58-9f97-45a6-973f-fab02a358c94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:32:41.369749 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:41.369726 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ec6d58-9f97-45a6-973f-fab02a358c94-kube-api-access-c6trp" (OuterVolumeSpecName: "kube-api-access-c6trp") pod "e3ec6d58-9f97-45a6-973f-fab02a358c94" (UID: "e3ec6d58-9f97-45a6-973f-fab02a358c94"). InnerVolumeSpecName "kube-api-access-c6trp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:32:41.371760 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:41.371742 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-util" (OuterVolumeSpecName: "util") pod "e3ec6d58-9f97-45a6-973f-fab02a358c94" (UID: "e3ec6d58-9f97-45a6-973f-fab02a358c94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:32:41.469123 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:41.469073 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-util\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:32:41.469123 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:41.469093 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6trp\" (UniqueName: \"kubernetes.io/projected/e3ec6d58-9f97-45a6-973f-fab02a358c94-kube-api-access-c6trp\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:32:41.469123 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:41.469104 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3ec6d58-9f97-45a6-973f-fab02a358c94-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:32:42.149234 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:42.149204 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" Sep 10 04:32:42.149406 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:42.149202 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flnlh8" event={"ID":"e3ec6d58-9f97-45a6-973f-fab02a358c94","Type":"ContainerDied","Data":"29e228f54c6a2d63a0a42b5e0ed0ef6f3f511c232189d92ff7eced27ea5580bf"} Sep 10 04:32:42.149406 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:42.149330 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29e228f54c6a2d63a0a42b5e0ed0ef6f3f511c232189d92ff7eced27ea5580bf" Sep 10 04:32:45.141788 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:45.141756 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lbddh" Sep 10 04:32:46.454881 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.454844 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dj842"] Sep 10 04:32:46.455304 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.455123 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ec6d58-9f97-45a6-973f-fab02a358c94" containerName="util" Sep 10 04:32:46.455304 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.455133 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ec6d58-9f97-45a6-973f-fab02a358c94" containerName="util" Sep 10 04:32:46.455304 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.455143 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ec6d58-9f97-45a6-973f-fab02a358c94" containerName="pull" Sep 10 04:32:46.455304 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.455149 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ec6d58-9f97-45a6-973f-fab02a358c94" containerName="pull" Sep 10 04:32:46.455304 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.455175 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ec6d58-9f97-45a6-973f-fab02a358c94" containerName="extract" Sep 10 04:32:46.455304 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.455183 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ec6d58-9f97-45a6-973f-fab02a358c94" containerName="extract" Sep 10 04:32:46.455304 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.455248 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ec6d58-9f97-45a6-973f-fab02a358c94" containerName="extract" Sep 10 04:32:46.459100 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.459084 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dj842" Sep 10 04:32:46.461977 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.461959 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5pnzq\"" Sep 10 04:32:46.469305 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.469282 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dj842"] Sep 10 04:32:46.612171 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.612141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ght4f\" (UniqueName: \"kubernetes.io/projected/54a57c7c-c89c-477d-95b9-d1bca8b4b7fe-kube-api-access-ght4f\") pod \"cert-manager-55b4d954d5-dj842\" (UID: \"54a57c7c-c89c-477d-95b9-d1bca8b4b7fe\") " pod="cert-manager/cert-manager-55b4d954d5-dj842" Sep 10 04:32:46.612296 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.612201 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54a57c7c-c89c-477d-95b9-d1bca8b4b7fe-bound-sa-token\") pod \"cert-manager-55b4d954d5-dj842\" (UID: \"54a57c7c-c89c-477d-95b9-d1bca8b4b7fe\") " pod="cert-manager/cert-manager-55b4d954d5-dj842" Sep 10 04:32:46.712985 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.712899 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54a57c7c-c89c-477d-95b9-d1bca8b4b7fe-bound-sa-token\") pod \"cert-manager-55b4d954d5-dj842\" (UID: \"54a57c7c-c89c-477d-95b9-d1bca8b4b7fe\") " pod="cert-manager/cert-manager-55b4d954d5-dj842" Sep 10 04:32:46.713139 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.713002 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ght4f\" (UniqueName: \"kubernetes.io/projected/54a57c7c-c89c-477d-95b9-d1bca8b4b7fe-kube-api-access-ght4f\") pod \"cert-manager-55b4d954d5-dj842\" (UID: \"54a57c7c-c89c-477d-95b9-d1bca8b4b7fe\") " pod="cert-manager/cert-manager-55b4d954d5-dj842" Sep 10 04:32:46.721313 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.721287 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54a57c7c-c89c-477d-95b9-d1bca8b4b7fe-bound-sa-token\") pod \"cert-manager-55b4d954d5-dj842\" (UID: \"54a57c7c-c89c-477d-95b9-d1bca8b4b7fe\") " pod="cert-manager/cert-manager-55b4d954d5-dj842" Sep 10 04:32:46.721424 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.721408 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ght4f\" (UniqueName: \"kubernetes.io/projected/54a57c7c-c89c-477d-95b9-d1bca8b4b7fe-kube-api-access-ght4f\") pod \"cert-manager-55b4d954d5-dj842\" (UID: \"54a57c7c-c89c-477d-95b9-d1bca8b4b7fe\") " pod="cert-manager/cert-manager-55b4d954d5-dj842" Sep 10 04:32:46.768246 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:46.768220 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dj842" Sep 10 04:32:47.037668 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:47.037548 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dj842"] Sep 10 04:32:47.039916 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:32:47.039887 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54a57c7c_c89c_477d_95b9_d1bca8b4b7fe.slice/crio-6010b722a80b1186baa43367d02f26558885e60bf8eab6846b46d6a1cd8b1d22 WatchSource:0}: Error finding container 6010b722a80b1186baa43367d02f26558885e60bf8eab6846b46d6a1cd8b1d22: Status 404 returned error can't find the container with id 6010b722a80b1186baa43367d02f26558885e60bf8eab6846b46d6a1cd8b1d22 Sep 10 04:32:47.171834 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:47.171803 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dj842" event={"ID":"54a57c7c-c89c-477d-95b9-d1bca8b4b7fe","Type":"ContainerStarted","Data":"211835afcfd434175c0707d9dea6742e08ab5ea2f2325d614333a944143f7492"} Sep 10 04:32:47.171989 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:47.171846 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dj842" event={"ID":"54a57c7c-c89c-477d-95b9-d1bca8b4b7fe","Type":"ContainerStarted","Data":"6010b722a80b1186baa43367d02f26558885e60bf8eab6846b46d6a1cd8b1d22"} Sep 10 04:32:47.187766 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:32:47.187719 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dj842" podStartSLOduration=1.187703649 podStartE2EDuration="1.187703649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:32:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:32:47.186544116 +0000 UTC m=+397.123455589" watchObservedRunningTime="2026-09-10 04:32:47.187703649 +0000 UTC m=+397.124615122" Sep 10 04:33:05.661174 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.661127 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5"] Sep 10 04:33:05.664484 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.664462 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:05.667287 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.667259 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 04:33:05.667417 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.667304 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 04:33:05.667417 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.667337 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8862r\"" Sep 10 04:33:05.672093 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.672074 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5"] Sep 10 04:33:05.764880 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.764856 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7s88\" (UniqueName: \"kubernetes.io/projected/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-kube-api-access-p7s88\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:05.765002 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.764893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:05.765002 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.764959 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:05.866123 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.866096 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:05.866243 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.866152 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7s88\" (UniqueName: \"kubernetes.io/projected/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-kube-api-access-p7s88\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:05.866297 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.866279 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:05.866569 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.866548 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:05.866613 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.866576 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:05.874269 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.874243 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7s88\" (UniqueName: \"kubernetes.io/projected/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-kube-api-access-p7s88\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:05.975293 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:05.975237 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:06.243132 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:06.243110 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5"] Sep 10 04:33:06.245095 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:33:06.245069 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a65ac4c_75f2_4351_8a3f_c74dc6355a9c.slice/crio-ae330a6ba76aca69c083cdd68534980d525b973cf836ba3bee9a0028bb79387f WatchSource:0}: Error finding container ae330a6ba76aca69c083cdd68534980d525b973cf836ba3bee9a0028bb79387f: Status 404 returned error can't find the container with id ae330a6ba76aca69c083cdd68534980d525b973cf836ba3bee9a0028bb79387f Sep 10 04:33:06.253779 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:06.253751 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" event={"ID":"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c","Type":"ContainerStarted","Data":"ae330a6ba76aca69c083cdd68534980d525b973cf836ba3bee9a0028bb79387f"} Sep 10 04:33:07.259078 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:07.258996 2555 generic.go:356] "Generic (PLEG): container finished" podID="9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" containerID="bc80be66e1064922c5938d57eeb12587028b8541d58e66ffd6f386a0ad8630ef" exitCode=0 Sep 10 04:33:07.259452 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:07.259084 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" event={"ID":"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c","Type":"ContainerDied","Data":"bc80be66e1064922c5938d57eeb12587028b8541d58e66ffd6f386a0ad8630ef"} Sep 10 04:33:08.265069 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:08.264987 2555 generic.go:356] "Generic (PLEG): container finished" podID="9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" containerID="5df35ccf9cbed00aa03c38ee3d4be7eb3df3701876616978c249b564faae0e0b" exitCode=0 Sep 10 04:33:08.265416 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:08.265073 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" event={"ID":"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c","Type":"ContainerDied","Data":"5df35ccf9cbed00aa03c38ee3d4be7eb3df3701876616978c249b564faae0e0b"} Sep 10 04:33:09.271692 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:09.271656 2555 generic.go:356] "Generic (PLEG): container finished" podID="9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" containerID="c2d83c059e69bbc5a47dcf6c825e9daf958f5b1de89520160f6e1d6a65a7d985" exitCode=0 Sep 10 04:33:09.272085 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:09.271744 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" event={"ID":"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c","Type":"ContainerDied","Data":"c2d83c059e69bbc5a47dcf6c825e9daf958f5b1de89520160f6e1d6a65a7d985"} Sep 10 04:33:10.405696 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:10.405672 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:10.497516 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:10.497491 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-util\") pod \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " Sep 10 04:33:10.497659 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:10.497589 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7s88\" (UniqueName: \"kubernetes.io/projected/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-kube-api-access-p7s88\") pod \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " Sep 10 04:33:10.497659 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:10.497608 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-bundle\") pod \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\" (UID: \"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c\") " Sep 10 04:33:10.498606 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:10.498576 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-bundle" (OuterVolumeSpecName: "bundle") pod "9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" (UID: "9a65ac4c-75f2-4351-8a3f-c74dc6355a9c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:33:10.499802 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:10.499772 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-kube-api-access-p7s88" (OuterVolumeSpecName: "kube-api-access-p7s88") pod "9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" (UID: "9a65ac4c-75f2-4351-8a3f-c74dc6355a9c"). InnerVolumeSpecName "kube-api-access-p7s88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:33:10.503187 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:10.503151 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-util" (OuterVolumeSpecName: "util") pod "9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" (UID: "9a65ac4c-75f2-4351-8a3f-c74dc6355a9c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:33:10.598574 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:10.598555 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7s88\" (UniqueName: \"kubernetes.io/projected/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-kube-api-access-p7s88\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:10.598574 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:10.598576 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:10.598709 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:10.598584 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a65ac4c-75f2-4351-8a3f-c74dc6355a9c-util\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:11.283959 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:11.283924 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" Sep 10 04:33:11.284104 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:11.283963 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqlc5" event={"ID":"9a65ac4c-75f2-4351-8a3f-c74dc6355a9c","Type":"ContainerDied","Data":"ae330a6ba76aca69c083cdd68534980d525b973cf836ba3bee9a0028bb79387f"} Sep 10 04:33:11.284104 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:11.284006 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae330a6ba76aca69c083cdd68534980d525b973cf836ba3bee9a0028bb79387f" Sep 10 04:33:15.060417 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.060383 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79dff7cf57-rjxmr"] Sep 10 04:33:15.060768 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.060683 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" containerName="pull" Sep 10 04:33:15.060768 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.060694 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" containerName="pull" Sep 10 04:33:15.060768 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.060707 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" containerName="util" Sep 10 04:33:15.060768 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.060716 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" containerName="util" Sep 10 04:33:15.060768 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.060728 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" containerName="extract" Sep 10 04:33:15.060768 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.060734 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" containerName="extract" Sep 10 04:33:15.060948 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.060779 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a65ac4c-75f2-4351-8a3f-c74dc6355a9c" containerName="extract" Sep 10 04:33:15.063339 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.063323 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.075564 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.075541 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79dff7cf57-rjxmr"] Sep 10 04:33:15.132615 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.132587 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-trusted-ca-bundle\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.132749 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.132628 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-service-ca\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.132749 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.132687 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-oauth-serving-cert\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.132749 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.132713 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z9p6\" (UniqueName: \"kubernetes.io/projected/ef387c2a-928a-4533-9d87-ada3835602d9-kube-api-access-2z9p6\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.132749 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.132733 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef387c2a-928a-4533-9d87-ada3835602d9-console-serving-cert\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.132876 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.132767 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-console-config\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.132876 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.132798 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef387c2a-928a-4533-9d87-ada3835602d9-console-oauth-config\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.233970 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.233944 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-oauth-serving-cert\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.233970 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.233970 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z9p6\" (UniqueName: \"kubernetes.io/projected/ef387c2a-928a-4533-9d87-ada3835602d9-kube-api-access-2z9p6\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.234121 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.233987 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef387c2a-928a-4533-9d87-ada3835602d9-console-serving-cert\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.234121 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.234003 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-console-config\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.234121 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.234051 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef387c2a-928a-4533-9d87-ada3835602d9-console-oauth-config\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.234121 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.234102 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-trusted-ca-bundle\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.234348 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.234133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-service-ca\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.234835 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.234812 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-service-ca\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.234919 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.234846 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-oauth-serving-cert\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.234958 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.234933 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-console-config\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.235013 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.234997 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef387c2a-928a-4533-9d87-ada3835602d9-trusted-ca-bundle\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.236469 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.236449 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef387c2a-928a-4533-9d87-ada3835602d9-console-serving-cert\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.236572 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.236459 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef387c2a-928a-4533-9d87-ada3835602d9-console-oauth-config\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.241396 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.241377 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z9p6\" (UniqueName: \"kubernetes.io/projected/ef387c2a-928a-4533-9d87-ada3835602d9-kube-api-access-2z9p6\") pod \"console-79dff7cf57-rjxmr\" (UID: \"ef387c2a-928a-4533-9d87-ada3835602d9\") " pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.373189 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.373121 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:15.639948 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:15.639915 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79dff7cf57-rjxmr"] Sep 10 04:33:15.642312 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:33:15.642279 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef387c2a_928a_4533_9d87_ada3835602d9.slice/crio-8a2cd2123c659bb9d8c7afee3c87d04319011cf4f4187792729484c97217edea WatchSource:0}: Error finding container 8a2cd2123c659bb9d8c7afee3c87d04319011cf4f4187792729484c97217edea: Status 404 returned error can't find the container with id 8a2cd2123c659bb9d8c7afee3c87d04319011cf4f4187792729484c97217edea Sep 10 04:33:16.307199 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:16.307148 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79dff7cf57-rjxmr" event={"ID":"ef387c2a-928a-4533-9d87-ada3835602d9","Type":"ContainerStarted","Data":"ebb97d083e5722ad206e42c86f6295c03cc8c8a75500c1ea04d71c2ce876f25c"} Sep 10 04:33:16.307535 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:16.307214 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79dff7cf57-rjxmr" event={"ID":"ef387c2a-928a-4533-9d87-ada3835602d9","Type":"ContainerStarted","Data":"8a2cd2123c659bb9d8c7afee3c87d04319011cf4f4187792729484c97217edea"} Sep 10 04:33:16.325058 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:16.325014 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79dff7cf57-rjxmr" podStartSLOduration=1.324998334 podStartE2EDuration="1.324998334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:33:16.324391329 +0000 UTC m=+426.261302814" watchObservedRunningTime="2026-09-10 04:33:16.324998334 +0000 UTC m=+426.261909808" Sep 10 04:33:19.290505 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.290462 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv"] Sep 10 04:33:19.292772 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.292748 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.297083 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.297058 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 04:33:19.298639 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.298611 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 04:33:19.298754 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.298670 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tlh9f\"" Sep 10 04:33:19.298754 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.298699 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 04:33:19.298867 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.298668 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 04:33:19.299004 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.298991 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:33:19.306674 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.306649 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv"] Sep 10 04:33:19.366485 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.366454 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7b104801-6777-416f-884a-724f9b55429d-manager-config\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.366608 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.366506 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b104801-6777-416f-884a-724f9b55429d-metrics-cert\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.366608 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.366555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc4rs\" (UniqueName: \"kubernetes.io/projected/7b104801-6777-416f-884a-724f9b55429d-kube-api-access-fc4rs\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.366608 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.366586 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b104801-6777-416f-884a-724f9b55429d-cert\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.466961 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.466914 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7b104801-6777-416f-884a-724f9b55429d-manager-config\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.467121 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.467008 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b104801-6777-416f-884a-724f9b55429d-metrics-cert\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.467121 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.467051 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc4rs\" (UniqueName: \"kubernetes.io/projected/7b104801-6777-416f-884a-724f9b55429d-kube-api-access-fc4rs\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.467121 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.467100 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b104801-6777-416f-884a-724f9b55429d-cert\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.467640 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.467616 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7b104801-6777-416f-884a-724f9b55429d-manager-config\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.469423 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.469403 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b104801-6777-416f-884a-724f9b55429d-cert\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.469556 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.469539 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b104801-6777-416f-884a-724f9b55429d-metrics-cert\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.476814 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.476796 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc4rs\" (UniqueName: \"kubernetes.io/projected/7b104801-6777-416f-884a-724f9b55429d-kube-api-access-fc4rs\") pod \"lws-controller-manager-55f5554b4b-8t5zv\" (UID: \"7b104801-6777-416f-884a-724f9b55429d\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.602789 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.602765 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:19.876009 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:19.875983 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv"] Sep 10 04:33:19.878239 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:33:19.878212 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b104801_6777_416f_884a_724f9b55429d.slice/crio-20c962636b14064823ea6a38ec4f072927e29e34b0b1e33ba628d6c32fac6aaa WatchSource:0}: Error finding container 20c962636b14064823ea6a38ec4f072927e29e34b0b1e33ba628d6c32fac6aaa: Status 404 returned error can't find the container with id 20c962636b14064823ea6a38ec4f072927e29e34b0b1e33ba628d6c32fac6aaa Sep 10 04:33:20.331151 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.331112 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" event={"ID":"7b104801-6777-416f-884a-724f9b55429d","Type":"ContainerStarted","Data":"20c962636b14064823ea6a38ec4f072927e29e34b0b1e33ba628d6c32fac6aaa"} Sep 10 04:33:20.503691 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.503652 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb"] Sep 10 04:33:20.506419 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.506401 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:20.509289 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.509265 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 04:33:20.510598 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.510576 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8862r\"" Sep 10 04:33:20.510681 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.510582 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 04:33:20.515553 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.515528 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb"] Sep 10 04:33:20.576127 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.576087 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:20.576127 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.576132 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m254l\" (UniqueName: \"kubernetes.io/projected/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-kube-api-access-m254l\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:20.576374 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.576259 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:20.677405 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.677311 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:20.677547 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.677406 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:20.677547 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.677439 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m254l\" (UniqueName: \"kubernetes.io/projected/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-kube-api-access-m254l\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:20.677799 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.677775 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:20.677835 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.677784 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:20.687815 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.687791 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m254l\" (UniqueName: \"kubernetes.io/projected/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-kube-api-access-m254l\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:20.816296 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:20.816251 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:21.086351 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:21.086315 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb"] Sep 10 04:33:21.088585 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:33:21.088560 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5432269_9c2d_4b21_84ec_fe5ac4bd9aae.slice/crio-311403ff8262b608a76209bcab9b8361faf1c02af76c5e53b2336f3b3cf900d7 WatchSource:0}: Error finding container 311403ff8262b608a76209bcab9b8361faf1c02af76c5e53b2336f3b3cf900d7: Status 404 returned error can't find the container with id 311403ff8262b608a76209bcab9b8361faf1c02af76c5e53b2336f3b3cf900d7 Sep 10 04:33:21.337820 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:21.337731 2555 generic.go:356] "Generic (PLEG): container finished" podID="b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" containerID="c011fb3cfc89c79747703f97d4504d802636323589d10cfc596ef141c6eb2b0e" exitCode=0 Sep 10 04:33:21.338203 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:21.337812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" event={"ID":"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae","Type":"ContainerDied","Data":"c011fb3cfc89c79747703f97d4504d802636323589d10cfc596ef141c6eb2b0e"} Sep 10 04:33:21.338203 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:21.337871 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" event={"ID":"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae","Type":"ContainerStarted","Data":"311403ff8262b608a76209bcab9b8361faf1c02af76c5e53b2336f3b3cf900d7"} Sep 10 04:33:22.344688 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.344658 2555 generic.go:356] "Generic (PLEG): container finished" podID="b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" containerID="e89757f045a0d74be98b97905b5d09429cf31f310fb321c54744017f14c15cb2" exitCode=0 Sep 10 04:33:22.345010 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.344748 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" event={"ID":"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae","Type":"ContainerDied","Data":"e89757f045a0d74be98b97905b5d09429cf31f310fb321c54744017f14c15cb2"} Sep 10 04:33:22.821076 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.821041 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k"] Sep 10 04:33:22.823439 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.823419 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.826136 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.826112 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 04:33:22.826269 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.826145 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 04:33:22.826269 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.826178 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pr9xr\"" Sep 10 04:33:22.826555 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.826539 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 04:33:22.826590 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.826548 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 04:33:22.842861 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.842839 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k"] Sep 10 04:33:22.894099 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.894069 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-tmp\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.894263 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.894158 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.894263 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.894231 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-manifests\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.894263 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.894248 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.894407 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.894263 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq2nv\" (UniqueName: \"kubernetes.io/projected/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-kube-api-access-wq2nv\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.995504 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.995461 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.995683 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.995532 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-manifests\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.995683 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.995555 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.995683 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.995577 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq2nv\" (UniqueName: \"kubernetes.io/projected/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-kube-api-access-wq2nv\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.995683 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.995625 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-tmp\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.995988 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.995963 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-manifests\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.997920 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.997891 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-tmp\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.998135 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.998113 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:22.998207 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:22.998113 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:23.008874 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:23.008847 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq2nv\" (UniqueName: \"kubernetes.io/projected/7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c-kube-api-access-wq2nv\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-t9m2k\" (UID: \"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:23.133523 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:23.133432 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:23.351000 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:23.350962 2555 generic.go:356] "Generic (PLEG): container finished" podID="b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" containerID="6d8c6580203ce4b14cff31f99d62e8ecafb5e551a28625060693794cadf77fa8" exitCode=0 Sep 10 04:33:23.351000 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:23.350995 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" event={"ID":"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae","Type":"ContainerDied","Data":"6d8c6580203ce4b14cff31f99d62e8ecafb5e551a28625060693794cadf77fa8"} Sep 10 04:33:23.427268 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:23.427194 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k"] Sep 10 04:33:23.430137 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:33:23.430111 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cdd6a0c_5fd2_4702_ac0a_fde97098dd2c.slice/crio-53e89d9f88f37d6ac560d0c526b1bc81b18d2a4fbec7aa8369970f70ebad0be1 WatchSource:0}: Error finding container 53e89d9f88f37d6ac560d0c526b1bc81b18d2a4fbec7aa8369970f70ebad0be1: Status 404 returned error can't find the container with id 53e89d9f88f37d6ac560d0c526b1bc81b18d2a4fbec7aa8369970f70ebad0be1 Sep 10 04:33:24.359474 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.359406 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" event={"ID":"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c","Type":"ContainerStarted","Data":"53e89d9f88f37d6ac560d0c526b1bc81b18d2a4fbec7aa8369970f70ebad0be1"} Sep 10 04:33:24.524609 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.524586 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:24.612388 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.611944 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m254l\" (UniqueName: \"kubernetes.io/projected/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-kube-api-access-m254l\") pod \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " Sep 10 04:33:24.612388 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.612103 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-bundle\") pod \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " Sep 10 04:33:24.612388 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.612143 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-util\") pod \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\" (UID: \"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae\") " Sep 10 04:33:24.613177 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.613131 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-bundle" (OuterVolumeSpecName: "bundle") pod "b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" (UID: "b5432269-9c2d-4b21-84ec-fe5ac4bd9aae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:33:24.614628 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.614587 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-kube-api-access-m254l" (OuterVolumeSpecName: "kube-api-access-m254l") pod "b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" (UID: "b5432269-9c2d-4b21-84ec-fe5ac4bd9aae"). InnerVolumeSpecName "kube-api-access-m254l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:33:24.621501 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.621475 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-util" (OuterVolumeSpecName: "util") pod "b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" (UID: "b5432269-9c2d-4b21-84ec-fe5ac4bd9aae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:33:24.713665 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.713630 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:24.713665 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.713663 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-util\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:24.713891 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:24.713676 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m254l\" (UniqueName: \"kubernetes.io/projected/b5432269-9c2d-4b21-84ec-fe5ac4bd9aae-kube-api-access-m254l\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:25.366866 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:25.366827 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" event={"ID":"b5432269-9c2d-4b21-84ec-fe5ac4bd9aae","Type":"ContainerDied","Data":"311403ff8262b608a76209bcab9b8361faf1c02af76c5e53b2336f3b3cf900d7"} Sep 10 04:33:25.367309 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:25.366887 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0m6lcb" Sep 10 04:33:25.367309 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:25.366890 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="311403ff8262b608a76209bcab9b8361faf1c02af76c5e53b2336f3b3cf900d7" Sep 10 04:33:25.373296 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:25.373270 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:25.373438 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:25.373329 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:25.378899 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:25.378878 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:26.375205 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:26.375154 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79dff7cf57-rjxmr" Sep 10 04:33:26.441114 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:26.441091 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8447f65f87-bk8wn"] Sep 10 04:33:27.377648 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:27.377612 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" event={"ID":"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c","Type":"ContainerStarted","Data":"397762c17a1572982fbb9372c1c8e7fae4ce02a3116d25d00557abcf97673e5e"} Sep 10 04:33:28.383434 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:28.383393 2555 generic.go:356] "Generic (PLEG): container finished" podID="7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c" containerID="397762c17a1572982fbb9372c1c8e7fae4ce02a3116d25d00557abcf97673e5e" exitCode=0 Sep 10 04:33:28.383775 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:28.383475 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" event={"ID":"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c","Type":"ContainerDied","Data":"397762c17a1572982fbb9372c1c8e7fae4ce02a3116d25d00557abcf97673e5e"} Sep 10 04:33:29.389944 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:29.389909 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" event={"ID":"7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c","Type":"ContainerStarted","Data":"fab2adecc536068b0ab9b89d13e823c30960b11642e783d35ac36b6e017988d6"} Sep 10 04:33:29.390568 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:29.390029 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:29.410243 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:29.410188 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" podStartSLOduration=3.081891703 podStartE2EDuration="7.41014959s" totalImagesPullingTime="3.249673222s" totalInitContainerRuntime="1.078584665s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:33:29.408948598 +0000 UTC m=+439.345860070" watchObservedRunningTime="2026-09-10 04:33:29.41014959 +0000 UTC m=+439.347061064" Sep 10 04:33:31.401270 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:31.401234 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" event={"ID":"7b104801-6777-416f-884a-724f9b55429d","Type":"ContainerStarted","Data":"8785069d2f2c99b2200f3fe9815df2d3fea788d9e401991f26fbb3967d40d7cc"} Sep 10 04:33:31.401719 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:31.401344 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:31.419857 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:31.419807 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" podStartSLOduration=1.732037738 podStartE2EDuration="12.419795167s" totalImagesPullingTime="10.687757429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:33:31.418020965 +0000 UTC m=+441.354932439" watchObservedRunningTime="2026-09-10 04:33:31.419795167 +0000 UTC m=+441.356706640" Sep 10 04:33:40.397986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:40.397911 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-t9m2k" Sep 10 04:33:42.407328 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:42.407294 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-8t5zv" Sep 10 04:33:51.466542 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.466488 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8447f65f87-bk8wn" podUID="1985e4eb-f798-4c24-8a09-1732d0088e56" containerName="console" containerID="cri-o://722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27" gracePeriod=15 Sep 10 04:33:51.485676 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:33:51.485654 2555 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1985e4eb_f798_4c24_8a09_1732d0088e56.slice/crio-conmon-722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27.scope/pids.max": read /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1985e4eb_f798_4c24_8a09_1732d0088e56.slice/crio-conmon-722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27.scope/pids.max: no such device Sep 10 04:33:51.492325 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:33:51.492297 2555 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1985e4eb_f798_4c24_8a09_1732d0088e56.slice/crio-722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27.scope\": RecentStats: unable to find data in memory cache]" Sep 10 04:33:51.704149 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.704127 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:33:51.735429 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.735372 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztd8d\" (UniqueName: \"kubernetes.io/projected/1985e4eb-f798-4c24-8a09-1732d0088e56-kube-api-access-ztd8d\") pod \"1985e4eb-f798-4c24-8a09-1732d0088e56\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " Sep 10 04:33:51.735429 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.735423 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-oauth-config\") pod \"1985e4eb-f798-4c24-8a09-1732d0088e56\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " Sep 10 04:33:51.735600 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.735468 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-serving-cert\") pod \"1985e4eb-f798-4c24-8a09-1732d0088e56\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " Sep 10 04:33:51.735600 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.735586 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-service-ca\") pod \"1985e4eb-f798-4c24-8a09-1732d0088e56\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " Sep 10 04:33:51.735706 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.735638 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-console-config\") pod \"1985e4eb-f798-4c24-8a09-1732d0088e56\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " Sep 10 04:33:51.735706 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.735691 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-oauth-serving-cert\") pod \"1985e4eb-f798-4c24-8a09-1732d0088e56\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " Sep 10 04:33:51.735815 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.735745 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-trusted-ca-bundle\") pod \"1985e4eb-f798-4c24-8a09-1732d0088e56\" (UID: \"1985e4eb-f798-4c24-8a09-1732d0088e56\") " Sep 10 04:33:51.736286 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.736239 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-console-config" (OuterVolumeSpecName: "console-config") pod "1985e4eb-f798-4c24-8a09-1732d0088e56" (UID: "1985e4eb-f798-4c24-8a09-1732d0088e56"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:33:51.736410 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.736276 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1985e4eb-f798-4c24-8a09-1732d0088e56" (UID: "1985e4eb-f798-4c24-8a09-1732d0088e56"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:33:51.736410 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.736370 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-service-ca" (OuterVolumeSpecName: "service-ca") pod "1985e4eb-f798-4c24-8a09-1732d0088e56" (UID: "1985e4eb-f798-4c24-8a09-1732d0088e56"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:33:51.736559 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.736411 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1985e4eb-f798-4c24-8a09-1732d0088e56" (UID: "1985e4eb-f798-4c24-8a09-1732d0088e56"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:33:51.737713 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.737686 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1985e4eb-f798-4c24-8a09-1732d0088e56-kube-api-access-ztd8d" (OuterVolumeSpecName: "kube-api-access-ztd8d") pod "1985e4eb-f798-4c24-8a09-1732d0088e56" (UID: "1985e4eb-f798-4c24-8a09-1732d0088e56"). InnerVolumeSpecName "kube-api-access-ztd8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:33:51.737823 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.737721 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1985e4eb-f798-4c24-8a09-1732d0088e56" (UID: "1985e4eb-f798-4c24-8a09-1732d0088e56"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:33:51.737823 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.737736 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1985e4eb-f798-4c24-8a09-1732d0088e56" (UID: "1985e4eb-f798-4c24-8a09-1732d0088e56"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:33:51.836352 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.836320 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-oauth-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:51.836352 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.836350 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-trusted-ca-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:51.836352 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.836359 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztd8d\" (UniqueName: \"kubernetes.io/projected/1985e4eb-f798-4c24-8a09-1732d0088e56-kube-api-access-ztd8d\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:51.836516 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.836369 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-oauth-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:51.836516 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.836378 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1985e4eb-f798-4c24-8a09-1732d0088e56-console-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:51.836516 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.836386 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-service-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:51.836516 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:51.836393 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1985e4eb-f798-4c24-8a09-1732d0088e56-console-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:33:52.497923 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:52.497886 2555 generic.go:356] "Generic (PLEG): container finished" podID="1985e4eb-f798-4c24-8a09-1732d0088e56" containerID="722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27" exitCode=0 Sep 10 04:33:52.498418 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:52.497935 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8447f65f87-bk8wn" Sep 10 04:33:52.498418 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:52.497982 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8447f65f87-bk8wn" event={"ID":"1985e4eb-f798-4c24-8a09-1732d0088e56","Type":"ContainerDied","Data":"722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27"} Sep 10 04:33:52.498418 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:52.498049 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8447f65f87-bk8wn" event={"ID":"1985e4eb-f798-4c24-8a09-1732d0088e56","Type":"ContainerDied","Data":"6da9da7cc78bef7bcfdd65a55094a5f35da990bdf7562d732c722517c361682d"} Sep 10 04:33:52.498418 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:52.498082 2555 scope.go:117] "RemoveContainer" containerID="722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27" Sep 10 04:33:52.512335 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:52.512311 2555 scope.go:117] "RemoveContainer" containerID="722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27" Sep 10 04:33:52.512608 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:33:52.512586 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27\": container with ID starting with 722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27 not found: ID does not exist" containerID="722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27" Sep 10 04:33:52.512702 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:52.512613 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27"} err="failed to get container status \"722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27\": rpc error: code = NotFound desc = could not find container \"722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27\": container with ID starting with 722e470cf3efa68750f403a8ef7ef4ef43fb646d6a7722e16e99986be805af27 not found: ID does not exist" Sep 10 04:33:52.522325 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:52.522303 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8447f65f87-bk8wn"] Sep 10 04:33:52.525579 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:52.525558 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8447f65f87-bk8wn"] Sep 10 04:33:52.547737 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:33:52.547714 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1985e4eb-f798-4c24-8a09-1732d0088e56" path="/var/lib/kubelet/pods/1985e4eb-f798-4c24-8a09-1732d0088e56/volumes" Sep 10 04:34:01.620701 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.620668 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz"] Sep 10 04:34:01.621064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.620955 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1985e4eb-f798-4c24-8a09-1732d0088e56" containerName="console" Sep 10 04:34:01.621064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.620967 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1985e4eb-f798-4c24-8a09-1732d0088e56" containerName="console" Sep 10 04:34:01.621064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.620975 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" containerName="util" Sep 10 04:34:01.621064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.620981 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" containerName="util" Sep 10 04:34:01.621064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.620998 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" containerName="extract" Sep 10 04:34:01.621064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.621003 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" containerName="extract" Sep 10 04:34:01.621064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.621010 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" containerName="pull" Sep 10 04:34:01.621064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.621016 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" containerName="pull" Sep 10 04:34:01.621336 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.621070 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5432269-9c2d-4b21-84ec-fe5ac4bd9aae" containerName="extract" Sep 10 04:34:01.621336 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.621078 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1985e4eb-f798-4c24-8a09-1732d0088e56" containerName="console" Sep 10 04:34:01.670871 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.670844 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz"] Sep 10 04:34:01.671008 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.670954 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.674050 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.674012 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 04:34:01.674050 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.674031 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 04:34:01.674050 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.674019 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 04:34:01.674274 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.674086 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bh2dg\"" Sep 10 04:34:01.674274 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.674119 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 04:34:01.711619 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.711594 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.711738 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.711627 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.711738 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.711648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9df8004f-bfa2-416f-b5f7-91ab224043ee-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.711738 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.711679 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df8004f-bfa2-416f-b5f7-91ab224043ee-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.711738 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.711734 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.711879 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.711788 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf7jn\" (UniqueName: \"kubernetes.io/projected/9df8004f-bfa2-416f-b5f7-91ab224043ee-kube-api-access-wf7jn\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.711879 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.711816 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.813244 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.813187 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.813444 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.813266 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.813444 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.813302 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.813444 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.813331 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9df8004f-bfa2-416f-b5f7-91ab224043ee-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.813444 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.813362 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df8004f-bfa2-416f-b5f7-91ab224043ee-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.813444 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.813430 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.813696 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.813467 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf7jn\" (UniqueName: \"kubernetes.io/projected/9df8004f-bfa2-416f-b5f7-91ab224043ee-kube-api-access-wf7jn\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.813934 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.813899 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.815629 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.815592 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df8004f-bfa2-416f-b5f7-91ab224043ee-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.815744 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.815725 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.815822 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.815765 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.815898 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.815877 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9df8004f-bfa2-416f-b5f7-91ab224043ee-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.821750 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.821720 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df8004f-bfa2-416f-b5f7-91ab224043ee-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.822338 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.822320 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf7jn\" (UniqueName: \"kubernetes.io/projected/9df8004f-bfa2-416f-b5f7-91ab224043ee-kube-api-access-wf7jn\") pod \"istiod-openshift-gateway-5677ccb49b-6s5pz\" (UID: \"9df8004f-bfa2-416f-b5f7-91ab224043ee\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:01.980918 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:01.980835 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:02.260908 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:02.260878 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz"] Sep 10 04:34:02.262676 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:34:02.262649 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df8004f_bfa2_416f_b5f7_91ab224043ee.slice/crio-b007e6bd8a12e8d69e36f7e587f78db7d659b44812ada726f17dc1ef29b321eb WatchSource:0}: Error finding container b007e6bd8a12e8d69e36f7e587f78db7d659b44812ada726f17dc1ef29b321eb: Status 404 returned error can't find the container with id b007e6bd8a12e8d69e36f7e587f78db7d659b44812ada726f17dc1ef29b321eb Sep 10 04:34:02.548189 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:02.548088 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" event={"ID":"9df8004f-bfa2-416f-b5f7-91ab224043ee","Type":"ContainerStarted","Data":"b007e6bd8a12e8d69e36f7e587f78db7d659b44812ada726f17dc1ef29b321eb"} Sep 10 04:34:04.545529 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:04.545462 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 04:34:04.545878 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:04.545558 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 04:34:05.565064 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:05.565013 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" event={"ID":"9df8004f-bfa2-416f-b5f7-91ab224043ee","Type":"ContainerStarted","Data":"1b79ef580f573557ae7b035d7b0d953a4877f227847cd27a4f0eb8f4e7c47b05"} Sep 10 04:34:05.565549 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:05.565117 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:05.566738 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:05.566708 2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-6s5pz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 04:34:05.566863 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:05.566766 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" podUID="9df8004f-bfa2-416f-b5f7-91ab224043ee" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 04:34:05.609637 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:05.609583 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" podStartSLOduration=2.329209215 podStartE2EDuration="4.609567636s" totalImagesPullingTime="2.280358421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:34:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:34:05.60704896 +0000 UTC m=+475.543960433" watchObservedRunningTime="2026-09-10 04:34:05.609567636 +0000 UTC m=+475.546479110" Sep 10 04:34:06.570013 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:06.569984 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6s5pz" Sep 10 04:34:58.301019 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.300981 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk"] Sep 10 04:34:58.309768 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.309741 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.312643 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.312619 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 04:34:58.312761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.312674 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8862r\"" Sep 10 04:34:58.312761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.312729 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk"] Sep 10 04:34:58.313904 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.313886 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 04:34:58.375288 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.375260 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.375407 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.375298 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfdl5\" (UniqueName: \"kubernetes.io/projected/c07997cb-74ed-4f40-9df5-4d88560c479a-kube-api-access-lfdl5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.375407 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.375339 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.406722 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.406697 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn"] Sep 10 04:34:58.410330 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.410314 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.425331 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.425311 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn"] Sep 10 04:34:58.476181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.476130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.476325 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.476200 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vq7n\" (UniqueName: \"kubernetes.io/projected/c87ad62d-4cb9-4811-9454-a304192cee33-kube-api-access-8vq7n\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.476325 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.476226 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.476325 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.476304 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.476484 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.476384 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfdl5\" (UniqueName: \"kubernetes.io/projected/c07997cb-74ed-4f40-9df5-4d88560c479a-kube-api-access-lfdl5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.476484 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.476421 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.476680 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.476662 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.476745 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.476683 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.492618 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.492597 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfdl5\" (UniqueName: \"kubernetes.io/projected/c07997cb-74ed-4f40-9df5-4d88560c479a-kube-api-access-lfdl5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.548550 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.548515 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b"] Sep 10 04:34:58.552115 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.552098 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.563018 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.562990 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b"] Sep 10 04:34:58.576852 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.576819 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc5w2\" (UniqueName: \"kubernetes.io/projected/119c1a60-f7eb-4edd-b1d7-50091d885e58-kube-api-access-bc5w2\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.577018 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.576895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.577018 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.576923 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.577018 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.576943 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vq7n\" (UniqueName: \"kubernetes.io/projected/c87ad62d-4cb9-4811-9454-a304192cee33-kube-api-access-8vq7n\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.577018 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.576968 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.577018 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.576992 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.577366 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.577347 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.577405 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.577371 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.587547 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.587514 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vq7n\" (UniqueName: \"kubernetes.io/projected/c87ad62d-4cb9-4811-9454-a304192cee33-kube-api-access-8vq7n\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.620614 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.620576 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw"] Sep 10 04:34:58.624315 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.624285 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:34:58.626077 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.626050 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:58.637612 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.637583 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw"] Sep 10 04:34:58.677516 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.677480 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:58.677689 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.677555 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.677689 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.677591 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.677689 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.677647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nq6s\" (UniqueName: \"kubernetes.io/projected/8a974648-d058-4593-952b-72274d5994b6-kube-api-access-9nq6s\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:58.677927 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.677709 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:58.677927 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.677741 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc5w2\" (UniqueName: \"kubernetes.io/projected/119c1a60-f7eb-4edd-b1d7-50091d885e58-kube-api-access-bc5w2\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.679126 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.679094 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.679763 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.679739 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.689647 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.689620 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc5w2\" (UniqueName: \"kubernetes.io/projected/119c1a60-f7eb-4edd-b1d7-50091d885e58-kube-api-access-bc5w2\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.718607 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.718578 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:34:58.779181 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.779129 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nq6s\" (UniqueName: \"kubernetes.io/projected/8a974648-d058-4593-952b-72274d5994b6-kube-api-access-9nq6s\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:58.779302 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.779230 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:58.779302 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.779286 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:58.779907 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.779749 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:58.779907 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.779851 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:58.790450 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.790421 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nq6s\" (UniqueName: \"kubernetes.io/projected/8a974648-d058-4593-952b-72274d5994b6-kube-api-access-9nq6s\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:58.862363 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.862281 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:34:58.905867 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.905840 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk"] Sep 10 04:34:58.908435 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:34:58.908376 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07997cb_74ed_4f40_9df5_4d88560c479a.slice/crio-f5146ef6ec6b3a26ea021362654832ba5e0b6ebd5e4a7bc820c0e5300ecf4eaa WatchSource:0}: Error finding container f5146ef6ec6b3a26ea021362654832ba5e0b6ebd5e4a7bc820c0e5300ecf4eaa: Status 404 returned error can't find the container with id f5146ef6ec6b3a26ea021362654832ba5e0b6ebd5e4a7bc820c0e5300ecf4eaa Sep 10 04:34:58.955714 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:58.955682 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:34:59.008687 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:34:59.008643 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87ad62d_4cb9_4811_9454_a304192cee33.slice/crio-5ca9c9f8e43ad1f8723e2afbc1b186bab0ec0e7f37156ec3e44bb0630185d1f6 WatchSource:0}: Error finding container 5ca9c9f8e43ad1f8723e2afbc1b186bab0ec0e7f37156ec3e44bb0630185d1f6: Status 404 returned error can't find the container with id 5ca9c9f8e43ad1f8723e2afbc1b186bab0ec0e7f37156ec3e44bb0630185d1f6 Sep 10 04:34:59.012568 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.009152 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn"] Sep 10 04:34:59.173804 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.173775 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b"] Sep 10 04:34:59.207033 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:34:59.206998 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119c1a60_f7eb_4edd_b1d7_50091d885e58.slice/crio-9535ac3d68cff7dae5d38b5773498aded6bca85f2880dd1ff7ba842cde022673 WatchSource:0}: Error finding container 9535ac3d68cff7dae5d38b5773498aded6bca85f2880dd1ff7ba842cde022673: Status 404 returned error can't find the container with id 9535ac3d68cff7dae5d38b5773498aded6bca85f2880dd1ff7ba842cde022673 Sep 10 04:34:59.233182 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.233140 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw"] Sep 10 04:34:59.239243 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:34:59.239219 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a974648_d058_4593_952b_72274d5994b6.slice/crio-2557f03b1b85fcc727f539d17c1cb41a85b8b82c3ddd65ffa0f5bbad6e952a7d WatchSource:0}: Error finding container 2557f03b1b85fcc727f539d17c1cb41a85b8b82c3ddd65ffa0f5bbad6e952a7d: Status 404 returned error can't find the container with id 2557f03b1b85fcc727f539d17c1cb41a85b8b82c3ddd65ffa0f5bbad6e952a7d Sep 10 04:34:59.810660 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.810624 2555 generic.go:356] "Generic (PLEG): container finished" podID="c07997cb-74ed-4f40-9df5-4d88560c479a" containerID="796a080af50ffec7318c80de26e0c8109022cbd8b6e7dd60733ab09967c80592" exitCode=0 Sep 10 04:34:59.811076 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.810713 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" event={"ID":"c07997cb-74ed-4f40-9df5-4d88560c479a","Type":"ContainerDied","Data":"796a080af50ffec7318c80de26e0c8109022cbd8b6e7dd60733ab09967c80592"} Sep 10 04:34:59.811076 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.810762 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" event={"ID":"c07997cb-74ed-4f40-9df5-4d88560c479a","Type":"ContainerStarted","Data":"f5146ef6ec6b3a26ea021362654832ba5e0b6ebd5e4a7bc820c0e5300ecf4eaa"} Sep 10 04:34:59.812377 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.812353 2555 generic.go:356] "Generic (PLEG): container finished" podID="c87ad62d-4cb9-4811-9454-a304192cee33" containerID="e1cdfeab7f826fbb5751886dca2dee4b202f1cd49ce72cc1c31e8e3cedc5cf89" exitCode=0 Sep 10 04:34:59.812471 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.812448 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" event={"ID":"c87ad62d-4cb9-4811-9454-a304192cee33","Type":"ContainerDied","Data":"e1cdfeab7f826fbb5751886dca2dee4b202f1cd49ce72cc1c31e8e3cedc5cf89"} Sep 10 04:34:59.812529 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.812497 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" event={"ID":"c87ad62d-4cb9-4811-9454-a304192cee33","Type":"ContainerStarted","Data":"5ca9c9f8e43ad1f8723e2afbc1b186bab0ec0e7f37156ec3e44bb0630185d1f6"} Sep 10 04:34:59.814098 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.814074 2555 generic.go:356] "Generic (PLEG): container finished" podID="119c1a60-f7eb-4edd-b1d7-50091d885e58" containerID="06fc62a4eb999ce5a5d90d0dca0d44aa41148bf3538152d64bad196b16aea0f0" exitCode=0 Sep 10 04:34:59.814209 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.814142 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" event={"ID":"119c1a60-f7eb-4edd-b1d7-50091d885e58","Type":"ContainerDied","Data":"06fc62a4eb999ce5a5d90d0dca0d44aa41148bf3538152d64bad196b16aea0f0"} Sep 10 04:34:59.814209 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.814202 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" event={"ID":"119c1a60-f7eb-4edd-b1d7-50091d885e58","Type":"ContainerStarted","Data":"9535ac3d68cff7dae5d38b5773498aded6bca85f2880dd1ff7ba842cde022673"} Sep 10 04:34:59.815887 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.815867 2555 generic.go:356] "Generic (PLEG): container finished" podID="8a974648-d058-4593-952b-72274d5994b6" containerID="011fe7e7fd37a2e4d4525d30b38a624c046101a743b5acedcf75191f71f15949" exitCode=0 Sep 10 04:34:59.815982 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.815921 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" event={"ID":"8a974648-d058-4593-952b-72274d5994b6","Type":"ContainerDied","Data":"011fe7e7fd37a2e4d4525d30b38a624c046101a743b5acedcf75191f71f15949"} Sep 10 04:34:59.815982 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:34:59.815955 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" event={"ID":"8a974648-d058-4593-952b-72274d5994b6","Type":"ContainerStarted","Data":"2557f03b1b85fcc727f539d17c1cb41a85b8b82c3ddd65ffa0f5bbad6e952a7d"} Sep 10 04:35:00.822428 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:00.822396 2555 generic.go:356] "Generic (PLEG): container finished" podID="c87ad62d-4cb9-4811-9454-a304192cee33" containerID="465f32341f41e78c9e1906fa67567525adc6adf38d70af7c98a0a24bb2995536" exitCode=0 Sep 10 04:35:00.822710 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:00.822458 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" event={"ID":"c87ad62d-4cb9-4811-9454-a304192cee33","Type":"ContainerDied","Data":"465f32341f41e78c9e1906fa67567525adc6adf38d70af7c98a0a24bb2995536"} Sep 10 04:35:01.829451 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:01.829413 2555 generic.go:356] "Generic (PLEG): container finished" podID="119c1a60-f7eb-4edd-b1d7-50091d885e58" containerID="ecf73a3b80b8651d59c0ed26fc074c0625faa16d135beafccf96bc99461df005" exitCode=0 Sep 10 04:35:01.829867 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:01.829501 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" event={"ID":"119c1a60-f7eb-4edd-b1d7-50091d885e58","Type":"ContainerDied","Data":"ecf73a3b80b8651d59c0ed26fc074c0625faa16d135beafccf96bc99461df005"} Sep 10 04:35:01.831986 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:01.831963 2555 generic.go:356] "Generic (PLEG): container finished" podID="c87ad62d-4cb9-4811-9454-a304192cee33" containerID="24aa99237aef472d9a569dd2690cb6482c40d0520da48c28bd007dd02faf7ff1" exitCode=0 Sep 10 04:35:01.832076 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:01.832009 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" event={"ID":"c87ad62d-4cb9-4811-9454-a304192cee33","Type":"ContainerDied","Data":"24aa99237aef472d9a569dd2690cb6482c40d0520da48c28bd007dd02faf7ff1"} Sep 10 04:35:02.839067 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:02.839027 2555 generic.go:356] "Generic (PLEG): container finished" podID="119c1a60-f7eb-4edd-b1d7-50091d885e58" containerID="85ce0a584477e9b566021b2480e1487ab1a3536202283b4f4e546ca4abd7d2ea" exitCode=0 Sep 10 04:35:02.839473 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:02.839102 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" event={"ID":"119c1a60-f7eb-4edd-b1d7-50091d885e58","Type":"ContainerDied","Data":"85ce0a584477e9b566021b2480e1487ab1a3536202283b4f4e546ca4abd7d2ea"} Sep 10 04:35:02.966128 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:02.966067 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:35:03.014613 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.014585 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vq7n\" (UniqueName: \"kubernetes.io/projected/c87ad62d-4cb9-4811-9454-a304192cee33-kube-api-access-8vq7n\") pod \"c87ad62d-4cb9-4811-9454-a304192cee33\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " Sep 10 04:35:03.014772 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.014663 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-bundle\") pod \"c87ad62d-4cb9-4811-9454-a304192cee33\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " Sep 10 04:35:03.014772 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.014690 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-util\") pod \"c87ad62d-4cb9-4811-9454-a304192cee33\" (UID: \"c87ad62d-4cb9-4811-9454-a304192cee33\") " Sep 10 04:35:03.015139 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.015116 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-bundle" (OuterVolumeSpecName: "bundle") pod "c87ad62d-4cb9-4811-9454-a304192cee33" (UID: "c87ad62d-4cb9-4811-9454-a304192cee33"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:35:03.016683 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.016657 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c87ad62d-4cb9-4811-9454-a304192cee33-kube-api-access-8vq7n" (OuterVolumeSpecName: "kube-api-access-8vq7n") pod "c87ad62d-4cb9-4811-9454-a304192cee33" (UID: "c87ad62d-4cb9-4811-9454-a304192cee33"). InnerVolumeSpecName "kube-api-access-8vq7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:35:03.019972 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.019925 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-util" (OuterVolumeSpecName: "util") pod "c87ad62d-4cb9-4811-9454-a304192cee33" (UID: "c87ad62d-4cb9-4811-9454-a304192cee33"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:35:03.116407 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.116315 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:03.116407 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.116350 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87ad62d-4cb9-4811-9454-a304192cee33-util\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:03.116407 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.116359 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vq7n\" (UniqueName: \"kubernetes.io/projected/c87ad62d-4cb9-4811-9454-a304192cee33-kube-api-access-8vq7n\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:03.847641 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.847609 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" Sep 10 04:35:03.848103 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.847618 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ccr6jn" event={"ID":"c87ad62d-4cb9-4811-9454-a304192cee33","Type":"ContainerDied","Data":"5ca9c9f8e43ad1f8723e2afbc1b186bab0ec0e7f37156ec3e44bb0630185d1f6"} Sep 10 04:35:03.848103 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.847729 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ca9c9f8e43ad1f8723e2afbc1b186bab0ec0e7f37156ec3e44bb0630185d1f6" Sep 10 04:35:03.974471 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:03.974448 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:35:04.023738 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.023712 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-util\") pod \"119c1a60-f7eb-4edd-b1d7-50091d885e58\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " Sep 10 04:35:04.023887 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.023777 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-bundle\") pod \"119c1a60-f7eb-4edd-b1d7-50091d885e58\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " Sep 10 04:35:04.023887 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.023842 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc5w2\" (UniqueName: \"kubernetes.io/projected/119c1a60-f7eb-4edd-b1d7-50091d885e58-kube-api-access-bc5w2\") pod \"119c1a60-f7eb-4edd-b1d7-50091d885e58\" (UID: \"119c1a60-f7eb-4edd-b1d7-50091d885e58\") " Sep 10 04:35:04.024426 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.024385 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-bundle" (OuterVolumeSpecName: "bundle") pod "119c1a60-f7eb-4edd-b1d7-50091d885e58" (UID: "119c1a60-f7eb-4edd-b1d7-50091d885e58"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:35:04.025862 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.025836 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119c1a60-f7eb-4edd-b1d7-50091d885e58-kube-api-access-bc5w2" (OuterVolumeSpecName: "kube-api-access-bc5w2") pod "119c1a60-f7eb-4edd-b1d7-50091d885e58" (UID: "119c1a60-f7eb-4edd-b1d7-50091d885e58"). InnerVolumeSpecName "kube-api-access-bc5w2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:35:04.029122 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.029088 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-util" (OuterVolumeSpecName: "util") pod "119c1a60-f7eb-4edd-b1d7-50091d885e58" (UID: "119c1a60-f7eb-4edd-b1d7-50091d885e58"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:35:04.124975 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.124899 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-util\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:04.124975 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.124927 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/119c1a60-f7eb-4edd-b1d7-50091d885e58-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:04.124975 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.124936 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc5w2\" (UniqueName: \"kubernetes.io/projected/119c1a60-f7eb-4edd-b1d7-50091d885e58-kube-api-access-bc5w2\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:04.855448 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.855424 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" Sep 10 04:35:04.855858 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.855421 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar6c2b" event={"ID":"119c1a60-f7eb-4edd-b1d7-50091d885e58","Type":"ContainerDied","Data":"9535ac3d68cff7dae5d38b5773498aded6bca85f2880dd1ff7ba842cde022673"} Sep 10 04:35:04.855858 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.855531 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9535ac3d68cff7dae5d38b5773498aded6bca85f2880dd1ff7ba842cde022673" Sep 10 04:35:04.857603 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.857575 2555 generic.go:356] "Generic (PLEG): container finished" podID="8a974648-d058-4593-952b-72274d5994b6" containerID="b72d067a9bc946e5176d2f6b00e761d00db05c199ddd5e6ad58e5ec76c4d2477" exitCode=0 Sep 10 04:35:04.857734 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.857668 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" event={"ID":"8a974648-d058-4593-952b-72274d5994b6","Type":"ContainerDied","Data":"b72d067a9bc946e5176d2f6b00e761d00db05c199ddd5e6ad58e5ec76c4d2477"} Sep 10 04:35:04.859938 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:04.859917 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" event={"ID":"c07997cb-74ed-4f40-9df5-4d88560c479a","Type":"ContainerStarted","Data":"5d5e249a2308c35c0558ef70c9b3165db94d8ce229e4c6ed4f67773893217238"} Sep 10 04:35:05.866923 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:05.866889 2555 generic.go:356] "Generic (PLEG): container finished" podID="c07997cb-74ed-4f40-9df5-4d88560c479a" containerID="5d5e249a2308c35c0558ef70c9b3165db94d8ce229e4c6ed4f67773893217238" exitCode=0 Sep 10 04:35:05.867354 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:05.866974 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" event={"ID":"c07997cb-74ed-4f40-9df5-4d88560c479a","Type":"ContainerDied","Data":"5d5e249a2308c35c0558ef70c9b3165db94d8ce229e4c6ed4f67773893217238"} Sep 10 04:35:05.869321 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:05.869296 2555 generic.go:356] "Generic (PLEG): container finished" podID="8a974648-d058-4593-952b-72274d5994b6" containerID="2df5f7d37fcf1f45ae3b290c02b6053b6a0d8222d40c4dabbc384cd8f1695404" exitCode=0 Sep 10 04:35:05.869423 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:05.869355 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" event={"ID":"8a974648-d058-4593-952b-72274d5994b6","Type":"ContainerDied","Data":"2df5f7d37fcf1f45ae3b290c02b6053b6a0d8222d40c4dabbc384cd8f1695404"} Sep 10 04:35:06.876185 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:06.876131 2555 generic.go:356] "Generic (PLEG): container finished" podID="c07997cb-74ed-4f40-9df5-4d88560c479a" containerID="6fc04dfe1740f6e4850902efcd8498a01616c9de9f3630d33f2515a084409b4d" exitCode=0 Sep 10 04:35:06.876577 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:06.876261 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" event={"ID":"c07997cb-74ed-4f40-9df5-4d88560c479a","Type":"ContainerDied","Data":"6fc04dfe1740f6e4850902efcd8498a01616c9de9f3630d33f2515a084409b4d"} Sep 10 04:35:07.003686 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.003661 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:35:07.050096 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.050066 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-util\") pod \"8a974648-d058-4593-952b-72274d5994b6\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " Sep 10 04:35:07.050256 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.050102 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-bundle\") pod \"8a974648-d058-4593-952b-72274d5994b6\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " Sep 10 04:35:07.050256 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.050157 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nq6s\" (UniqueName: \"kubernetes.io/projected/8a974648-d058-4593-952b-72274d5994b6-kube-api-access-9nq6s\") pod \"8a974648-d058-4593-952b-72274d5994b6\" (UID: \"8a974648-d058-4593-952b-72274d5994b6\") " Sep 10 04:35:07.050565 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.050543 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-bundle" (OuterVolumeSpecName: "bundle") pod "8a974648-d058-4593-952b-72274d5994b6" (UID: "8a974648-d058-4593-952b-72274d5994b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:35:07.052275 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.052249 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a974648-d058-4593-952b-72274d5994b6-kube-api-access-9nq6s" (OuterVolumeSpecName: "kube-api-access-9nq6s") pod "8a974648-d058-4593-952b-72274d5994b6" (UID: "8a974648-d058-4593-952b-72274d5994b6"). InnerVolumeSpecName "kube-api-access-9nq6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:35:07.056792 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.056767 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-util" (OuterVolumeSpecName: "util") pod "8a974648-d058-4593-952b-72274d5994b6" (UID: "8a974648-d058-4593-952b-72274d5994b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:35:07.150898 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.150804 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-util\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:07.150898 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.150837 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a974648-d058-4593-952b-72274d5994b6-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:07.150898 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.150846 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nq6s\" (UniqueName: \"kubernetes.io/projected/8a974648-d058-4593-952b-72274d5994b6-kube-api-access-9nq6s\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:07.884146 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.884113 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" Sep 10 04:35:07.884146 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.884122 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9tjw" event={"ID":"8a974648-d058-4593-952b-72274d5994b6","Type":"ContainerDied","Data":"2557f03b1b85fcc727f539d17c1cb41a85b8b82c3ddd65ffa0f5bbad6e952a7d"} Sep 10 04:35:07.884580 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:07.884187 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2557f03b1b85fcc727f539d17c1cb41a85b8b82c3ddd65ffa0f5bbad6e952a7d" Sep 10 04:35:08.017876 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.017851 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:35:08.059058 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.059027 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-bundle\") pod \"c07997cb-74ed-4f40-9df5-4d88560c479a\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " Sep 10 04:35:08.059058 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.059058 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfdl5\" (UniqueName: \"kubernetes.io/projected/c07997cb-74ed-4f40-9df5-4d88560c479a-kube-api-access-lfdl5\") pod \"c07997cb-74ed-4f40-9df5-4d88560c479a\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " Sep 10 04:35:08.059247 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.059116 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-util\") pod \"c07997cb-74ed-4f40-9df5-4d88560c479a\" (UID: \"c07997cb-74ed-4f40-9df5-4d88560c479a\") " Sep 10 04:35:08.059679 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.059647 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-bundle" (OuterVolumeSpecName: "bundle") pod "c07997cb-74ed-4f40-9df5-4d88560c479a" (UID: "c07997cb-74ed-4f40-9df5-4d88560c479a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:35:08.061333 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.061311 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c07997cb-74ed-4f40-9df5-4d88560c479a-kube-api-access-lfdl5" (OuterVolumeSpecName: "kube-api-access-lfdl5") pod "c07997cb-74ed-4f40-9df5-4d88560c479a" (UID: "c07997cb-74ed-4f40-9df5-4d88560c479a"). InnerVolumeSpecName "kube-api-access-lfdl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:35:08.063893 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.063854 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-util" (OuterVolumeSpecName: "util") pod "c07997cb-74ed-4f40-9df5-4d88560c479a" (UID: "c07997cb-74ed-4f40-9df5-4d88560c479a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:35:08.160416 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.160332 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:08.160416 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.160361 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfdl5\" (UniqueName: \"kubernetes.io/projected/c07997cb-74ed-4f40-9df5-4d88560c479a-kube-api-access-lfdl5\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:08.160416 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.160371 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c07997cb-74ed-4f40-9df5-4d88560c479a-util\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Sep 10 04:35:08.891541 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.891457 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" event={"ID":"c07997cb-74ed-4f40-9df5-4d88560c479a","Type":"ContainerDied","Data":"f5146ef6ec6b3a26ea021362654832ba5e0b6ebd5e4a7bc820c0e5300ecf4eaa"} Sep 10 04:35:08.891541 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.891540 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5146ef6ec6b3a26ea021362654832ba5e0b6ebd5e4a7bc820c0e5300ecf4eaa" Sep 10 04:35:08.891928 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:35:08.891468 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bqzbk" Sep 10 04:36:06.049030 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.048993 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049319 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119c1a60-f7eb-4edd-b1d7-50091d885e58" containerName="extract" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049332 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="119c1a60-f7eb-4edd-b1d7-50091d885e58" containerName="extract" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049345 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a974648-d058-4593-952b-72274d5994b6" containerName="pull" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049351 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a974648-d058-4593-952b-72274d5994b6" containerName="pull" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049361 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c07997cb-74ed-4f40-9df5-4d88560c479a" containerName="util" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049367 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c07997cb-74ed-4f40-9df5-4d88560c479a" containerName="util" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049373 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a974648-d058-4593-952b-72274d5994b6" containerName="extract" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049378 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a974648-d058-4593-952b-72274d5994b6" containerName="extract" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049384 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c07997cb-74ed-4f40-9df5-4d88560c479a" containerName="extract" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049389 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c07997cb-74ed-4f40-9df5-4d88560c479a" containerName="extract" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049399 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87ad62d-4cb9-4811-9454-a304192cee33" containerName="util" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049404 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87ad62d-4cb9-4811-9454-a304192cee33" containerName="util" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049411 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c07997cb-74ed-4f40-9df5-4d88560c479a" containerName="pull" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049417 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c07997cb-74ed-4f40-9df5-4d88560c479a" containerName="pull" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049424 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119c1a60-f7eb-4edd-b1d7-50091d885e58" containerName="util" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049429 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="119c1a60-f7eb-4edd-b1d7-50091d885e58" containerName="util" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049435 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a974648-d058-4593-952b-72274d5994b6" containerName="util" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049439 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a974648-d058-4593-952b-72274d5994b6" containerName="util" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049445 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119c1a60-f7eb-4edd-b1d7-50091d885e58" containerName="pull" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049449 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="119c1a60-f7eb-4edd-b1d7-50091d885e58" containerName="pull" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049457 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87ad62d-4cb9-4811-9454-a304192cee33" containerName="pull" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049462 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87ad62d-4cb9-4811-9454-a304192cee33" containerName="pull" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049467 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87ad62d-4cb9-4811-9454-a304192cee33" containerName="extract" Sep 10 04:36:06.049499 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049472 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87ad62d-4cb9-4811-9454-a304192cee33" containerName="extract" Sep 10 04:36:06.050211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049518 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="119c1a60-f7eb-4edd-b1d7-50091d885e58" containerName="extract" Sep 10 04:36:06.050211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049526 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a974648-d058-4593-952b-72274d5994b6" containerName="extract" Sep 10 04:36:06.050211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049533 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c87ad62d-4cb9-4811-9454-a304192cee33" containerName="extract" Sep 10 04:36:06.050211 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.049541 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c07997cb-74ed-4f40-9df5-4d88560c479a" containerName="extract" Sep 10 04:36:06.052386 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.052368 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" Sep 10 04:36:06.055055 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.055033 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 04:36:06.055199 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.055093 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 04:36:06.055199 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.055102 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 04:36:06.056248 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.056233 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jr9x6\"" Sep 10 04:36:06.061994 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.061971 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:36:06.084251 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.084220 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:36:06.160248 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.160214 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff1dea70-a6a6-4e40-8b73-e94307f6bac3-config-file\") pod \"limitador-limitador-84994f7ffc-fsf9w\" (UID: \"ff1dea70-a6a6-4e40-8b73-e94307f6bac3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" Sep 10 04:36:06.160248 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.160250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qrb\" (UniqueName: \"kubernetes.io/projected/ff1dea70-a6a6-4e40-8b73-e94307f6bac3-kube-api-access-n7qrb\") pod \"limitador-limitador-84994f7ffc-fsf9w\" (UID: \"ff1dea70-a6a6-4e40-8b73-e94307f6bac3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" Sep 10 04:36:06.260878 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.260840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff1dea70-a6a6-4e40-8b73-e94307f6bac3-config-file\") pod \"limitador-limitador-84994f7ffc-fsf9w\" (UID: \"ff1dea70-a6a6-4e40-8b73-e94307f6bac3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" Sep 10 04:36:06.260878 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.260884 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qrb\" (UniqueName: \"kubernetes.io/projected/ff1dea70-a6a6-4e40-8b73-e94307f6bac3-kube-api-access-n7qrb\") pod \"limitador-limitador-84994f7ffc-fsf9w\" (UID: \"ff1dea70-a6a6-4e40-8b73-e94307f6bac3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" Sep 10 04:36:06.261521 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.261501 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff1dea70-a6a6-4e40-8b73-e94307f6bac3-config-file\") pod \"limitador-limitador-84994f7ffc-fsf9w\" (UID: \"ff1dea70-a6a6-4e40-8b73-e94307f6bac3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" Sep 10 04:36:06.268927 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.268904 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7qrb\" (UniqueName: \"kubernetes.io/projected/ff1dea70-a6a6-4e40-8b73-e94307f6bac3-kube-api-access-n7qrb\") pod \"limitador-limitador-84994f7ffc-fsf9w\" (UID: \"ff1dea70-a6a6-4e40-8b73-e94307f6bac3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" Sep 10 04:36:06.364533 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.364495 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" Sep 10 04:36:06.634946 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:06.634861 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:36:06.638180 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:36:06.638134 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff1dea70_a6a6_4e40_8b73_e94307f6bac3.slice/crio-812b99f4ba0dcead7ea270a57fdfb654de77b315c98c5be48af087e91211e397 WatchSource:0}: Error finding container 812b99f4ba0dcead7ea270a57fdfb654de77b315c98c5be48af087e91211e397: Status 404 returned error can't find the container with id 812b99f4ba0dcead7ea270a57fdfb654de77b315c98c5be48af087e91211e397 Sep 10 04:36:07.180273 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:07.180235 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" event={"ID":"ff1dea70-a6a6-4e40-8b73-e94307f6bac3","Type":"ContainerStarted","Data":"812b99f4ba0dcead7ea270a57fdfb654de77b315c98c5be48af087e91211e397"} Sep 10 04:36:09.193478 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:09.193389 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" event={"ID":"ff1dea70-a6a6-4e40-8b73-e94307f6bac3","Type":"ContainerStarted","Data":"407c1ac1408295876f54434d77e6ba1ea5ad8bafc951fb4013b7f2174c7077f6"} Sep 10 04:36:09.193834 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:09.193529 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" Sep 10 04:36:09.213488 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:09.213427 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" podStartSLOduration=0.954415078 podStartE2EDuration="3.213414334s" totalImagesPullingTime="2.258999256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:36:09.210017747 +0000 UTC m=+599.146929220" watchObservedRunningTime="2026-09-10 04:36:09.213414334 +0000 UTC m=+599.150325807" Sep 10 04:36:10.532552 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:10.532520 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:36:10.533012 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:10.532618 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:36:20.199365 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:36:20.199335 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fsf9w" Sep 10 04:37:17.279312 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:17.279275 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:37:35.840607 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.840573 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl"] Sep 10 04:37:35.843807 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.843787 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:35.846763 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.846744 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 04:37:35.846869 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.846748 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 04:37:35.847987 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.847967 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 10 04:37:35.848092 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.847971 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cl8w9\"" Sep 10 04:37:35.852800 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.852781 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl"] Sep 10 04:37:35.924934 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.924901 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:35.925088 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.924947 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt4z2\" (UniqueName: \"kubernetes.io/projected/fb563abe-8e39-44a2-9db3-88c254958cc0-kube-api-access-pt4z2\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:35.925088 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.925000 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:35.925088 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.925063 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:35.925249 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.925091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb563abe-8e39-44a2-9db3-88c254958cc0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:35.925249 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:35.925129 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.025681 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.025647 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.025851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.025691 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.025851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.025706 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb563abe-8e39-44a2-9db3-88c254958cc0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.025851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.025728 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.025851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.025776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.025851 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.025800 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt4z2\" (UniqueName: \"kubernetes.io/projected/fb563abe-8e39-44a2-9db3-88c254958cc0-kube-api-access-pt4z2\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.026105 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.026066 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.026158 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.026131 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.026252 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.026189 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.027931 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.027900 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb563abe-8e39-44a2-9db3-88c254958cc0-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.028206 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.028188 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb563abe-8e39-44a2-9db3-88c254958cc0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.034433 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.034411 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt4z2\" (UniqueName: \"kubernetes.io/projected/fb563abe-8e39-44a2-9db3-88c254958cc0-kube-api-access-pt4z2\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5tgjl\" (UID: \"fb563abe-8e39-44a2-9db3-88c254958cc0\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.155677 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.155593 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:36.428612 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.428585 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl"] Sep 10 04:37:36.430091 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:37:36.430068 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb563abe_8e39_44a2_9db3_88c254958cc0.slice/crio-71503955e7eedbbd561c7107447a2fa5fb9c909868bcafff9998ac295f47eddc WatchSource:0}: Error finding container 71503955e7eedbbd561c7107447a2fa5fb9c909868bcafff9998ac295f47eddc: Status 404 returned error can't find the container with id 71503955e7eedbbd561c7107447a2fa5fb9c909868bcafff9998ac295f47eddc Sep 10 04:37:36.431457 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.431441 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 04:37:36.494737 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.494707 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:37:36.632144 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:36.632109 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" event={"ID":"fb563abe-8e39-44a2-9db3-88c254958cc0","Type":"ContainerStarted","Data":"71503955e7eedbbd561c7107447a2fa5fb9c909868bcafff9998ac295f47eddc"} Sep 10 04:37:37.639481 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:37.639451 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" event={"ID":"fb563abe-8e39-44a2-9db3-88c254958cc0","Type":"ContainerStarted","Data":"4e61bbbfe641e07a623e792e88b785e7c75f6344e9c010c12843e48955b8ac80"} Sep 10 04:37:37.656636 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:37.656593 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podStartSLOduration=1.5353028210000002 podStartE2EDuration="2.656576563s" totalImagesPullingTime="1.121273742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:37:37.65575777 +0000 UTC m=+687.592669278" watchObservedRunningTime="2026-09-10 04:37:37.656576563 +0000 UTC m=+687.593488035" Sep 10 04:37:38.645795 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:38.645756 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb563abe-8e39-44a2-9db3-88c254958cc0" containerID="4e61bbbfe641e07a623e792e88b785e7c75f6344e9c010c12843e48955b8ac80" exitCode=0 Sep 10 04:37:38.646203 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:38.645846 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" event={"ID":"fb563abe-8e39-44a2-9db3-88c254958cc0","Type":"ContainerDied","Data":"4e61bbbfe641e07a623e792e88b785e7c75f6344e9c010c12843e48955b8ac80"} Sep 10 04:37:38.646203 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:38.646054 2555 scope.go:117] "RemoveContainer" containerID="4e61bbbfe641e07a623e792e88b785e7c75f6344e9c010c12843e48955b8ac80" Sep 10 04:37:39.653044 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:39.653005 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb563abe-8e39-44a2-9db3-88c254958cc0" containerID="337c48108737ae6be5acc810012be2493d65ffa1dd566e58834fc038eda9cec4" exitCode=0 Sep 10 04:37:39.653505 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:39.653093 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" event={"ID":"fb563abe-8e39-44a2-9db3-88c254958cc0","Type":"ContainerDied","Data":"337c48108737ae6be5acc810012be2493d65ffa1dd566e58834fc038eda9cec4"} Sep 10 04:37:39.653505 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:39.653186 2555 scope.go:117] "RemoveContainer" containerID="4e61bbbfe641e07a623e792e88b785e7c75f6344e9c010c12843e48955b8ac80" Sep 10 04:37:39.653505 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:39.653298 2555 scope.go:117] "RemoveContainer" containerID="337c48108737ae6be5acc810012be2493d65ffa1dd566e58834fc038eda9cec4" Sep 10 04:37:39.653635 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:37:39.653534 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:37:40.661052 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:40.661024 2555 scope.go:117] "RemoveContainer" containerID="337c48108737ae6be5acc810012be2493d65ffa1dd566e58834fc038eda9cec4" Sep 10 04:37:40.661422 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:37:40.661192 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:37:46.155702 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:46.155655 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:46.156085 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:46.155737 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:46.156085 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:46.155755 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:46.156085 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:46.155770 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:37:46.156311 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:37:46.156183 2555 scope.go:117] "RemoveContainer" containerID="337c48108737ae6be5acc810012be2493d65ffa1dd566e58834fc038eda9cec4" Sep 10 04:37:46.156382 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:37:46.156345 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:38:01.542811 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:01.542780 2555 scope.go:117] "RemoveContainer" containerID="337c48108737ae6be5acc810012be2493d65ffa1dd566e58834fc038eda9cec4" Sep 10 04:38:02.771415 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:02.771382 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb563abe-8e39-44a2-9db3-88c254958cc0" containerID="4525cae46de56481768d5e7c48377a60756e49ca69b4956546cff6f63341d4b2" exitCode=0 Sep 10 04:38:02.771860 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:02.771453 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" event={"ID":"fb563abe-8e39-44a2-9db3-88c254958cc0","Type":"ContainerDied","Data":"4525cae46de56481768d5e7c48377a60756e49ca69b4956546cff6f63341d4b2"} Sep 10 04:38:02.771860 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:02.771515 2555 scope.go:117] "RemoveContainer" containerID="337c48108737ae6be5acc810012be2493d65ffa1dd566e58834fc038eda9cec4" Sep 10 04:38:02.771860 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:02.771857 2555 scope.go:117] "RemoveContainer" containerID="4525cae46de56481768d5e7c48377a60756e49ca69b4956546cff6f63341d4b2" Sep 10 04:38:02.772105 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:38:02.772084 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:38:04.928849 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:04.928814 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:38:06.156503 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:06.156468 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:38:06.156837 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:06.156529 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:38:06.156837 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:06.156547 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:38:06.156837 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:06.156562 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:38:06.156958 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:06.156877 2555 scope.go:117] "RemoveContainer" containerID="4525cae46de56481768d5e7c48377a60756e49ca69b4956546cff6f63341d4b2" Sep 10 04:38:06.157077 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:38:06.157057 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:38:16.729075 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:16.729036 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:38:19.542634 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:19.542598 2555 scope.go:117] "RemoveContainer" containerID="4525cae46de56481768d5e7c48377a60756e49ca69b4956546cff6f63341d4b2" Sep 10 04:38:19.543024 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:38:19.542765 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:38:23.929115 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:23.929078 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:38:28.055414 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.055382 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz"] Sep 10 04:38:28.060008 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.059988 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.065116 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.065097 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 04:38:28.143712 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.143676 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz"] Sep 10 04:38:28.156968 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.156923 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.157118 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.156989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.157118 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.157047 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.157217 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.157114 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.157255 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.157226 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.157299 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.157280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc656\" (UniqueName: \"kubernetes.io/projected/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-kube-api-access-hc656\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.258511 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.258486 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.258511 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.258514 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.258727 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.258532 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.258727 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.258582 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.258727 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.258626 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc656\" (UniqueName: \"kubernetes.io/projected/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-kube-api-access-hc656\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.258727 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.258665 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.258947 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.258875 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.258999 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.258938 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.258999 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.258981 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.260885 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.260860 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.261123 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.261105 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.266987 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.266970 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc656\" (UniqueName: \"kubernetes.io/projected/a01017f4-5f0a-4224-b8e0-00ff190ad7d0-kube-api-access-hc656\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz\" (UID: \"a01017f4-5f0a-4224-b8e0-00ff190ad7d0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.369209 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.369132 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:28.642257 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.642230 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz"] Sep 10 04:38:28.643501 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:38:28.643472 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01017f4_5f0a_4224_b8e0_00ff190ad7d0.slice/crio-b5302321d66a0a25a6a3b3797bd2718758a5a21ee32f1c456d44d9e60e0210cf WatchSource:0}: Error finding container b5302321d66a0a25a6a3b3797bd2718758a5a21ee32f1c456d44d9e60e0210cf: Status 404 returned error can't find the container with id b5302321d66a0a25a6a3b3797bd2718758a5a21ee32f1c456d44d9e60e0210cf Sep 10 04:38:28.903490 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.903371 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" event={"ID":"a01017f4-5f0a-4224-b8e0-00ff190ad7d0","Type":"ContainerStarted","Data":"cd2003ebee954e7982eb679e5c975442024d5f7b0ee0dba33186627ae55456fb"} Sep 10 04:38:28.903490 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.903432 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" event={"ID":"a01017f4-5f0a-4224-b8e0-00ff190ad7d0","Type":"ContainerStarted","Data":"b5302321d66a0a25a6a3b3797bd2718758a5a21ee32f1c456d44d9e60e0210cf"} Sep 10 04:38:28.922358 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:28.922316 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" podStartSLOduration=0.753724762 podStartE2EDuration="922.301848ms" totalImagesPullingTime="168.577086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:38:28.921152992 +0000 UTC m=+738.858064469" watchObservedRunningTime="2026-09-10 04:38:28.922301848 +0000 UTC m=+738.859213321" Sep 10 04:38:29.430839 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:29.430800 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:38:31.543099 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:31.543066 2555 scope.go:117] "RemoveContainer" containerID="4525cae46de56481768d5e7c48377a60756e49ca69b4956546cff6f63341d4b2" Sep 10 04:38:31.920324 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:31.920291 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb563abe-8e39-44a2-9db3-88c254958cc0" containerID="2ec802c61d3c86a141b3eef5c3bd4c7bcf97e3e6c71fac063611a16a4253fc5f" exitCode=0 Sep 10 04:38:31.920464 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:31.920364 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" event={"ID":"fb563abe-8e39-44a2-9db3-88c254958cc0","Type":"ContainerDied","Data":"2ec802c61d3c86a141b3eef5c3bd4c7bcf97e3e6c71fac063611a16a4253fc5f"} Sep 10 04:38:31.920464 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:31.920426 2555 scope.go:117] "RemoveContainer" containerID="4525cae46de56481768d5e7c48377a60756e49ca69b4956546cff6f63341d4b2" Sep 10 04:38:31.920734 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:31.920716 2555 scope.go:117] "RemoveContainer" containerID="2ec802c61d3c86a141b3eef5c3bd4c7bcf97e3e6c71fac063611a16a4253fc5f" Sep 10 04:38:31.920941 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:38:31.920921 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:38:36.156063 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:36.156024 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:38:36.156504 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:36.156102 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:38:36.156504 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:36.156125 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:38:36.156504 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:36.156148 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:38:36.156611 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:36.156515 2555 scope.go:117] "RemoveContainer" containerID="2ec802c61d3c86a141b3eef5c3bd4c7bcf97e3e6c71fac063611a16a4253fc5f" Sep 10 04:38:36.156703 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:38:36.156680 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:38:38.369909 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:38.369868 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:38.370365 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:38.369934 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:38.382640 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:38.382612 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:38.968560 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:38.968531 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz" Sep 10 04:38:40.928284 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:40.928251 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:38:46.542856 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:46.542822 2555 scope.go:117] "RemoveContainer" containerID="2ec802c61d3c86a141b3eef5c3bd4c7bcf97e3e6c71fac063611a16a4253fc5f" Sep 10 04:38:46.543241 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:38:46.542999 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:38:46.830093 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:38:46.830059 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fsf9w"] Sep 10 04:39:01.542549 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:01.542512 2555 scope.go:117] "RemoveContainer" containerID="2ec802c61d3c86a141b3eef5c3bd4c7bcf97e3e6c71fac063611a16a4253fc5f" Sep 10 04:39:01.543005 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:39:01.542705 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:39:12.543567 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:12.543537 2555 scope.go:117] "RemoveContainer" containerID="2ec802c61d3c86a141b3eef5c3bd4c7bcf97e3e6c71fac063611a16a4253fc5f" Sep 10 04:39:13.131578 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:13.131546 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb563abe-8e39-44a2-9db3-88c254958cc0" containerID="a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf" exitCode=0 Sep 10 04:39:13.131745 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:13.131584 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" event={"ID":"fb563abe-8e39-44a2-9db3-88c254958cc0","Type":"ContainerDied","Data":"a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf"} Sep 10 04:39:13.131745 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:13.131628 2555 scope.go:117] "RemoveContainer" containerID="2ec802c61d3c86a141b3eef5c3bd4c7bcf97e3e6c71fac063611a16a4253fc5f" Sep 10 04:39:13.131991 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:13.131957 2555 scope.go:117] "RemoveContainer" containerID="a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf" Sep 10 04:39:13.132231 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:39:13.132210 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:39:16.156634 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:16.156605 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:39:16.157002 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:16.156655 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:39:16.157002 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:16.156676 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:39:16.157002 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:16.156691 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:39:16.157107 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:16.157013 2555 scope.go:117] "RemoveContainer" containerID="a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf" Sep 10 04:39:16.157226 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:39:16.157207 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:39:29.543274 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:29.543239 2555 scope.go:117] "RemoveContainer" containerID="a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf" Sep 10 04:39:29.543823 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:39:29.543475 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:39:43.542724 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:43.542635 2555 scope.go:117] "RemoveContainer" containerID="a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf" Sep 10 04:39:43.543114 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:39:43.542816 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:39:58.543467 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:39:58.543431 2555 scope.go:117] "RemoveContainer" containerID="a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf" Sep 10 04:39:58.543836 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:39:58.543653 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:40:10.545576 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:10.545542 2555 scope.go:117] "RemoveContainer" containerID="a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf" Sep 10 04:40:10.546123 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:40:10.545779 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:40:24.543509 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:24.543480 2555 scope.go:117] "RemoveContainer" containerID="a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf" Sep 10 04:40:24.543894 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:40:24.543639 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:40:35.542959 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:35.542930 2555 scope.go:117] "RemoveContainer" containerID="a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf" Sep 10 04:40:36.572426 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:36.572394 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb563abe-8e39-44a2-9db3-88c254958cc0" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" exitCode=0 Sep 10 04:40:36.572817 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:36.572464 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" event={"ID":"fb563abe-8e39-44a2-9db3-88c254958cc0","Type":"ContainerDied","Data":"d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567"} Sep 10 04:40:36.572817 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:36.572524 2555 scope.go:117] "RemoveContainer" containerID="a45648f9ac8f6eebc3e5ead6301573cf6d2be36a236af42cebe02df5fbdf0ebf" Sep 10 04:40:36.572923 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:36.572840 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:40:36.573020 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:40:36.573000 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:40:46.156456 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:46.156412 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:40:46.156937 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:46.156478 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:40:46.156937 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:46.156494 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:40:46.156937 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:46.156507 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" Sep 10 04:40:46.156937 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:40:46.156839 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:40:46.157072 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:40:46.156996 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:41:00.547230 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:41:00.547191 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:41:00.547704 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:41:00.547366 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:41:10.568313 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:41:10.568229 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:41:10.575824 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:41:10.575799 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:41:14.542526 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:41:14.542490 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:41:14.542921 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:41:14.542690 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:41:29.542576 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:41:29.542543 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:41:29.542988 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:41:29.542705 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:41:42.542911 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:41:42.542874 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:41:42.543412 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:41:42.543051 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:41:54.543572 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:41:54.543536 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:41:54.545766 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:41:54.543762 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:42:08.543026 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:08.542991 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:42:08.543434 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:42:08.543148 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:42:20.546343 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:20.546305 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:42:20.546788 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:42:20.546544 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:42:33.543404 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:33.543332 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:42:33.543767 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:42:33.543500 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:42:37.384738 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:37.384709 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-t9m2k_7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c/copy-manifests/0.log" Sep 10 04:42:37.391045 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:37.391027 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-t9m2k_7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c/manager/0.log" Sep 10 04:42:39.344962 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:39.344933 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fsf9w_ff1dea70-a6a6-4e40-8b73-e94307f6bac3/limitador/0.log" Sep 10 04:42:39.936672 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:39.936626 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6s5pz_9df8004f-bfa2-416f-b5f7-91ab224043ee/discovery/0.log" Sep 10 04:42:40.625242 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:40.625209 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5587d886cb-b694w_8331e93c-ec29-4f3b-98a9-9a03c8eab0e5/router/0.log" Sep 10 04:42:40.966018 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:40.965945 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-5tgjl_fb563abe-8e39-44a2-9db3-88c254958cc0/main/5.log" Sep 10 04:42:41.404785 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:41.404759 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw4swz_a01017f4-5f0a-4224-b8e0-00ff190ad7d0/main/0.log" Sep 10 04:42:45.543034 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:45.543001 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:42:45.543410 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:42:45.543180 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:42:49.795132 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:49.795102 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-66jvb_39729577-e75a-4943-949c-647afac710e5/global-pull-secret-syncer/0.log" Sep 10 04:42:49.953589 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:49.953555 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rdj8n_b86f871b-a02c-4026-a329-957bcce55301/konnectivity-agent/0.log" Sep 10 04:42:50.012132 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:50.012103 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-38.ec2.internal_9fdb93b4f2f56237d3ad52cebf5c1335/haproxy/0.log" Sep 10 04:42:54.702388 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:54.702356 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fsf9w_ff1dea70-a6a6-4e40-8b73-e94307f6bac3/limitador/0.log" Sep 10 04:42:56.294090 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:56.294062 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc07d85f-758b-47be-b185-0fae5744d9c8/alertmanager/0.log" Sep 10 04:42:56.315660 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:56.315637 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc07d85f-758b-47be-b185-0fae5744d9c8/config-reloader/0.log" Sep 10 04:42:56.335804 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:56.335778 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc07d85f-758b-47be-b185-0fae5744d9c8/kube-rbac-proxy-web/0.log" Sep 10 04:42:56.360379 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:56.360358 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc07d85f-758b-47be-b185-0fae5744d9c8/kube-rbac-proxy/0.log" Sep 10 04:42:56.397623 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:56.397603 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc07d85f-758b-47be-b185-0fae5744d9c8/kube-rbac-proxy-metric/0.log" Sep 10 04:42:56.426836 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:56.426815 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc07d85f-758b-47be-b185-0fae5744d9c8/prom-label-proxy/0.log" Sep 10 04:42:56.448980 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:56.448956 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc07d85f-758b-47be-b185-0fae5744d9c8/init-config-reloader/0.log" Sep 10 04:42:56.803824 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:56.803797 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnzj5_6c689236-c827-4aab-a0fd-2fa35950729c/node-exporter/0.log" Sep 10 04:42:56.829095 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:56.829072 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnzj5_6c689236-c827-4aab-a0fd-2fa35950729c/kube-rbac-proxy/0.log" Sep 10 04:42:56.848124 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:56.848102 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnzj5_6c689236-c827-4aab-a0fd-2fa35950729c/init-textfile/0.log" Sep 10 04:42:57.206619 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:57.206540 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-gtqbl_599492a4-4be5-4470-b54d-ad4024fdf39a/prometheus-operator/0.log" Sep 10 04:42:57.235118 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:57.235089 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-gtqbl_599492a4-4be5-4470-b54d-ad4024fdf39a/kube-rbac-proxy/0.log" Sep 10 04:42:57.303761 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:57.303737 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d9556c6c4-v9pxj_38263b90-c9a1-44b4-b303-f8c5932c475c/telemeter-client/0.log" Sep 10 04:42:57.325065 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:57.325042 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d9556c6c4-v9pxj_38263b90-c9a1-44b4-b303-f8c5932c475c/reload/0.log" Sep 10 04:42:57.349350 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:57.349324 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d9556c6c4-v9pxj_38263b90-c9a1-44b4-b303-f8c5932c475c/kube-rbac-proxy/0.log" Sep 10 04:42:57.543210 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:57.543109 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:42:57.543355 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:42:57.543340 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:42:58.894011 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:58.893978 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-jmk74_30be0e41-dcec-426a-90c2-50bb57e8bba7/networking-console-plugin/0.log" Sep 10 04:42:59.654671 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.654632 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6"] Sep 10 04:42:59.658236 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.658220 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.660895 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.660870 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfjbl\"/\"kube-root-ca.crt\"" Sep 10 04:42:59.662225 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.662206 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfjbl\"/\"openshift-service-ca.crt\"" Sep 10 04:42:59.662346 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.662212 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zfjbl\"/\"default-dockercfg-gnz5s\"" Sep 10 04:42:59.668470 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.668439 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6"] Sep 10 04:42:59.739569 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.739537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-podres\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.739569 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.739570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb7hw\" (UniqueName: \"kubernetes.io/projected/17e0bd24-57d1-41ea-8f2c-7b305d392e73-kube-api-access-cb7hw\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.739782 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.739594 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-proc\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.739782 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.739621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-sys\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.739782 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.739672 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-lib-modules\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.840919 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.840883 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-podres\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.840919 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.840918 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb7hw\" (UniqueName: \"kubernetes.io/projected/17e0bd24-57d1-41ea-8f2c-7b305d392e73-kube-api-access-cb7hw\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.841158 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.840943 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-proc\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.841158 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.841058 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-sys\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.841158 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.841082 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-podres\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.841158 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.841094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-lib-modules\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.841364 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.841179 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-sys\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.841364 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.841158 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-proc\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.841364 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.841211 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17e0bd24-57d1-41ea-8f2c-7b305d392e73-lib-modules\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.848930 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.848904 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb7hw\" (UniqueName: \"kubernetes.io/projected/17e0bd24-57d1-41ea-8f2c-7b305d392e73-kube-api-access-cb7hw\") pod \"perf-node-gather-daemonset-dtzd6\" (UID: \"17e0bd24-57d1-41ea-8f2c-7b305d392e73\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:42:59.969394 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:42:59.969308 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:43:00.040760 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:00.040691 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79dff7cf57-rjxmr_ef387c2a-928a-4533-9d87-ada3835602d9/console/0.log" Sep 10 04:43:00.242559 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:00.242532 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6"] Sep 10 04:43:00.243846 ip-10-0-140-38 kubenswrapper[2555]: W0910 04:43:00.243820 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod17e0bd24_57d1_41ea_8f2c_7b305d392e73.slice/crio-60460858b46c20d11b506c95fe8e4725744beaf027de7a0b2edfc43ba4fefe21 WatchSource:0}: Error finding container 60460858b46c20d11b506c95fe8e4725744beaf027de7a0b2edfc43ba4fefe21: Status 404 returned error can't find the container with id 60460858b46c20d11b506c95fe8e4725744beaf027de7a0b2edfc43ba4fefe21 Sep 10 04:43:00.310127 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:00.310094 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" event={"ID":"17e0bd24-57d1-41ea-8f2c-7b305d392e73","Type":"ContainerStarted","Data":"60460858b46c20d11b506c95fe8e4725744beaf027de7a0b2edfc43ba4fefe21"} Sep 10 04:43:01.317234 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:01.317192 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" event={"ID":"17e0bd24-57d1-41ea-8f2c-7b305d392e73","Type":"ContainerStarted","Data":"ac8d95cb072936291e2e725ad7f5bb9820b11b3d642f418e7323a183e7fd811e"} Sep 10 04:43:01.317626 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:01.317295 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:43:01.333354 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:01.333298 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" podStartSLOduration=2.333282332 podStartE2EDuration="2.333282332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:43:01.331280902 +0000 UTC m=+1011.268192391" watchObservedRunningTime="2026-09-10 04:43:01.333282332 +0000 UTC m=+1011.270193804" Sep 10 04:43:01.831746 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:01.831716 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bb67w_4a5862c6-e214-40b4-ae41-d1a29f99f550/dns/0.log" Sep 10 04:43:01.849055 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:01.849030 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bb67w_4a5862c6-e214-40b4-ae41-d1a29f99f550/kube-rbac-proxy/0.log" Sep 10 04:43:01.958686 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:01.958663 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5kv8_59056bf7-c39f-4b7a-add4-14b7cce7eaf4/dns-node-resolver/0.log" Sep 10 04:43:02.479796 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:02.479750 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c7b65bd4d-6scs2_f7e57983-7c68-4ca9-8471-f010fcaf3aeb/registry/0.log" Sep 10 04:43:02.517267 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:02.517236 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8k86_b63665a1-098c-4ed3-bbbf-216f1ea2bb8f/node-ca/0.log" Sep 10 04:43:03.454641 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:03.454610 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6s5pz_9df8004f-bfa2-416f-b5f7-91ab224043ee/discovery/0.log" Sep 10 04:43:03.577610 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:03.577581 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5587d886cb-b694w_8331e93c-ec29-4f3b-98a9-9a03c8eab0e5/router/0.log" Sep 10 04:43:04.174457 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:04.174433 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-74gkc_dd2f2688-72b5-40bc-bdc6-c53a5ec76fb9/serve-healthcheck-canary/0.log" Sep 10 04:43:04.663486 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:04.663451 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-g8vg7_42008412-8080-44cc-b338-b5b1539b51e3/insights-operator/1.log" Sep 10 04:43:04.663942 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:04.663844 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-g8vg7_42008412-8080-44cc-b338-b5b1539b51e3/insights-operator/0.log" Sep 10 04:43:04.743701 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:04.743669 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh2vv_1a83e291-e5e5-4bd0-b771-447b737c1540/kube-rbac-proxy/0.log" Sep 10 04:43:04.761103 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:04.761078 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh2vv_1a83e291-e5e5-4bd0-b771-447b737c1540/exporter/0.log" Sep 10 04:43:04.779531 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:04.779505 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh2vv_1a83e291-e5e5-4bd0-b771-447b737c1540/extractor/0.log" Sep 10 04:43:07.095616 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:07.095589 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-t9m2k_7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c/manager/0.log" Sep 10 04:43:07.116128 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:07.116101 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-t9m2k_7cdd6a0c-5fd2-4702-ac0a-fde97098dd2c/copy-manifests/0.log" Sep 10 04:43:07.332870 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:07.332845 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-dtzd6" Sep 10 04:43:08.283890 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:08.283860 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55f5554b4b-8t5zv_7b104801-6777-416f-884a-724f9b55429d/manager/0.log" Sep 10 04:43:10.350694 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:10.350663 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6s5pz_9df8004f-bfa2-416f-b5f7-91ab224043ee/discovery/0.log" Sep 10 04:43:10.468289 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:10.468245 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5587d886cb-b694w_8331e93c-ec29-4f3b-98a9-9a03c8eab0e5/router/0.log" Sep 10 04:43:11.543260 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:11.543229 2555 scope.go:117] "RemoveContainer" containerID="d0cf06ca2b52a4f5d35a09a7ee06fb88aaecd7733083defb6d5558b6578f3567" Sep 10 04:43:11.543631 ip-10-0-140-38 kubenswrapper[2555]: E0910 04:43:11.543414 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5tgjl_llm(fb563abe-8e39-44a2-9db3-88c254958cc0)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5tgjl" podUID="fb563abe-8e39-44a2-9db3-88c254958cc0" Sep 10 04:43:11.696748 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:11.696712 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6s5pz_9df8004f-bfa2-416f-b5f7-91ab224043ee/discovery/0.log" Sep 10 04:43:11.823643 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:11.823618 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5587d886cb-b694w_8331e93c-ec29-4f3b-98a9-9a03c8eab0e5/router/0.log" Sep 10 04:43:14.041090 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:14.041054 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-8g5xl_fbc3e870-876e-4ef7-9c07-7402473cc2ad/kube-storage-version-migrator-operator/1.log" Sep 10 04:43:14.041771 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:14.041753 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-8g5xl_fbc3e870-876e-4ef7-9c07-7402473cc2ad/kube-storage-version-migrator-operator/0.log" Sep 10 04:43:15.022407 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:15.022373 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7cbwj_585473ab-86f2-4972-9108-19b67edd1a06/kube-multus/0.log" Sep 10 04:43:15.179591 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:15.179556 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hxp2_60afc3da-8b47-4964-9997-ff5167095ed0/kube-multus-additional-cni-plugins/0.log" Sep 10 04:43:15.199451 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:15.199424 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hxp2_60afc3da-8b47-4964-9997-ff5167095ed0/egress-router-binary-copy/0.log" Sep 10 04:43:15.219387 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:15.219364 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hxp2_60afc3da-8b47-4964-9997-ff5167095ed0/cni-plugins/0.log" Sep 10 04:43:15.237428 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:15.237399 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hxp2_60afc3da-8b47-4964-9997-ff5167095ed0/bond-cni-plugin/0.log" Sep 10 04:43:15.253976 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:15.253956 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hxp2_60afc3da-8b47-4964-9997-ff5167095ed0/routeoverride-cni/0.log" Sep 10 04:43:15.270852 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:15.270832 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hxp2_60afc3da-8b47-4964-9997-ff5167095ed0/whereabouts-cni-bincopy/0.log" Sep 10 04:43:15.290149 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:15.290090 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hxp2_60afc3da-8b47-4964-9997-ff5167095ed0/whereabouts-cni/0.log" Sep 10 04:43:15.561673 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:15.561644 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-clrgs_a348378a-58b7-43b0-9e14-76c8a8ba1679/network-metrics-daemon/0.log" Sep 10 04:43:15.576991 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:15.576955 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-clrgs_a348378a-58b7-43b0-9e14-76c8a8ba1679/kube-rbac-proxy/0.log" Sep 10 04:43:16.528574 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:16.528541 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-controller/0.log" Sep 10 04:43:16.544121 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:16.544085 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/0.log" Sep 10 04:43:16.544121 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:16.544105 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovn-acl-logging/1.log" Sep 10 04:43:16.559709 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:16.559687 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/kube-rbac-proxy-node/0.log" Sep 10 04:43:16.578439 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:16.578414 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 04:43:16.600586 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:16.600566 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/northd/0.log" Sep 10 04:43:16.623654 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:16.623628 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/nbdb/0.log" Sep 10 04:43:16.647904 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:16.647883 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/sbdb/0.log" Sep 10 04:43:16.683256 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:16.683234 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcvsz_a6423083-a77c-492f-b9eb-0cfb8da61729/ovnkube-controller/0.log" Sep 10 04:43:17.999477 ip-10-0-140-38 kubenswrapper[2555]: I0910 04:43:17.999447 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pmsfj_62deddbb-4d33-4337-a967-a45e6508cada/network-check-target-container/0.log"