Sep 07 20:55:25.256680 ip-10-0-140-24 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 07 20:55:25.256692 ip-10-0-140-24 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 07 20:55:25.256699 ip-10-0-140-24 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 07 20:55:25.256878 ip-10-0-140-24 systemd[1]: Failed to start Kubernetes Kubelet. Sep 07 20:55:36.571629 ip-10-0-140-24 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 07 20:55:36.571649 ip-10-0-140-24 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3d09450de6794f75bf43c4f90f019cba -- Sep 07 20:57:13.605657 ip-10-0-140-24 systemd[1]: Starting Kubernetes Kubelet... Sep 07 20:57:14.033585 ip-10-0-140-24 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 20:57:14.033585 ip-10-0-140-24 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 20:57:14.033585 ip-10-0-140-24 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 20:57:14.033585 ip-10-0-140-24 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 20:57:14.033585 ip-10-0-140-24 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 20:57:14.034368 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.033733 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 20:57:14.039922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039897 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 20:57:14.039922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039921 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039927 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039931 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039936 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039939 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039943 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039947 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039951 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039955 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039962 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039967 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039972 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039976 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039980 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039985 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039989 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.039995 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040000 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 20:57:14.039997 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040006 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040010 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040014 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040019 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040022 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040027 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040031 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040035 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040038 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040042 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040046 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040050 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040053 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040056 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040060 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040064 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040067 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040071 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040074 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040078 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 20:57:14.040438 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040082 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040085 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040089 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040093 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040097 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040100 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040103 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040107 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040110 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040114 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040117 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040121 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040125 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040128 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040134 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040138 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040142 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040146 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040149 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040153 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 20:57:14.040922 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040160 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040163 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040167 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040170 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040174 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040178 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040182 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040185 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040189 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040193 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040196 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040200 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040204 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040209 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040212 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040215 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040219 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040223 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040227 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040230 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 20:57:14.041422 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040238 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040243 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040247 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040250 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040254 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040262 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040267 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040271 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040274 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040278 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040282 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040285 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040289 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040292 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040296 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040299 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040303 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040306 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040328 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 20:57:14.041948 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.040332 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041384 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041394 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041398 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041402 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041407 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041411 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041416 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041420 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041424 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041428 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041432 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041436 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041444 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041449 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041454 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041458 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041461 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041468 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 20:57:14.042428 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041472 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041476 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041479 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041483 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041487 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041491 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041495 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041498 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041503 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041506 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041513 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041518 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041523 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041526 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041530 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041534 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041538 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041542 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041546 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 20:57:14.042907 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041549 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041555 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041558 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041562 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041566 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041570 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041574 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041578 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041581 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041585 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041589 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041596 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041603 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041608 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041612 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041616 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041620 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041624 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041628 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 20:57:14.043403 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041632 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041636 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041640 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041644 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041648 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041652 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041656 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041659 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041663 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041667 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041671 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041675 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041679 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041683 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041686 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041691 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041694 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041698 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041703 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041706 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 07 20:57:14.043869 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041711 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041716 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041720 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041724 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041727 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041733 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041737 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041740 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041743 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041747 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041751 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041754 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041758 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041761 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041765 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041768 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041772 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041776 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041780 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041785 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 20:57:14.044377 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041788 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041792 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.041796 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042376 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042390 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042395 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042398 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042402 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042405 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042408 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042411 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042415 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042417 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042420 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042423 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042425 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042428 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042431 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042433 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042436 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 20:57:14.044874 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042439 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042442 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042445 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042447 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042450 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042453 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042455 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042458 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042461 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042463 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042466 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042468 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042471 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042474 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042476 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042479 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042483 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042486 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042489 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042491 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 20:57:14.045379 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042494 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042496 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042499 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042502 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042504 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042509 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042514 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042517 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042520 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042523 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042527 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042529 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042532 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042534 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042537 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042540 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042542 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042545 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042547 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 20:57:14.045872 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042550 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042553 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042555 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042558 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042561 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042563 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042566 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042568 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042570 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042577 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042580 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042583 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042586 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042590 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042593 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042596 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042599 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042601 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042604 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 20:57:14.046333 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042606 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042609 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042611 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042614 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042616 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042620 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042624 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042627 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042630 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042632 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042635 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042638 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042640 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042643 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042646 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042648 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042651 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042653 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042656 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 20:57:14.046835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042658 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042661 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042663 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042667 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.042670 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042773 2578 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042817 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042825 2578 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042830 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042834 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042838 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042842 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042847 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042850 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042853 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042857 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042860 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042864 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042867 2578 flags.go:64] FLAG: --cgroup-root="" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042870 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042873 2578 flags.go:64] FLAG: --client-ca-file="" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042876 2578 flags.go:64] FLAG: --cloud-provider="external" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042879 2578 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042884 2578 flags.go:64] FLAG: --cluster-domain="" Sep 07 20:57:14.047323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042887 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042890 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042893 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042897 2578 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042901 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042904 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042909 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042913 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042916 2578 flags.go:64] FLAG: --contention-profiling="false" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042919 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042922 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042927 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042930 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042935 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042938 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042942 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042945 2578 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042948 2578 flags.go:64] FLAG: --enable-server="true" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042951 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042956 2578 flags.go:64] FLAG: --event-burst="100" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042959 2578 flags.go:64] FLAG: --event-qps="50" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042962 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042966 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042969 2578 flags.go:64] FLAG: --eviction-hard="" Sep 07 20:57:14.047902 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042973 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042976 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042979 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042982 2578 flags.go:64] FLAG: --eviction-soft="" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042985 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042988 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042991 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042994 2578 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.042997 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043000 2578 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043003 2578 flags.go:64] FLAG: --feature-gates="" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043006 2578 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043010 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043013 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043016 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043019 2578 flags.go:64] FLAG: --healthz-port="10248" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043022 2578 flags.go:64] FLAG: --help="false" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043025 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043028 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043032 2578 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043035 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043039 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043042 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043046 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 20:57:14.048500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043049 2578 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043051 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043054 2578 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043058 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043061 2578 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043064 2578 flags.go:64] FLAG: --kube-reserved="" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043066 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043069 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043073 2578 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043075 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043079 2578 flags.go:64] FLAG: --lock-file="" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043082 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043085 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043088 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043094 2578 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043105 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043108 2578 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043111 2578 flags.go:64] FLAG: --logging-format="text" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043114 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043118 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043121 2578 flags.go:64] FLAG: --manifest-url="" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043124 2578 flags.go:64] FLAG: --manifest-url-header="" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043129 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043132 2578 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043136 2578 flags.go:64] FLAG: --max-pods="110" Sep 07 20:57:14.049102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043139 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043144 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043151 2578 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043154 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043157 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043161 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043164 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043173 2578 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043176 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043179 2578 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043182 2578 flags.go:64] FLAG: --pod-cidr="" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043185 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043191 2578 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043194 2578 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043198 2578 flags.go:64] FLAG: --pods-per-core="0" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043201 2578 flags.go:64] FLAG: --port="10250" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043204 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043207 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-063be2aaa87784126" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043210 2578 flags.go:64] FLAG: --qos-reserved="" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043213 2578 flags.go:64] FLAG: --read-only-port="10255" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043216 2578 flags.go:64] FLAG: --register-node="true" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043219 2578 flags.go:64] FLAG: --register-with-taints="" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043223 2578 flags.go:64] FLAG: --registry-burst="10" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043226 2578 flags.go:64] FLAG: --registry-qps="5" Sep 07 20:57:14.049739 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043229 2578 flags.go:64] FLAG: --reserved-cpus="" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043232 2578 flags.go:64] FLAG: --reserved-memory="" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043236 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043239 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043242 2578 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043245 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043248 2578 flags.go:64] FLAG: --runonce="false" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043251 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043254 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043259 2578 flags.go:64] FLAG: --seccomp-default="false" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043262 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043266 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043269 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043272 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043277 2578 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043280 2578 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043284 2578 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043287 2578 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043290 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043293 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043296 2578 flags.go:64] FLAG: --system-cgroups="" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043299 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043305 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043322 2578 flags.go:64] FLAG: --tls-cert-file="" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043326 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 20:57:14.050490 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043330 2578 flags.go:64] FLAG: --tls-min-version="" Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043333 2578 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043336 2578 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043339 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043342 2578 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043345 2578 flags.go:64] FLAG: --v="2" Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043350 2578 flags.go:64] FLAG: --version="false" Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043354 2578 flags.go:64] FLAG: --vmodule="" Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043358 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.043361 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043480 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043484 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043488 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043492 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043496 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043499 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043503 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043506 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043509 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043512 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043515 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 20:57:14.051124 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043517 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043520 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043522 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043526 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043529 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043531 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043534 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043537 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043539 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043542 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043544 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043547 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043550 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043552 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043555 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043557 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043560 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043563 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043565 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043567 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 20:57:14.051846 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043570 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043573 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043575 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043578 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043580 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043582 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043585 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043589 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043591 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043594 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043596 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043599 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043602 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043604 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043607 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043609 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043612 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043615 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043618 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043620 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 20:57:14.052730 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043623 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043625 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043628 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043630 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043632 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043635 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043638 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043640 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043643 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043647 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043651 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043654 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043656 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043659 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043662 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043665 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043668 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043670 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043673 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043677 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 20:57:14.053716 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043679 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043682 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043685 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043687 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043690 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043693 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043696 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043698 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043700 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043703 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043706 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043708 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043711 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043713 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043716 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043718 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043721 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043723 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043726 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 20:57:14.054337 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043728 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043731 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043733 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043736 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043738 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043741 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043744 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043746 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.043750 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.044669 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.053808 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 20:57:14.054816 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.054028 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.055038 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.055059 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055171 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055180 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055186 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055191 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055195 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055199 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055204 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055208 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055212 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055217 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055221 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055225 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055229 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055234 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055238 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055242 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 20:57:14.055248 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055246 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055250 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055254 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055258 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055262 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055267 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055271 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055275 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055279 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055283 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055287 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055291 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055296 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055301 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055305 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055323 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055327 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055333 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055336 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055340 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 20:57:14.056075 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055344 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055348 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055352 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055356 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055360 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055364 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055369 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055376 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055383 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055387 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055391 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055395 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055400 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055403 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055409 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055413 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055417 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055422 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055426 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055430 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 20:57:14.056813 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055434 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055439 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055443 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055447 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055452 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055456 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055461 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055466 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055470 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055475 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055481 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055485 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055489 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055494 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055498 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055502 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055506 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055511 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055515 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 20:57:14.057352 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055519 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055524 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055528 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055532 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055537 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055541 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055548 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055555 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055560 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055565 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055569 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055574 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055580 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055585 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055590 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055595 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055600 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055605 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055609 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 20:57:14.058125 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055614 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055618 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055622 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055627 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055630 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.055640 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055833 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055843 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055848 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055853 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055858 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055862 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055867 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055872 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055876 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 20:57:14.058934 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055880 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055885 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055889 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055893 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055897 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055901 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055906 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055911 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055915 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055920 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055927 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055933 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055938 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055942 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055947 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055952 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055956 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055960 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055965 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 20:57:14.059360 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055969 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055973 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055977 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055981 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055986 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055990 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055995 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.055999 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056003 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056007 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056012 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056016 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056020 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056024 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056028 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056032 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056036 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056040 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056044 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056049 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 20:57:14.059835 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056053 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056057 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056061 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056065 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056069 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056073 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056077 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056080 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056084 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056088 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056092 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056096 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056101 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056105 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056109 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056113 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056118 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056123 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056127 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 20:57:14.060343 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056131 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056136 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056140 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056145 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056149 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056154 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056158 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056163 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056167 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056171 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056176 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056180 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056185 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056190 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056194 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056199 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056203 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056207 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056212 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 20:57:14.060806 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056216 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056220 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056226 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056231 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056237 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056241 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056246 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056250 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056255 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056260 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056265 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056269 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:14.056274 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.056283 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 20:57:14.061272 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.056485 2578 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 20:57:14.130645 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.130611 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 20:57:14.133786 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.133760 2578 server.go:1019] "Starting client certificate rotation" Sep 07 20:57:14.133900 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.133881 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 20:57:14.133933 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.133916 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 20:57:14.136722 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.136701 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 20:57:14.140768 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.140745 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 20:57:14.155776 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.155752 2578 log.go:25] "Validated CRI v1 runtime API" Sep 07 20:57:14.159474 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.159451 2578 log.go:25] "Validated CRI v1 image API" Sep 07 20:57:14.160389 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.160370 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 20:57:14.164277 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.164255 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 20:57:14.165030 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.165002 2578 fs.go:135] Filesystem UUIDs: map[2815c977-2a0d-4819-8ac2-fa9b0899f346:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8af8dba2-8be4-4b62-a62a-c47a2d8bf057:/dev/nvme0n1p3] Sep 07 20:57:14.165089 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.165031 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 20:57:14.171482 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.171352 2578 manager.go:216] Machine: {Timestamp:2026-09-07 20:57:14.16987803 +0000 UTC m=+0.458247301 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093473 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec226ca895ba01708fba0abdbbc33282 SystemUUID:ec226ca8-95ba-0170-8fba-0abdbbc33282 BootID:3d09450d-e679-4f75-bf43-c4f90f019cba Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9a:3e:00:0e:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9a:3e:00:0e:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:5c:65:7b:87:ca Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 20:57:14.171482 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.171473 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 20:57:14.171636 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.171624 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 20:57:14.175259 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.175227 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 20:57:14.175454 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.175262 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-24.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 20:57:14.176869 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.176855 2578 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 20:57:14.176904 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.176871 2578 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 20:57:14.176904 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.176884 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 20:57:14.177876 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.177860 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 20:57:14.179857 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.179842 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 20:57:14.184672 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.184655 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 07 20:57:14.184813 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.184803 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 20:57:14.184844 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.184836 2578 kubelet.go:486] "Attempting to sync node with API server" Sep 07 20:57:14.184874 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.184849 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 20:57:14.184874 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.184863 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 20:57:14.184927 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.184876 2578 kubelet.go:398] "Adding apiserver pod source" Sep 07 20:57:14.184927 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.184885 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 20:57:14.185410 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.185390 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 20:57:14.185483 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.185427 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 20:57:14.189381 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.189356 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 20:57:14.192398 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.192380 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 20:57:14.192495 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.192412 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 20:57:14.192588 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.192578 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 20:57:14.192618 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.192593 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 20:57:14.192618 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.192599 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 20:57:14.192618 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.192604 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 20:57:14.192618 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.192612 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 20:57:14.192618 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.192618 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 20:57:14.193230 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.193221 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 20:57:14.193261 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.193230 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 20:57:14.193261 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.193237 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 20:57:14.193261 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.193243 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 20:57:14.193261 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.193252 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 20:57:14.193261 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.193259 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 20:57:14.194170 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.194159 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 20:57:14.194207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.194172 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 20:57:14.198239 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.198218 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 20:57:14.198363 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.198259 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 20:57:14.198411 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.198357 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 20:57:14.198609 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.198597 2578 server.go:1268] "Started kubelet" Sep 07 20:57:14.198707 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.198681 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 20:57:14.198767 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.198713 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 20:57:14.198811 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.198796 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 20:57:14.199479 ip-10-0-140-24 systemd[1]: Started Kubernetes Kubelet. Sep 07 20:57:14.200453 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.200431 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 20:57:14.201366 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.201353 2578 server.go:310] "Adding debug handlers to kubelet server" Sep 07 20:57:14.203922 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.203890 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 20:57:14.204803 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.203663 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-24.ec2.internal.18d3256ea86d08f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-24.ec2.internal,UID:ip-10-0-140-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-24.ec2.internal,},FirstTimestamp:2026-09-07 20:57:14.198567161 +0000 UTC m=+0.486936436,LastTimestamp:2026-09-07 20:57:14.198567161 +0000 UTC m=+0.486936436,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-24.ec2.internal,}" Sep 07 20:57:14.206091 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.206072 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 20:57:14.206182 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.206092 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 20:57:14.206182 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.206173 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Sep 07 20:57:14.206906 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.206887 2578 factory.go:55] Registering systemd factory Sep 07 20:57:14.206906 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.206908 2578 factory.go:223] Registration of the systemd container factory successfully Sep 07 20:57:14.207063 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.206942 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 20:57:14.207063 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.206983 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 20:57:14.207063 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.207007 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 20:57:14.207238 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.207141 2578 factory.go:153] Registering CRI-O factory Sep 07 20:57:14.207238 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.207156 2578 factory.go:223] Registration of the crio container factory successfully Sep 07 20:57:14.207238 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.207167 2578 reconstruct.go:97] "Volume reconstruction finished" Sep 07 20:57:14.207238 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.207178 2578 reconciler.go:29] "Reconciler: start to sync state" Sep 07 20:57:14.207238 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.207206 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 20:57:14.207238 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.207225 2578 factory.go:103] Registering Raw factory Sep 07 20:57:14.207238 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.207240 2578 manager.go:1196] Started watching for new ooms in manager Sep 07 20:57:14.207749 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.207735 2578 manager.go:349] Starting recovery of all containers Sep 07 20:57:14.213394 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.213304 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 07 20:57:14.213758 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.213734 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 07 20:57:14.217917 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.217890 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h79z4" Sep 07 20:57:14.221081 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.221063 2578 manager.go:354] Recovery completed Sep 07 20:57:14.225390 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.225370 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h79z4" Sep 07 20:57:14.226148 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.226132 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 20:57:14.228925 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.228907 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Sep 07 20:57:14.229005 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.228940 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 20:57:14.229005 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.228954 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Sep 07 20:57:14.229584 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.229568 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 20:57:14.229584 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.229581 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 20:57:14.229678 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.229601 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 07 20:57:14.229678 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.229607 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 20:57:14.230341 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.230326 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Sep 07 20:57:14.230407 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.230354 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 20:57:14.230407 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.230366 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Sep 07 20:57:14.231168 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.231052 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-24.ec2.internal.18d3256eaa3c3f9c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-24.ec2.internal,UID:ip-10-0-140-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-24.ec2.internal,},FirstTimestamp:2026-09-07 20:57:14.228924316 +0000 UTC m=+0.517293586,LastTimestamp:2026-09-07 20:57:14.228924316 +0000 UTC m=+0.517293586,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-24.ec2.internal,}" Sep 07 20:57:14.231582 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.231571 2578 policy_none.go:49] "None policy: Start" Sep 07 20:57:14.231618 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.231587 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 20:57:14.231618 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.231597 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 20:57:14.233678 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.233666 2578 policy_none.go:47] "Start" Sep 07 20:57:14.272970 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.272931 2578 manager.go:337] "Starting Device Plugin manager" Sep 07 20:57:14.292228 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.272982 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 20:57:14.292228 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.272996 2578 server.go:87] "Starting device plugin registration server" Sep 07 20:57:14.292228 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.273287 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 20:57:14.292228 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.273300 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 20:57:14.292228 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.273391 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 20:57:14.292228 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.273481 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 20:57:14.292228 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.273488 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 20:57:14.292228 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.274086 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 20:57:14.292228 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.274134 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-24.ec2.internal\" not found" Sep 07 20:57:14.310763 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.310722 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 20:57:14.312053 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.312036 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 20:57:14.312118 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.312092 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 20:57:14.312118 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.312118 2578 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 20:57:14.312228 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.312157 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 20:57:14.313651 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.313623 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 20:57:14.374014 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.373968 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 20:57:14.375103 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.375078 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Sep 07 20:57:14.375219 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.375123 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 20:57:14.375219 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.375138 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Sep 07 20:57:14.375219 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.375168 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.381306 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.381280 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.381423 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.381325 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-24.ec2.internal\": node \"ip-10-0-140-24.ec2.internal\" not found" Sep 07 20:57:14.402444 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.402411 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Sep 07 20:57:14.412730 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.412678 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal"] Sep 07 20:57:14.412816 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.412779 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 20:57:14.413893 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.413867 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Sep 07 20:57:14.413998 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.413904 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 20:57:14.413998 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.413913 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Sep 07 20:57:14.416213 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.416199 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 20:57:14.416371 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.416355 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.416412 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.416404 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 20:57:14.417097 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.417075 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Sep 07 20:57:14.417224 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.417106 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 20:57:14.417224 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.417118 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Sep 07 20:57:14.417224 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.417075 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Sep 07 20:57:14.417224 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.417196 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 20:57:14.417224 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.417210 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Sep 07 20:57:14.419584 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.419566 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.419677 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.419594 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 20:57:14.420422 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.420406 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Sep 07 20:57:14.420518 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.420432 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 20:57:14.420518 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.420456 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Sep 07 20:57:14.436018 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.435988 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-24.ec2.internal\" not found" node="ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.440420 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.440402 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-24.ec2.internal\" not found" node="ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.503230 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.503194 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Sep 07 20:57:14.508510 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.508486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdf03853ada29dc907108cd2cb3e25b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"bdf03853ada29dc907108cd2cb3e25b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.508607 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.508518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdf03853ada29dc907108cd2cb3e25b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"bdf03853ada29dc907108cd2cb3e25b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.508607 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.508536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87d2f7628ee920e5b6f01791cc8df082-config\") pod \"kube-apiserver-proxy-ip-10-0-140-24.ec2.internal\" (UID: \"87d2f7628ee920e5b6f01791cc8df082\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.603679 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.603654 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Sep 07 20:57:14.609042 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.609022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdf03853ada29dc907108cd2cb3e25b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"bdf03853ada29dc907108cd2cb3e25b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.609111 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.609049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdf03853ada29dc907108cd2cb3e25b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"bdf03853ada29dc907108cd2cb3e25b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.609111 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.609067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87d2f7628ee920e5b6f01791cc8df082-config\") pod \"kube-apiserver-proxy-ip-10-0-140-24.ec2.internal\" (UID: \"87d2f7628ee920e5b6f01791cc8df082\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.609178 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.609118 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdf03853ada29dc907108cd2cb3e25b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"bdf03853ada29dc907108cd2cb3e25b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.609178 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.609155 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdf03853ada29dc907108cd2cb3e25b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"bdf03853ada29dc907108cd2cb3e25b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.609239 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.609210 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87d2f7628ee920e5b6f01791cc8df082-config\") pod \"kube-apiserver-proxy-ip-10-0-140-24.ec2.internal\" (UID: \"87d2f7628ee920e5b6f01791cc8df082\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.703984 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.703939 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Sep 07 20:57:14.738589 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.738563 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.743563 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:14.743539 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Sep 07 20:57:14.804721 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.804674 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Sep 07 20:57:14.905376 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:14.905287 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Sep 07 20:57:15.006301 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.006264 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Sep 07 20:57:15.089214 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.089182 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 20:57:15.106600 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.106567 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Sep 07 20:57:15.115323 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.115291 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 20:57:15.116796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.116781 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Sep 07 20:57:15.128122 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.128093 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 20:57:15.133259 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.133237 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 20:57:15.133405 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.133387 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 20:57:15.133447 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.133410 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 20:57:15.181580 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.181551 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 20:57:15.185581 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.185561 2578 apiserver.go:52] "Watching apiserver" Sep 07 20:57:15.194591 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.194562 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 20:57:15.195077 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.194952 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-29pbq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf","openshift-cluster-node-tuning-operator/tuned-jjgzl","openshift-multus/network-metrics-daemon-5645v","openshift-network-diagnostics/network-check-target-lvmpk","openshift-network-operator/iptables-alerter-5rs5c","openshift-ovn-kubernetes/ovnkube-node-9qjfq","kube-system/global-pull-secret-syncer-khvqk","kube-system/konnectivity-agent-hk9kl","kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal","openshift-dns/node-resolver-4fcrz","openshift-image-registry/node-ca-v64xb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal","openshift-multus/multus-9kn7f"] Sep 07 20:57:15.197664 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.197642 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.200035 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.200004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.200035 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.200023 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 20:57:15.200397 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.200380 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 20:57:15.200492 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.200479 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 20:57:15.200641 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.200622 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 20:57:15.201160 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.201144 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 20:57:15.201227 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.201172 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 20:57:15.201278 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.201233 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-87d8n\"" Sep 07 20:57:15.202282 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.202265 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.202764 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.202730 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-89hk9\"" Sep 07 20:57:15.202764 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.202738 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 20:57:15.202885 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.202765 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 20:57:15.204472 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.204445 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 20:57:15.204472 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.204464 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j8vpc\"" Sep 07 20:57:15.204591 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.204519 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 20:57:15.204874 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.204861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:15.204938 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.204920 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:15.206198 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.206183 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 20:57:15.207218 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.207203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:15.207304 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.207252 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:15.209597 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.209571 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.211658 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.211638 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 20:57:15.211915 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.211893 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:15.212203 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-sysctl-d\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.212291 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-tmp\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.212291 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5397147-b3c6-4e8a-a59f-bdad3a3d8f14-host-slash\") pod \"iptables-alerter-5rs5c\" (UID: \"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14\") " pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.212291 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212265 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 20:57:15.212493 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-slash\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212493 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212337 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-node-log\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212493 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212380 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 20:57:15.212493 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-log-socket\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212493 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f5cbd85-da5a-4640-81f4-1e0761ae9d52-hosts-file\") pod \"node-resolver-4fcrz\" (UID: \"6f5cbd85-da5a-4640-81f4-1e0761ae9d52\") " pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.212493 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-sysctl-conf\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.212493 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-systemd\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.212493 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f5cbd85-da5a-4640-81f4-1e0761ae9d52-tmp-dir\") pod \"node-resolver-4fcrz\" (UID: \"6f5cbd85-da5a-4640-81f4-1e0761ae9d52\") " pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.212493 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f5397147-b3c6-4e8a-a59f-bdad3a3d8f14-iptables-alerter-script\") pod \"iptables-alerter-5rs5c\" (UID: \"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14\") " pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-etc-openvswitch\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-cni-bin\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-cni-netd\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea5b378c-0a95-47ad-9771-b8685555c45c-ovn-node-metrics-cert\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c66hs\" (UniqueName: \"kubernetes.io/projected/6f5cbd85-da5a-4640-81f4-1e0761ae9d52-kube-api-access-c66hs\") pod \"node-resolver-4fcrz\" (UID: \"6f5cbd85-da5a-4640-81f4-1e0761ae9d52\") " pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfvlz\" (UniqueName: \"kubernetes.io/projected/af830417-6366-47ce-868f-221f859ff24e-kube-api-access-nfvlz\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea5b378c-0a95-47ad-9771-b8685555c45c-ovnkube-config\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212770 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea5b378c-0a95-47ad-9771-b8685555c45c-ovnkube-script-lib\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdnm\" (UniqueName: \"kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm\") pod \"network-check-target-lvmpk\" (UID: \"ec254331-d4df-4295-84bd-ee477edb9b85\") " pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-kubelet\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-systemd-units\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-run-systemd\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thdjp\" (UniqueName: \"kubernetes.io/projected/ea5b378c-0a95-47ad-9771-b8685555c45c-kube-api-access-thdjp\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.212967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212931 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-run-netns\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.212982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-modprobe-d\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-sys\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-var-lib-kubelet\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-run-openvswitch\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-var-lib-openvswitch\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213139 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-run\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-host\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjrmq\" (UniqueName: \"kubernetes.io/projected/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-kube-api-access-hjrmq\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-run-ovn\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-lib-modules\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-tuned\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t4tt\" (UniqueName: \"kubernetes.io/projected/f5397147-b3c6-4e8a-a59f-bdad3a3d8f14-kube-api-access-5t4tt\") pod \"iptables-alerter-5rs5c\" (UID: \"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14\") " pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea5b378c-0a95-47ad-9771-b8685555c45c-env-overrides\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.213647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-sysconfig\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.215050 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.213453 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-kubernetes\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.215050 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.214360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.216765 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.216750 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.219038 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.219017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:15.219140 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.219084 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:15.221419 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.221399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.224015 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.223990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.226746 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.226726 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bj7ms\"" Sep 07 20:57:15.227948 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.227920 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 20:52:14 +0000 UTC" deadline="2028-03-25 16:19:15.24517248 +0000 UTC" Sep 07 20:57:15.228003 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.227949 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13555h22m0.017227775s" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.237045 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.237434 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.237469 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.237725 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h6st4\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.237860 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.237944 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rqx49\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.238063 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.238136 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s9m7f\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.238279 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.238306 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.238476 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.238480 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z5sk6\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.238693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.238899 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.238946 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.239122 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.239140 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 20:57:15.239476 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.239282 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 20:57:15.240338 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.240180 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-frrll\"" Sep 07 20:57:15.245185 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.245161 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 20:57:15.281634 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.281609 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x95gx" Sep 07 20:57:15.290598 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.290569 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x95gx" Sep 07 20:57:15.307801 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.307768 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 20:57:15.313758 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.313675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b594e18-f02a-440a-b194-0e353c2177eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.313758 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.313717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b594e18-f02a-440a-b194-0e353c2177eb-cnibin\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.313758 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.313742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f5cbd85-da5a-4640-81f4-1e0761ae9d52-tmp-dir\") pod \"node-resolver-4fcrz\" (UID: \"6f5cbd85-da5a-4640-81f4-1e0761ae9d52\") " pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.313945 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.313765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f5397147-b3c6-4e8a-a59f-bdad3a3d8f14-iptables-alerter-script\") pod \"iptables-alerter-5rs5c\" (UID: \"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14\") " pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.313945 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.313791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-etc-openvswitch\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.313945 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.313847 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-etc-openvswitch\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.313945 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.313873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-cni-bin\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.313945 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.313929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-cni-netd\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.314207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.313958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c66hs\" (UniqueName: \"kubernetes.io/projected/6f5cbd85-da5a-4640-81f4-1e0761ae9d52-kube-api-access-c66hs\") pod \"node-resolver-4fcrz\" (UID: \"6f5cbd85-da5a-4640-81f4-1e0761ae9d52\") " pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.314207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.313982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea5b378c-0a95-47ad-9771-b8685555c45c-ovnkube-config\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.314207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdnm\" (UniqueName: \"kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm\") pod \"network-check-target-lvmpk\" (UID: \"ec254331-d4df-4295-84bd-ee477edb9b85\") " pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:15.314207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-socket-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.314207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a55519a-9408-423e-a1f7-219e9c9c4d22-agent-certs\") pod \"konnectivity-agent-hk9kl\" (UID: \"8a55519a-9408-423e-a1f7-219e9c9c4d22\") " pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:15.314207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/413611dd-75b5-46b7-b195-0365dafba1c3-host\") pod \"node-ca-v64xb\" (UID: \"413611dd-75b5-46b7-b195-0365dafba1c3\") " pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.314207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/413611dd-75b5-46b7-b195-0365dafba1c3-serviceca\") pod \"node-ca-v64xb\" (UID: \"413611dd-75b5-46b7-b195-0365dafba1c3\") " pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.314207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314133 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f5cbd85-da5a-4640-81f4-1e0761ae9d52-tmp-dir\") pod \"node-resolver-4fcrz\" (UID: \"6f5cbd85-da5a-4640-81f4-1e0761ae9d52\") " pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.314207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-system-cni-dir\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.314207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-multus-conf-dir\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314218 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-kubelet\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314226 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-cni-netd\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thdjp\" (UniqueName: \"kubernetes.io/projected/ea5b378c-0a95-47ad-9771-b8685555c45c-kube-api-access-thdjp\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314265 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-cni-bin\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-registration-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314428 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-kubelet\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-sys\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314510 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f5397147-b3c6-4e8a-a59f-bdad3a3d8f14-iptables-alerter-script\") pod \"iptables-alerter-5rs5c\" (UID: \"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14\") " pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-var-lib-kubelet\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314538 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-sys\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-etc-selinux\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314568 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-var-lib-kubelet\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-var-lib-kubelet\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314618 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-etc-kubernetes\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-run\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-host\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.314724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314698 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-var-lib-cni-bin\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314722 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-run-ovn\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-host\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-tuned\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314785 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-run\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314771 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-run-ovn\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b594e18-f02a-440a-b194-0e353c2177eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314798 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea5b378c-0a95-47ad-9771-b8685555c45c-ovnkube-config\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d75dq\" (UniqueName: \"kubernetes.io/projected/413611dd-75b5-46b7-b195-0365dafba1c3-kube-api-access-d75dq\") pod \"node-ca-v64xb\" (UID: \"413611dd-75b5-46b7-b195-0365dafba1c3\") " pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-sysctl-d\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.314986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-sys-fs\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a55519a-9408-423e-a1f7-219e9c9c4d22-konnectivity-ca\") pod \"konnectivity-agent-hk9kl\" (UID: \"8a55519a-9408-423e-a1f7-219e9c9c4d22\") " pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-multus-socket-dir-parent\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-run-netns\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-slash\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f5cbd85-da5a-4640-81f4-1e0761ae9d52-hosts-file\") pod \"node-resolver-4fcrz\" (UID: \"6f5cbd85-da5a-4640-81f4-1e0761ae9d52\") " pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.315465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-sysctl-conf\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315114 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-sysctl-d\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-systemd\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-kubelet-config\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ttmp\" (UniqueName: \"kubernetes.io/projected/a24e9820-cf22-4400-a4a9-574a117eb986-kube-api-access-5ttmp\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315175 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-slash\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-device-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea5b378c-0a95-47ad-9771-b8685555c45c-ovn-node-metrics-cert\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315225 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-systemd\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315234 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f5cbd85-da5a-4640-81f4-1e0761ae9d52-hosts-file\") pod \"node-resolver-4fcrz\" (UID: \"6f5cbd85-da5a-4640-81f4-1e0761ae9d52\") " pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315238 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b594e18-f02a-440a-b194-0e353c2177eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-sysctl-conf\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-cnibin\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-hostroot\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-run-multus-certs\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea5b378c-0a95-47ad-9771-b8685555c45c-ovnkube-script-lib\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316184 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315420 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315449 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvk86\" (UniqueName: \"kubernetes.io/projected/9fbea98b-d21e-4db3-8321-e671c742447c-kube-api-access-pvk86\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-multus-cni-dir\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315509 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315550 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-systemd-units\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-systemd-units\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-run-systemd\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a24e9820-cf22-4400-a4a9-574a117eb986-cni-binary-copy\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-run-k8s-cni-cncf-io\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-run-netns\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315685 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-run-systemd\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-modprobe-d\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315755 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-run-netns\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.315852 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315874 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-modprobe-d\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.316897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b594e18-f02a-440a-b194-0e353c2177eb-system-cni-dir\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.315926 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs podName:af830417-6366-47ce-868f-221f859ff24e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:15.815892818 +0000 UTC m=+2.104262082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs") pod "network-metrics-daemon-5645v" (UID: "af830417-6366-47ce-868f-221f859ff24e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315973 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea5b378c-0a95-47ad-9771-b8685555c45c-ovnkube-script-lib\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.315996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-run-openvswitch\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-var-lib-openvswitch\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjrmq\" (UniqueName: \"kubernetes.io/projected/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-kube-api-access-hjrmq\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-lib-modules\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316076 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-var-lib-openvswitch\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a24e9820-cf22-4400-a4a9-574a117eb986-multus-daemon-config\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316069 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-run-openvswitch\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316099 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t4tt\" (UniqueName: \"kubernetes.io/projected/f5397147-b3c6-4e8a-a59f-bdad3a3d8f14-kube-api-access-5t4tt\") pod \"iptables-alerter-5rs5c\" (UID: \"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14\") " pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea5b378c-0a95-47ad-9771-b8685555c45c-env-overrides\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-sysconfig\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-kubernetes\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.317679 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-tmp\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316212 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-lib-modules\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b594e18-f02a-440a-b194-0e353c2177eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhxph\" (UniqueName: \"kubernetes.io/projected/1b594e18-f02a-440a-b194-0e353c2177eb-kube-api-access-fhxph\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316264 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-sysconfig\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-var-lib-cni-multus\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5397147-b3c6-4e8a-a59f-bdad3a3d8f14-host-slash\") pod \"iptables-alerter-5rs5c\" (UID: \"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14\") " pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316436 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-kubernetes\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-node-log\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316471 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5397147-b3c6-4e8a-a59f-bdad3a3d8f14-host-slash\") pod \"iptables-alerter-5rs5c\" (UID: \"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14\") " pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-log-socket\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-node-log\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316512 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea5b378c-0a95-47ad-9771-b8685555c45c-log-socket\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfvlz\" (UniqueName: \"kubernetes.io/projected/af830417-6366-47ce-868f-221f859ff24e-kube-api-access-nfvlz\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-dbus\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:15.318556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.316575 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea5b378c-0a95-47ad-9771-b8685555c45c-env-overrides\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.319392 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.319226 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-tmp\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.319429 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.319256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea5b378c-0a95-47ad-9771-b8685555c45c-ovn-node-metrics-cert\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.319465 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.319278 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-etc-tuned\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.323167 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.323144 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thdjp\" (UniqueName: \"kubernetes.io/projected/ea5b378c-0a95-47ad-9771-b8685555c45c-kube-api-access-thdjp\") pod \"ovnkube-node-9qjfq\" (UID: \"ea5b378c-0a95-47ad-9771-b8685555c45c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.324201 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.324186 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 20:57:15.324254 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.324206 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 20:57:15.324254 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.324217 2578 projected.go:196] Error preparing data for projected volume kube-api-access-vcdnm for pod openshift-network-diagnostics/network-check-target-lvmpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:15.324329 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.324269 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm podName:ec254331-d4df-4295-84bd-ee477edb9b85 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:15.824254153 +0000 UTC m=+2.112623410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vcdnm" (UniqueName: "kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm") pod "network-check-target-lvmpk" (UID: "ec254331-d4df-4295-84bd-ee477edb9b85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:15.327168 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.327144 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c66hs\" (UniqueName: \"kubernetes.io/projected/6f5cbd85-da5a-4640-81f4-1e0761ae9d52-kube-api-access-c66hs\") pod \"node-resolver-4fcrz\" (UID: \"6f5cbd85-da5a-4640-81f4-1e0761ae9d52\") " pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.329434 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.329417 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjrmq\" (UniqueName: \"kubernetes.io/projected/63c68c83-6fed-46bc-b7a6-f70cf1a1bd64-kube-api-access-hjrmq\") pod \"tuned-jjgzl\" (UID: \"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64\") " pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.334032 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.334001 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t4tt\" (UniqueName: \"kubernetes.io/projected/f5397147-b3c6-4e8a-a59f-bdad3a3d8f14-kube-api-access-5t4tt\") pod \"iptables-alerter-5rs5c\" (UID: \"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14\") " pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.334695 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.334676 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfvlz\" (UniqueName: \"kubernetes.io/projected/af830417-6366-47ce-868f-221f859ff24e-kube-api-access-nfvlz\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:15.359520 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.359484 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf03853ada29dc907108cd2cb3e25b3.slice/crio-b5f1d25eb9b15869520cefa531d4c380747aad941e13e60973aa89879eabe331 WatchSource:0}: Error finding container b5f1d25eb9b15869520cefa531d4c380747aad941e13e60973aa89879eabe331: Status 404 returned error can't find the container with id b5f1d25eb9b15869520cefa531d4c380747aad941e13e60973aa89879eabe331 Sep 07 20:57:15.359983 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.359968 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d2f7628ee920e5b6f01791cc8df082.slice/crio-59a4c7e58c9fee228087b32ea9051302dcac21161fe41756f06e1200c1666127 WatchSource:0}: Error finding container 59a4c7e58c9fee228087b32ea9051302dcac21161fe41756f06e1200c1666127: Status 404 returned error can't find the container with id 59a4c7e58c9fee228087b32ea9051302dcac21161fe41756f06e1200c1666127 Sep 07 20:57:15.365179 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.365161 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 20:57:15.400781 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.400752 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 20:57:15.417709 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.417670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b594e18-f02a-440a-b194-0e353c2177eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.417709 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.417706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhxph\" (UniqueName: \"kubernetes.io/projected/1b594e18-f02a-440a-b194-0e353c2177eb-kube-api-access-fhxph\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.417981 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.417723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-var-lib-cni-multus\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.417981 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.417743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-dbus\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:15.417981 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.417805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-var-lib-cni-multus\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.417981 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.417881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b594e18-f02a-440a-b194-0e353c2177eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.417981 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.417895 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-dbus\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:15.417981 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.417929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b594e18-f02a-440a-b194-0e353c2177eb-cnibin\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.417981 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.417973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-socket-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.417999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a55519a-9408-423e-a1f7-219e9c9c4d22-agent-certs\") pod \"konnectivity-agent-hk9kl\" (UID: \"8a55519a-9408-423e-a1f7-219e9c9c4d22\") " pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/413611dd-75b5-46b7-b195-0365dafba1c3-host\") pod \"node-ca-v64xb\" (UID: \"413611dd-75b5-46b7-b195-0365dafba1c3\") " pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b594e18-f02a-440a-b194-0e353c2177eb-cnibin\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/413611dd-75b5-46b7-b195-0365dafba1c3-serviceca\") pod \"node-ca-v64xb\" (UID: \"413611dd-75b5-46b7-b195-0365dafba1c3\") " pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-system-cni-dir\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/413611dd-75b5-46b7-b195-0365dafba1c3-host\") pod \"node-ca-v64xb\" (UID: \"413611dd-75b5-46b7-b195-0365dafba1c3\") " pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-multus-conf-dir\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418130 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-socket-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418142 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-system-cni-dir\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418137 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-multus-conf-dir\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-registration-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-etc-selinux\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418248 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-registration-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-var-lib-kubelet\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.418302 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418303 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-etc-selinux\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-etc-kubernetes\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418361 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-var-lib-kubelet\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-var-lib-cni-bin\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418403 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b594e18-f02a-440a-b194-0e353c2177eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418428 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-var-lib-cni-bin\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-etc-kubernetes\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b594e18-f02a-440a-b194-0e353c2177eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418470 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b594e18-f02a-440a-b194-0e353c2177eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d75dq\" (UniqueName: \"kubernetes.io/projected/413611dd-75b5-46b7-b195-0365dafba1c3-kube-api-access-d75dq\") pod \"node-ca-v64xb\" (UID: \"413611dd-75b5-46b7-b195-0365dafba1c3\") " pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-sys-fs\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/413611dd-75b5-46b7-b195-0365dafba1c3-serviceca\") pod \"node-ca-v64xb\" (UID: \"413611dd-75b5-46b7-b195-0365dafba1c3\") " pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.418564 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a55519a-9408-423e-a1f7-219e9c9c4d22-konnectivity-ca\") pod \"konnectivity-agent-hk9kl\" (UID: \"8a55519a-9408-423e-a1f7-219e9c9c4d22\") " pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-multus-socket-dir-parent\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-run-netns\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418627 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-sys-fs\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.419059 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-kubelet-config\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-multus-socket-dir-parent\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.418688 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret podName:6b417cb6-1545-46c2-86bf-f4b5fbffafa7 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:15.918665374 +0000 UTC m=+2.207034635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret") pod "global-pull-secret-syncer-khvqk" (UID: "6b417cb6-1545-46c2-86bf-f4b5fbffafa7") : object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418720 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-kubelet-config\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ttmp\" (UniqueName: \"kubernetes.io/projected/a24e9820-cf22-4400-a4a9-574a117eb986-kube-api-access-5ttmp\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-device-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418787 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-run-netns\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b594e18-f02a-440a-b194-0e353c2177eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-cnibin\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418882 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b594e18-f02a-440a-b194-0e353c2177eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-hostroot\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-run-multus-certs\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418839 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-device-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418951 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-cnibin\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418953 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-hostroot\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.419841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418955 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b594e18-f02a-440a-b194-0e353c2177eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvk86\" (UniqueName: \"kubernetes.io/projected/9fbea98b-d21e-4db3-8321-e671c742447c-kube-api-access-pvk86\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-multus-cni-dir\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419003 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9fbea98b-d21e-4db3-8321-e671c742447c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.418985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-run-multus-certs\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a24e9820-cf22-4400-a4a9-574a117eb986-cni-binary-copy\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-run-k8s-cni-cncf-io\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b594e18-f02a-440a-b194-0e353c2177eb-system-cni-dir\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a24e9820-cf22-4400-a4a9-574a117eb986-multus-daemon-config\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419163 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-host-run-k8s-cni-cncf-io\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24e9820-cf22-4400-a4a9-574a117eb986-multus-cni-dir\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b594e18-f02a-440a-b194-0e353c2177eb-system-cni-dir\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419409 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a55519a-9408-423e-a1f7-219e9c9c4d22-konnectivity-ca\") pod \"konnectivity-agent-hk9kl\" (UID: \"8a55519a-9408-423e-a1f7-219e9c9c4d22\") " pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419616 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a24e9820-cf22-4400-a4a9-574a117eb986-cni-binary-copy\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.420399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.419719 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a24e9820-cf22-4400-a4a9-574a117eb986-multus-daemon-config\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.420887 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.420867 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a55519a-9408-423e-a1f7-219e9c9c4d22-agent-certs\") pod \"konnectivity-agent-hk9kl\" (UID: \"8a55519a-9408-423e-a1f7-219e9c9c4d22\") " pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:15.430093 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.430064 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d75dq\" (UniqueName: \"kubernetes.io/projected/413611dd-75b5-46b7-b195-0365dafba1c3-kube-api-access-d75dq\") pod \"node-ca-v64xb\" (UID: \"413611dd-75b5-46b7-b195-0365dafba1c3\") " pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.430233 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.430096 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ttmp\" (UniqueName: \"kubernetes.io/projected/a24e9820-cf22-4400-a4a9-574a117eb986-kube-api-access-5ttmp\") pod \"multus-9kn7f\" (UID: \"a24e9820-cf22-4400-a4a9-574a117eb986\") " pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.430233 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.430151 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhxph\" (UniqueName: \"kubernetes.io/projected/1b594e18-f02a-440a-b194-0e353c2177eb-kube-api-access-fhxph\") pod \"multus-additional-cni-plugins-29pbq\" (UID: \"1b594e18-f02a-440a-b194-0e353c2177eb\") " pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.430233 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.430156 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvk86\" (UniqueName: \"kubernetes.io/projected/9fbea98b-d21e-4db3-8321-e671c742447c-kube-api-access-pvk86\") pod \"aws-ebs-csi-driver-node-94xgf\" (UID: \"9fbea98b-d21e-4db3-8321-e671c742447c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.528927 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.528830 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:15.535460 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.535441 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4fcrz" Sep 07 20:57:15.539545 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.539519 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5b378c_0a95_47ad_9771_b8685555c45c.slice/crio-4807c613bd6be9334cbf774ae3776984270c7dbff9a02dc27e23796bfa87e032 WatchSource:0}: Error finding container 4807c613bd6be9334cbf774ae3776984270c7dbff9a02dc27e23796bfa87e032: Status 404 returned error can't find the container with id 4807c613bd6be9334cbf774ae3776984270c7dbff9a02dc27e23796bfa87e032 Sep 07 20:57:15.544030 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.543998 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5cbd85_da5a_4640_81f4_1e0761ae9d52.slice/crio-37ac99a8b7d77db15df6ba7f462d8b51adf87b19f78b0913d15519925603b6aa WatchSource:0}: Error finding container 37ac99a8b7d77db15df6ba7f462d8b51adf87b19f78b0913d15519925603b6aa: Status 404 returned error can't find the container with id 37ac99a8b7d77db15df6ba7f462d8b51adf87b19f78b0913d15519925603b6aa Sep 07 20:57:15.547231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.547210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" Sep 07 20:57:15.556374 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.556341 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c68c83_6fed_46bc_b7a6_f70cf1a1bd64.slice/crio-4d38bde39a219d34c636fdd72fd625011c4924cf076eb0100b0f33d00337e158 WatchSource:0}: Error finding container 4d38bde39a219d34c636fdd72fd625011c4924cf076eb0100b0f33d00337e158: Status 404 returned error can't find the container with id 4d38bde39a219d34c636fdd72fd625011c4924cf076eb0100b0f33d00337e158 Sep 07 20:57:15.569727 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.569701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5rs5c" Sep 07 20:57:15.575905 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.575873 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:15.579778 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.579749 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5397147_b3c6_4e8a_a59f_bdad3a3d8f14.slice/crio-16eb29ef4c0b929d667ce0aff83c27932b4de8210551402043ccff429a7d77fd WatchSource:0}: Error finding container 16eb29ef4c0b929d667ce0aff83c27932b4de8210551402043ccff429a7d77fd: Status 404 returned error can't find the container with id 16eb29ef4c0b929d667ce0aff83c27932b4de8210551402043ccff429a7d77fd Sep 07 20:57:15.585246 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.585220 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a55519a_9408_423e_a1f7_219e9c9c4d22.slice/crio-3bd70146f3a77284bf40ff11265a220f1370df073a0fbf9836f12c3140e7bab6 WatchSource:0}: Error finding container 3bd70146f3a77284bf40ff11265a220f1370df073a0fbf9836f12c3140e7bab6: Status 404 returned error can't find the container with id 3bd70146f3a77284bf40ff11265a220f1370df073a0fbf9836f12c3140e7bab6 Sep 07 20:57:15.590377 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.590355 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9kn7f" Sep 07 20:57:15.599924 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.599898 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24e9820_cf22_4400_a4a9_574a117eb986.slice/crio-25a4fa621d6e755d60128355c990268e9954903e697bd892091fe997b168a284 WatchSource:0}: Error finding container 25a4fa621d6e755d60128355c990268e9954903e697bd892091fe997b168a284: Status 404 returned error can't find the container with id 25a4fa621d6e755d60128355c990268e9954903e697bd892091fe997b168a284 Sep 07 20:57:15.610612 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.610587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" Sep 07 20:57:15.620470 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.620446 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbea98b_d21e_4db3_8321_e671c742447c.slice/crio-283a5ff62b9c0913d0b88ce17b31d820649130fac91a4529e29c380f1a847bb3 WatchSource:0}: Error finding container 283a5ff62b9c0913d0b88ce17b31d820649130fac91a4529e29c380f1a847bb3: Status 404 returned error can't find the container with id 283a5ff62b9c0913d0b88ce17b31d820649130fac91a4529e29c380f1a847bb3 Sep 07 20:57:15.637050 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.637022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-29pbq" Sep 07 20:57:15.641891 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.641871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v64xb" Sep 07 20:57:15.646626 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.646599 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b594e18_f02a_440a_b194_0e353c2177eb.slice/crio-0accd0003d5a25f2b83b7a4b6c6b522418161d6debc2269f3c7d3e3fae6561be WatchSource:0}: Error finding container 0accd0003d5a25f2b83b7a4b6c6b522418161d6debc2269f3c7d3e3fae6561be: Status 404 returned error can't find the container with id 0accd0003d5a25f2b83b7a4b6c6b522418161d6debc2269f3c7d3e3fae6561be Sep 07 20:57:15.650537 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:15.650513 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413611dd_75b5_46b7_b195_0365dafba1c3.slice/crio-e7baf75427ad4bb2e5eabbbef6a0ac9bdf5c7c75d37bea0acc69d75a127acafb WatchSource:0}: Error finding container e7baf75427ad4bb2e5eabbbef6a0ac9bdf5c7c75d37bea0acc69d75a127acafb: Status 404 returned error can't find the container with id e7baf75427ad4bb2e5eabbbef6a0ac9bdf5c7c75d37bea0acc69d75a127acafb Sep 07 20:57:15.822477 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.822387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:15.822651 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.822537 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:15.822651 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.822601 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs podName:af830417-6366-47ce-868f-221f859ff24e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:16.822581734 +0000 UTC m=+3.110951008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs") pod "network-metrics-daemon-5645v" (UID: "af830417-6366-47ce-868f-221f859ff24e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:15.923714 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.923676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdnm\" (UniqueName: \"kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm\") pod \"network-check-target-lvmpk\" (UID: \"ec254331-d4df-4295-84bd-ee477edb9b85\") " pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:15.923894 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:15.923733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:15.923894 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.923879 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:15.924018 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.923941 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret podName:6b417cb6-1545-46c2-86bf-f4b5fbffafa7 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:16.923921455 +0000 UTC m=+3.212290735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret") pod "global-pull-secret-syncer-khvqk" (UID: "6b417cb6-1545-46c2-86bf-f4b5fbffafa7") : object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:15.924392 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.924371 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 20:57:15.924515 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.924400 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 20:57:15.924515 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.924416 2578 projected.go:196] Error preparing data for projected volume kube-api-access-vcdnm for pod openshift-network-diagnostics/network-check-target-lvmpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:15.924515 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:15.924465 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm podName:ec254331-d4df-4295-84bd-ee477edb9b85 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:16.924448002 +0000 UTC m=+3.212817265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcdnm" (UniqueName: "kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm") pod "network-check-target-lvmpk" (UID: "ec254331-d4df-4295-84bd-ee477edb9b85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:16.294212 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.294109 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 20:52:15 +0000 UTC" deadline="2028-05-25 00:58:50.594268864 +0000 UTC" Sep 07 20:57:16.294212 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.294158 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15004h1m34.300115492s" Sep 07 20:57:16.314912 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.314245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:16.314912 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:16.314428 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:16.349410 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.349336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v64xb" event={"ID":"413611dd-75b5-46b7-b195-0365dafba1c3","Type":"ContainerStarted","Data":"e7baf75427ad4bb2e5eabbbef6a0ac9bdf5c7c75d37bea0acc69d75a127acafb"} Sep 07 20:57:16.375078 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.375037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" event={"ID":"9fbea98b-d21e-4db3-8321-e671c742447c","Type":"ContainerStarted","Data":"283a5ff62b9c0913d0b88ce17b31d820649130fac91a4529e29c380f1a847bb3"} Sep 07 20:57:16.407897 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.407856 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hk9kl" event={"ID":"8a55519a-9408-423e-a1f7-219e9c9c4d22","Type":"ContainerStarted","Data":"3bd70146f3a77284bf40ff11265a220f1370df073a0fbf9836f12c3140e7bab6"} Sep 07 20:57:16.434049 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.434007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" event={"ID":"ea5b378c-0a95-47ad-9771-b8685555c45c","Type":"ContainerStarted","Data":"4807c613bd6be9334cbf774ae3776984270c7dbff9a02dc27e23796bfa87e032"} Sep 07 20:57:16.439973 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.439917 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29pbq" event={"ID":"1b594e18-f02a-440a-b194-0e353c2177eb","Type":"ContainerStarted","Data":"0accd0003d5a25f2b83b7a4b6c6b522418161d6debc2269f3c7d3e3fae6561be"} Sep 07 20:57:16.451473 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.451223 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 20:57:16.457257 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.457218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9kn7f" event={"ID":"a24e9820-cf22-4400-a4a9-574a117eb986","Type":"ContainerStarted","Data":"25a4fa621d6e755d60128355c990268e9954903e697bd892091fe997b168a284"} Sep 07 20:57:16.473330 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.473272 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5rs5c" event={"ID":"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14","Type":"ContainerStarted","Data":"16eb29ef4c0b929d667ce0aff83c27932b4de8210551402043ccff429a7d77fd"} Sep 07 20:57:16.482092 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.481951 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" event={"ID":"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64","Type":"ContainerStarted","Data":"4d38bde39a219d34c636fdd72fd625011c4924cf076eb0100b0f33d00337e158"} Sep 07 20:57:16.486243 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.486104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4fcrz" event={"ID":"6f5cbd85-da5a-4640-81f4-1e0761ae9d52","Type":"ContainerStarted","Data":"37ac99a8b7d77db15df6ba7f462d8b51adf87b19f78b0913d15519925603b6aa"} Sep 07 20:57:16.497492 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.497450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" event={"ID":"bdf03853ada29dc907108cd2cb3e25b3","Type":"ContainerStarted","Data":"b5f1d25eb9b15869520cefa531d4c380747aad941e13e60973aa89879eabe331"} Sep 07 20:57:16.512797 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.512743 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" event={"ID":"87d2f7628ee920e5b6f01791cc8df082","Type":"ContainerStarted","Data":"59a4c7e58c9fee228087b32ea9051302dcac21161fe41756f06e1200c1666127"} Sep 07 20:57:16.831671 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.831510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:16.831887 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:16.831690 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:16.831887 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:16.831763 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs podName:af830417-6366-47ce-868f-221f859ff24e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:18.831744922 +0000 UTC m=+5.120114184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs") pod "network-metrics-daemon-5645v" (UID: "af830417-6366-47ce-868f-221f859ff24e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:16.933381 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.932404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdnm\" (UniqueName: \"kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm\") pod \"network-check-target-lvmpk\" (UID: \"ec254331-d4df-4295-84bd-ee477edb9b85\") " pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:16.933381 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:16.932468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:16.933381 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:16.932671 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:16.933381 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:16.932735 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret podName:6b417cb6-1545-46c2-86bf-f4b5fbffafa7 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:18.932716187 +0000 UTC m=+5.221085450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret") pod "global-pull-secret-syncer-khvqk" (UID: "6b417cb6-1545-46c2-86bf-f4b5fbffafa7") : object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:16.933381 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:16.933178 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 20:57:16.933381 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:16.933203 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 20:57:16.933381 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:16.933217 2578 projected.go:196] Error preparing data for projected volume kube-api-access-vcdnm for pod openshift-network-diagnostics/network-check-target-lvmpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:16.933381 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:16.933284 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm podName:ec254331-d4df-4295-84bd-ee477edb9b85 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:18.933256494 +0000 UTC m=+5.221625757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcdnm" (UniqueName: "kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm") pod "network-check-target-lvmpk" (UID: "ec254331-d4df-4295-84bd-ee477edb9b85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:17.295274 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:17.295117 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 20:52:15 +0000 UTC" deadline="2028-03-05 23:31:24.939729564 +0000 UTC" Sep 07 20:57:17.295274 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:17.295187 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13082h34m7.644548197s" Sep 07 20:57:17.312470 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:17.312374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:17.312470 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:17.312417 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:17.312710 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:17.312520 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:17.312960 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:17.312899 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:18.008556 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:18.008455 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 20:57:18.315904 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:18.315354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:18.315904 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:18.315501 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:18.851062 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:18.851006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:18.851244 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:18.851212 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:18.851300 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:18.851292 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs podName:af830417-6366-47ce-868f-221f859ff24e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:22.851269893 +0000 UTC m=+9.139639173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs") pod "network-metrics-daemon-5645v" (UID: "af830417-6366-47ce-868f-221f859ff24e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:18.951760 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:18.951669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdnm\" (UniqueName: \"kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm\") pod \"network-check-target-lvmpk\" (UID: \"ec254331-d4df-4295-84bd-ee477edb9b85\") " pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:18.951760 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:18.951737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:18.952002 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:18.951839 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 20:57:18.952002 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:18.951862 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:18.952002 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:18.951871 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 20:57:18.952002 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:18.951884 2578 projected.go:196] Error preparing data for projected volume kube-api-access-vcdnm for pod openshift-network-diagnostics/network-check-target-lvmpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:18.952002 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:18.951926 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret podName:6b417cb6-1545-46c2-86bf-f4b5fbffafa7 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:22.95190713 +0000 UTC m=+9.240276411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret") pod "global-pull-secret-syncer-khvqk" (UID: "6b417cb6-1545-46c2-86bf-f4b5fbffafa7") : object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:18.952002 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:18.951954 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm podName:ec254331-d4df-4295-84bd-ee477edb9b85 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:22.951934568 +0000 UTC m=+9.240303832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcdnm" (UniqueName: "kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm") pod "network-check-target-lvmpk" (UID: "ec254331-d4df-4295-84bd-ee477edb9b85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:19.312541 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:19.312449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:19.312716 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:19.312591 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:19.312779 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:19.312759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:19.312908 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:19.312868 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:20.312871 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:20.312841 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:20.313494 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:20.312955 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:21.313172 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:21.313140 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:21.313674 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:21.313270 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:21.313744 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:21.313672 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:21.313796 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:21.313768 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:22.317373 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:22.317331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:22.317909 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:22.317480 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:22.888175 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:22.888136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:22.888410 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:22.888269 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:22.888410 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:22.888352 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs podName:af830417-6366-47ce-868f-221f859ff24e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:30.888333215 +0000 UTC m=+17.176702472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs") pod "network-metrics-daemon-5645v" (UID: "af830417-6366-47ce-868f-221f859ff24e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:22.989437 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:22.989396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdnm\" (UniqueName: \"kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm\") pod \"network-check-target-lvmpk\" (UID: \"ec254331-d4df-4295-84bd-ee477edb9b85\") " pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:22.989639 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:22.989464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:22.989701 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:22.989650 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:22.989757 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:22.989715 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret podName:6b417cb6-1545-46c2-86bf-f4b5fbffafa7 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:30.989694872 +0000 UTC m=+17.278064136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret") pod "global-pull-secret-syncer-khvqk" (UID: "6b417cb6-1545-46c2-86bf-f4b5fbffafa7") : object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:22.990300 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:22.990146 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 20:57:22.990300 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:22.990170 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 20:57:22.990300 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:22.990185 2578 projected.go:196] Error preparing data for projected volume kube-api-access-vcdnm for pod openshift-network-diagnostics/network-check-target-lvmpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:22.990300 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:22.990229 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm podName:ec254331-d4df-4295-84bd-ee477edb9b85 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:30.990214788 +0000 UTC m=+17.278584048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcdnm" (UniqueName: "kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm") pod "network-check-target-lvmpk" (UID: "ec254331-d4df-4295-84bd-ee477edb9b85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:23.313381 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:23.313286 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:23.313556 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:23.313438 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:23.313719 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:23.313698 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:23.313838 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:23.313818 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:24.313250 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:24.313220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:24.313638 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:24.313334 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:25.313102 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:25.313017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:25.313276 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:25.313140 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:25.313276 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:25.313189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:25.313680 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:25.313296 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:26.313277 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:26.313234 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:26.313921 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:26.313404 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:27.313040 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:27.312959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:27.313221 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:27.312959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:27.313221 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:27.313092 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:27.313221 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:27.313182 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:28.312987 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:28.312945 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:28.313175 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:28.313076 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:29.312544 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:29.312506 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:29.312959 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:29.312507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:29.312959 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:29.312653 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:29.312959 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:29.312719 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:30.312716 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:30.312677 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:30.313206 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:30.312836 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:30.955552 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:30.955511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:30.955785 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:30.955678 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:30.955785 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:30.955750 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs podName:af830417-6366-47ce-868f-221f859ff24e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:46.955732889 +0000 UTC m=+33.244102152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs") pod "network-metrics-daemon-5645v" (UID: "af830417-6366-47ce-868f-221f859ff24e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:31.056787 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:31.056751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:31.056982 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:31.056922 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:31.056982 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:31.056934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdnm\" (UniqueName: \"kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm\") pod \"network-check-target-lvmpk\" (UID: \"ec254331-d4df-4295-84bd-ee477edb9b85\") " pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:31.057088 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:31.057003 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret podName:6b417cb6-1545-46c2-86bf-f4b5fbffafa7 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:47.056983775 +0000 UTC m=+33.345353047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret") pod "global-pull-secret-syncer-khvqk" (UID: "6b417cb6-1545-46c2-86bf-f4b5fbffafa7") : object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:31.057133 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:31.057098 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 20:57:31.057133 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:31.057118 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 20:57:31.057133 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:31.057127 2578 projected.go:196] Error preparing data for projected volume kube-api-access-vcdnm for pod openshift-network-diagnostics/network-check-target-lvmpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:31.057332 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:31.057174 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm podName:ec254331-d4df-4295-84bd-ee477edb9b85 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:47.057159228 +0000 UTC m=+33.345528487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcdnm" (UniqueName: "kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm") pod "network-check-target-lvmpk" (UID: "ec254331-d4df-4295-84bd-ee477edb9b85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:31.312879 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:31.312837 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:31.313377 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:31.312836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:31.313377 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:31.312982 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:31.313377 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:31.313062 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:32.313155 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:32.313119 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:32.313595 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:32.313270 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:33.313174 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:33.313129 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:33.313709 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:33.313144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:33.313709 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:33.313298 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:33.313709 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:33.313395 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:34.313849 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:34.313804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:34.314355 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:34.313928 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:35.313633 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.313256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:35.313812 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.313274 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:35.313812 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:35.313729 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:35.313812 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:35.313770 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:35.568446 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.568405 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" event={"ID":"87d2f7628ee920e5b6f01791cc8df082","Type":"ContainerStarted","Data":"a5ae54c2e4941b53e60b4340ff330dff4d951fa48873aac66b23217ff17bcaeb"} Sep 07 20:57:35.569905 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.569877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v64xb" event={"ID":"413611dd-75b5-46b7-b195-0365dafba1c3","Type":"ContainerStarted","Data":"70c40356a63c470a859161b23f0d92e53c51a977c6f71ca562c807ba9f0ab91e"} Sep 07 20:57:35.571408 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.571378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" event={"ID":"9fbea98b-d21e-4db3-8321-e671c742447c","Type":"ContainerStarted","Data":"5c13d1934f3ab375eaaa5209edb6c8a681adebb3ea39c916f239a9c14ee249e1"} Sep 07 20:57:35.573095 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.573069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hk9kl" event={"ID":"8a55519a-9408-423e-a1f7-219e9c9c4d22","Type":"ContainerStarted","Data":"9a4f46535f5611293f6fc88e64bfed05b135d6e1d0eb0d4ce8072bbd3205972d"} Sep 07 20:57:35.576478 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.576456 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-acl-logging/0.log" Sep 07 20:57:35.576866 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.576841 2578 generic.go:356] "Generic (PLEG): container finished" podID="ea5b378c-0a95-47ad-9771-b8685555c45c" containerID="4839de2893b964805b6fbbe407c702d3a81f51d2188a9f04d52f097130177a3b" exitCode=1 Sep 07 20:57:35.576989 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.576924 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" event={"ID":"ea5b378c-0a95-47ad-9771-b8685555c45c","Type":"ContainerStarted","Data":"1f2b931d51300b443cba30bd060fc5887225c5a6ee281ac00548488c09114adf"} Sep 07 20:57:35.577052 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.577018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" event={"ID":"ea5b378c-0a95-47ad-9771-b8685555c45c","Type":"ContainerStarted","Data":"ad9e7788829f8efcaf236438931845306107a932cd1d6aec7dd8898f9ef79dde"} Sep 07 20:57:35.577099 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.577064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" event={"ID":"ea5b378c-0a95-47ad-9771-b8685555c45c","Type":"ContainerStarted","Data":"1a26d201955c5e1b7b2fe75d64487edcda232f9f9186c31c034a82732adfd617"} Sep 07 20:57:35.577145 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.577103 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" event={"ID":"ea5b378c-0a95-47ad-9771-b8685555c45c","Type":"ContainerStarted","Data":"979190ca5b60fe9c321836c390a20823ce313b1d1f88488713012bf6eb347464"} Sep 07 20:57:35.577145 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.577134 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" event={"ID":"ea5b378c-0a95-47ad-9771-b8685555c45c","Type":"ContainerDied","Data":"4839de2893b964805b6fbbe407c702d3a81f51d2188a9f04d52f097130177a3b"} Sep 07 20:57:35.577227 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.577190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" event={"ID":"ea5b378c-0a95-47ad-9771-b8685555c45c","Type":"ContainerStarted","Data":"fddfbf0e62e2a4fac8daed648b5fca6cd7cb6d83bd4a8e32bea97a5f790c5461"} Sep 07 20:57:35.578848 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.578823 2578 generic.go:356] "Generic (PLEG): container finished" podID="1b594e18-f02a-440a-b194-0e353c2177eb" containerID="836e4cccd6c20020b4f93da4330fc5f42b7a7118ab52de441174f26907965885" exitCode=0 Sep 07 20:57:35.579072 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.579047 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29pbq" event={"ID":"1b594e18-f02a-440a-b194-0e353c2177eb","Type":"ContainerDied","Data":"836e4cccd6c20020b4f93da4330fc5f42b7a7118ab52de441174f26907965885"} Sep 07 20:57:35.580915 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.580718 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9kn7f" event={"ID":"a24e9820-cf22-4400-a4a9-574a117eb986","Type":"ContainerStarted","Data":"74441bb7f54e2f0413ba9805611c6fb14e3a54d88bc3fdb80d6d2568fc9831d2"} Sep 07 20:57:35.582486 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.582460 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" event={"ID":"63c68c83-6fed-46bc-b7a6-f70cf1a1bd64","Type":"ContainerStarted","Data":"7c3f635f7bd1100049edac337c072420b2a58e6c674433bcb70868ca39c88eb2"} Sep 07 20:57:35.584500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.584299 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4fcrz" event={"ID":"6f5cbd85-da5a-4640-81f4-1e0761ae9d52","Type":"ContainerStarted","Data":"4ef8bd219d0754e0b8eb63c30d50714f7fa076e28b658ffc09571631040a07f8"} Sep 07 20:57:35.586391 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.586365 2578 generic.go:356] "Generic (PLEG): container finished" podID="bdf03853ada29dc907108cd2cb3e25b3" containerID="babfe5e9f45119f87551dbf5a4cdc7393349353735c6b1a5abc9602a33c33342" exitCode=0 Sep 07 20:57:35.586497 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.586404 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" event={"ID":"bdf03853ada29dc907108cd2cb3e25b3","Type":"ContainerDied","Data":"babfe5e9f45119f87551dbf5a4cdc7393349353735c6b1a5abc9602a33c33342"} Sep 07 20:57:35.598491 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.598429 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" podStartSLOduration=20.598409288 podStartE2EDuration="20.598409288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:35.583500679 +0000 UTC m=+21.871869961" watchObservedRunningTime="2026-09-07 20:57:35.598409288 +0000 UTC m=+21.886778567" Sep 07 20:57:35.617075 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.617023 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hk9kl" podStartSLOduration=2.846448445 podStartE2EDuration="21.617006822s" totalImagesPullingTime="18.770558377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:35.598576303 +0000 UTC m=+21.886945564" watchObservedRunningTime="2026-09-07 20:57:35.617006822 +0000 UTC m=+21.905376101" Sep 07 20:57:35.617293 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.617267 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9kn7f" podStartSLOduration=2.582694981 podStartE2EDuration="21.617256158s" totalImagesPullingTime="19.034561177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:35.616746048 +0000 UTC m=+21.905115329" watchObservedRunningTime="2026-09-07 20:57:35.617256158 +0000 UTC m=+21.905625437" Sep 07 20:57:35.632460 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.632405 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jjgzl" podStartSLOduration=2.755795749 podStartE2EDuration="21.632383583s" totalImagesPullingTime="18.876587834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:35.632354975 +0000 UTC m=+21.920724255" watchObservedRunningTime="2026-09-07 20:57:35.632383583 +0000 UTC m=+21.920752863" Sep 07 20:57:35.667894 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.667842 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v64xb" podStartSLOduration=2.962468465 podStartE2EDuration="21.667825796s" totalImagesPullingTime="18.705357331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:35.667816029 +0000 UTC m=+21.956185310" watchObservedRunningTime="2026-09-07 20:57:35.667825796 +0000 UTC m=+21.956195076" Sep 07 20:57:35.699996 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:35.699942 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4fcrz" podStartSLOduration=2.8393242499999998 podStartE2EDuration="21.699921896s" totalImagesPullingTime="18.860597646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:35.699771639 +0000 UTC m=+21.988140918" watchObservedRunningTime="2026-09-07 20:57:35.699921896 +0000 UTC m=+21.988291176" Sep 07 20:57:36.312799 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.312770 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:36.312957 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:36.312918 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:36.418663 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.418622 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 20:57:36.470407 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.470367 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:36.471163 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.471139 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:36.591367 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.591259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5rs5c" event={"ID":"f5397147-b3c6-4e8a-a59f-bdad3a3d8f14","Type":"ContainerStarted","Data":"fb52ec059561c137464357d8fd043665856345a0e7b3426a0bdf42daf230c67f"} Sep 07 20:57:36.593701 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.593665 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" event={"ID":"bdf03853ada29dc907108cd2cb3e25b3","Type":"ContainerStarted","Data":"ebd39355ef4909b081ec496694a0b86d293d41e452749eada5aebe1e3f185517"} Sep 07 20:57:36.595889 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.595848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" event={"ID":"9fbea98b-d21e-4db3-8321-e671c742447c","Type":"ContainerStarted","Data":"9c09814ad2c98444d49fe5639a272add35667b6c88f3ac5158d2bb6857018708"} Sep 07 20:57:36.596480 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.596454 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:36.596963 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.596946 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hk9kl" Sep 07 20:57:36.612542 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.612478 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5rs5c" podStartSLOduration=3.758245444 podStartE2EDuration="22.612458371s" totalImagesPullingTime="18.854212927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:36.612106143 +0000 UTC m=+22.900475423" watchObservedRunningTime="2026-09-07 20:57:36.612458371 +0000 UTC m=+22.900827650" Sep 07 20:57:36.642675 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:36.642614 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" podStartSLOduration=21.642593255 podStartE2EDuration="21.642593255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:36.642489122 +0000 UTC m=+22.930858405" watchObservedRunningTime="2026-09-07 20:57:36.642593255 +0000 UTC m=+22.930962536" Sep 07 20:57:37.285826 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:37.285706 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T20:57:36.418644183Z","UUID":"7671f9a9-5ec8-4f0b-8aec-5ba7ef233e8c","Handler":null,"Name":"","Endpoint":""} Sep 07 20:57:37.287650 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:37.287625 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 20:57:37.287796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:37.287665 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 20:57:37.312399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:37.312360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:37.312399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:37.312372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:37.312629 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:37.312494 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:37.313179 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:37.312699 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:37.601720 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:37.601618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" event={"ID":"9fbea98b-d21e-4db3-8321-e671c742447c","Type":"ContainerStarted","Data":"04cc88073cb84c68575b2f959acb967e4ae81bed2df5f7eb0307ca85d55fde3f"} Sep 07 20:57:37.605467 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:37.605439 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-acl-logging/0.log" Sep 07 20:57:37.606024 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:37.605989 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" event={"ID":"ea5b378c-0a95-47ad-9771-b8685555c45c","Type":"ContainerStarted","Data":"e238528adbca9d513ba8680ed5c2d4a28cd46c6b7d29365ee4756b516a7a955b"} Sep 07 20:57:37.622068 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:37.622017 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94xgf" podStartSLOduration=2.725185346 podStartE2EDuration="23.622000604s" totalImagesPullingTime="20.896815258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:37.621617311 +0000 UTC m=+23.909986595" watchObservedRunningTime="2026-09-07 20:57:37.622000604 +0000 UTC m=+23.910369884" Sep 07 20:57:38.313088 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:38.313049 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:38.313362 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:38.313173 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:39.312750 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:39.312716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:39.313177 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:39.312716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:39.313177 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:39.312835 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:39.313177 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:39.312929 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:40.313029 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:40.312838 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:40.313466 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:40.313152 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:40.619426 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:40.619399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-acl-logging/0.log" Sep 07 20:57:40.619943 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:40.619919 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" event={"ID":"ea5b378c-0a95-47ad-9771-b8685555c45c","Type":"ContainerStarted","Data":"1727db24ccb65d74abd963bc9d07b97d94caaf94576de44916b63fb72ebf8deb"} Sep 07 20:57:40.620259 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:40.620237 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:40.620422 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:40.620335 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:40.620500 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:40.620481 2578 scope.go:117] "RemoveContainer" containerID="4839de2893b964805b6fbbe407c702d3a81f51d2188a9f04d52f097130177a3b" Sep 07 20:57:40.622622 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:40.622591 2578 generic.go:356] "Generic (PLEG): container finished" podID="1b594e18-f02a-440a-b194-0e353c2177eb" containerID="5f9662906763f35a59a1c5075b0590b534b6bacb08843fb3e47a40ecb397fd14" exitCode=0 Sep 07 20:57:40.622830 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:40.622629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29pbq" event={"ID":"1b594e18-f02a-440a-b194-0e353c2177eb","Type":"ContainerDied","Data":"5f9662906763f35a59a1c5075b0590b534b6bacb08843fb3e47a40ecb397fd14"} Sep 07 20:57:40.640428 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:40.640405 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:41.312380 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.312339 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:41.312614 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.312355 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:41.312614 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:41.312486 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:41.312614 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:41.312532 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:41.630293 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.630267 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-acl-logging/0.log" Sep 07 20:57:41.630992 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.630689 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" event={"ID":"ea5b378c-0a95-47ad-9771-b8685555c45c","Type":"ContainerStarted","Data":"d8d7e934f11c1d957ecd3c9433df62508eb0894af320f128f9012ad043fbbae5"} Sep 07 20:57:41.630992 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.630908 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:41.633163 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.633134 2578 generic.go:356] "Generic (PLEG): container finished" podID="1b594e18-f02a-440a-b194-0e353c2177eb" containerID="25c62c12db49d85248671b0721814e2f5ced9b9404d1424e5f6ca8433ce7328a" exitCode=0 Sep 07 20:57:41.633299 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.633180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29pbq" event={"ID":"1b594e18-f02a-440a-b194-0e353c2177eb","Type":"ContainerDied","Data":"25c62c12db49d85248671b0721814e2f5ced9b9404d1424e5f6ca8433ce7328a"} Sep 07 20:57:41.648905 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.648872 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:57:41.663456 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.662242 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" podStartSLOduration=8.747353424 podStartE2EDuration="27.66221424s" totalImagesPullingTime="18.914860816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:41.660040101 +0000 UTC m=+27.948409382" watchObservedRunningTime="2026-09-07 20:57:41.66221424 +0000 UTC m=+27.950583529" Sep 07 20:57:41.905576 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.905482 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-khvqk"] Sep 07 20:57:41.905741 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.905658 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:41.905809 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:41.905779 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:41.909061 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.909031 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5645v"] Sep 07 20:57:41.909208 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.909161 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:41.909287 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:41.909269 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:41.917843 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.917815 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lvmpk"] Sep 07 20:57:41.917983 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:41.917918 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:41.918020 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:41.917997 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:42.638274 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:42.638238 2578 generic.go:356] "Generic (PLEG): container finished" podID="1b594e18-f02a-440a-b194-0e353c2177eb" containerID="244151b2504544c713633ec0d1175931da50c4e8539e55b360ccad71b40c27e6" exitCode=0 Sep 07 20:57:42.638668 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:42.638418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29pbq" event={"ID":"1b594e18-f02a-440a-b194-0e353c2177eb","Type":"ContainerDied","Data":"244151b2504544c713633ec0d1175931da50c4e8539e55b360ccad71b40c27e6"} Sep 07 20:57:43.312785 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:43.312749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:43.312960 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:43.312792 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:43.312960 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:43.312893 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:43.313053 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:43.313029 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:44.313713 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:44.313385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:44.314198 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:44.313812 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:45.312501 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:45.312465 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:45.312727 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:45.312478 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:45.312727 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:45.312580 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:45.312727 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:45.312679 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:46.313076 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:46.313036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:46.313685 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:46.313171 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:46.980766 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:46.980734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:46.980923 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:46.980903 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:46.980976 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:46.980969 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs podName:af830417-6366-47ce-868f-221f859ff24e nodeName:}" failed. No retries permitted until 2026-09-07 20:58:18.980953709 +0000 UTC m=+65.269322972 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs") pod "network-metrics-daemon-5645v" (UID: "af830417-6366-47ce-868f-221f859ff24e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 20:57:47.081835 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:47.081791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdnm\" (UniqueName: \"kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm\") pod \"network-check-target-lvmpk\" (UID: \"ec254331-d4df-4295-84bd-ee477edb9b85\") " pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:47.082028 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:47.081855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:47.082028 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:47.081966 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:47.082238 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:47.082037 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret podName:6b417cb6-1545-46c2-86bf-f4b5fbffafa7 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:19.08201973 +0000 UTC m=+65.370389000 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret") pod "global-pull-secret-syncer-khvqk" (UID: "6b417cb6-1545-46c2-86bf-f4b5fbffafa7") : object "kube-system"/"original-pull-secret" not registered Sep 07 20:57:47.082238 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:47.081968 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 20:57:47.082238 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:47.082077 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 20:57:47.082238 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:47.082090 2578 projected.go:196] Error preparing data for projected volume kube-api-access-vcdnm for pod openshift-network-diagnostics/network-check-target-lvmpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:47.082238 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:47.082135 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm podName:ec254331-d4df-4295-84bd-ee477edb9b85 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:19.082122052 +0000 UTC m=+65.370491310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcdnm" (UniqueName: "kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm") pod "network-check-target-lvmpk" (UID: "ec254331-d4df-4295-84bd-ee477edb9b85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 20:57:47.312395 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:47.312359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:47.312395 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:47.312387 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:47.312596 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:47.312472 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khvqk" podUID="6b417cb6-1545-46c2-86bf-f4b5fbffafa7" Sep 07 20:57:47.312596 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:47.312547 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5645v" podUID="af830417-6366-47ce-868f-221f859ff24e" Sep 07 20:57:47.655462 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:47.655428 2578 generic.go:356] "Generic (PLEG): container finished" podID="1b594e18-f02a-440a-b194-0e353c2177eb" containerID="dda3d87bd70505b79731ea48c290585aab5697ea7d92752d9963b4ed0b678b96" exitCode=0 Sep 07 20:57:47.655866 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:47.655504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29pbq" event={"ID":"1b594e18-f02a-440a-b194-0e353c2177eb","Type":"ContainerDied","Data":"dda3d87bd70505b79731ea48c290585aab5697ea7d92752d9963b4ed0b678b96"} Sep 07 20:57:48.313353 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.313295 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:48.313540 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.313432 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvmpk" podUID="ec254331-d4df-4295-84bd-ee477edb9b85" Sep 07 20:57:48.538399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.538369 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeReady" Sep 07 20:57:48.538595 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.538528 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 20:57:48.578798 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.578762 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-dkmlh"] Sep 07 20:57:48.598288 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.597904 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78f5cf9fdb-j7c82"] Sep 07 20:57:48.598493 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.598452 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.602443 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.601943 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 20:57:48.603529 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.603498 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-snz2x\"" Sep 07 20:57:48.604014 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.603737 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 20:57:48.604088 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.604032 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 07 20:57:48.607974 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.604612 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 07 20:57:48.610544 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.610518 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 07 20:57:48.615372 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.615344 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648"] Sep 07 20:57:48.615487 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.615452 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.619261 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.618776 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 07 20:57:48.619261 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.619040 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qwnfj\"" Sep 07 20:57:48.619503 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.619413 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 07 20:57:48.620009 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.619967 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 07 20:57:48.620716 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.620189 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 07 20:57:48.620716 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.620398 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 07 20:57:48.620716 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.620415 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 07 20:57:48.633381 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.633356 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph"] Sep 07 20:57:48.633615 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.633502 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:48.636142 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.636113 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 07 20:57:48.636338 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.636302 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hqz49\"" Sep 07 20:57:48.637549 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.637529 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 20:57:48.637641 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.637536 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 07 20:57:48.637641 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.637566 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 20:57:48.655512 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.655482 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bb47f9cb8-mxrx7"] Sep 07 20:57:48.655943 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.655666 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph" Sep 07 20:57:48.658218 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.658174 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 07 20:57:48.658218 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.658213 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 07 20:57:48.658446 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.658352 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x29pl\"" Sep 07 20:57:48.661511 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.661488 2578 generic.go:356] "Generic (PLEG): container finished" podID="1b594e18-f02a-440a-b194-0e353c2177eb" containerID="bd196ffadd41247e7ce3f66f4cc394df17f284dc5dc4923b717aec4a0b43f613" exitCode=0 Sep 07 20:57:48.679693 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.679655 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29pbq" event={"ID":"1b594e18-f02a-440a-b194-0e353c2177eb","Type":"ContainerDied","Data":"bd196ffadd41247e7ce3f66f4cc394df17f284dc5dc4923b717aec4a0b43f613"} Sep 07 20:57:48.679869 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.679703 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph"] Sep 07 20:57:48.679869 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.679777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.682296 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.682268 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 07 20:57:48.682466 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.682363 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 07 20:57:48.682670 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.682651 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 07 20:57:48.682761 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.682680 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-47zm6\"" Sep 07 20:57:48.689695 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.689456 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 07 20:57:48.692759 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.692739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.692821 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.692767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92b58442-c40e-4135-8ac0-7b9cfaa800b0-serving-cert\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.692821 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.692789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-stats-auth\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.692821 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.692812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/92b58442-c40e-4135-8ac0-7b9cfaa800b0-snapshots\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.692922 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.692876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-default-certificate\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.692961 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.692938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvpk\" (UniqueName: \"kubernetes.io/projected/d0541c9c-1195-40f0-a412-76512e40f592-kube-api-access-ffvpk\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.693000 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.692992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b58442-c40e-4135-8ac0-7b9cfaa800b0-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.693041 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.693008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b58442-c40e-4135-8ac0-7b9cfaa800b0-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.693041 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.693036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4fdd\" (UniqueName: \"kubernetes.io/projected/92b58442-c40e-4135-8ac0-7b9cfaa800b0-kube-api-access-z4fdd\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.693161 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.693054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.693161 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.693120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92b58442-c40e-4135-8ac0-7b9cfaa800b0-tmp\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.697804 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.697781 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ltdbr"] Sep 07 20:57:48.697901 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.697888 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:57:48.700710 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.700687 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kx5ls\"" Sep 07 20:57:48.700841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.700741 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 07 20:57:48.700896 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.700836 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 07 20:57:48.700980 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.700953 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 07 20:57:48.720156 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.720122 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph"] Sep 07 20:57:48.720156 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.720172 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-dkmlh"] Sep 07 20:57:48.720401 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.720193 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648"] Sep 07 20:57:48.720401 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.720207 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ltdbr"] Sep 07 20:57:48.720401 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.720222 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78f5cf9fdb-j7c82"] Sep 07 20:57:48.720401 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.720246 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt"] Sep 07 20:57:48.720569 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.720443 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.727757 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.727734 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 07 20:57:48.728805 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.727857 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 07 20:57:48.728805 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.728099 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 07 20:57:48.728957 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.728097 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 07 20:57:48.729244 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.729225 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bq77s\"" Sep 07 20:57:48.735081 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.735057 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 07 20:57:48.740078 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.740059 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-2cvhw"] Sep 07 20:57:48.740160 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.740143 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:48.743581 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.743561 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 07 20:57:48.743675 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.743625 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-c7525\"" Sep 07 20:57:48.743936 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.743918 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 07 20:57:48.744011 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.743994 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 07 20:57:48.744052 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.744044 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 07 20:57:48.764148 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.764123 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm"] Sep 07 20:57:48.764284 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.764250 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-2cvhw" Sep 07 20:57:48.766928 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.766904 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 20:57:48.767055 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.766951 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qbthq\"" Sep 07 20:57:48.767174 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.767158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 20:57:48.788510 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.788430 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bb47f9cb8-mxrx7"] Sep 07 20:57:48.788510 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.788471 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z69sv"] Sep 07 20:57:48.788688 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.788510 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:48.791289 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.791261 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 07 20:57:48.791515 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.791261 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 07 20:57:48.791736 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.791718 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 07 20:57:48.791783 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.791734 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 07 20:57:48.791870 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.791855 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4sc8r\"" Sep 07 20:57:48.793429 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvs78\" (UniqueName: \"kubernetes.io/projected/3bc72d5f-9125-45b4-9273-f9cd44a04d48-kube-api-access-rvs78\") pod \"volume-data-source-validator-695c895bd6-7d2ph\" (UID: \"3bc72d5f-9125-45b4-9273-f9cd44a04d48\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph" Sep 07 20:57:48.793486 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:57:48.793540 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-installation-pull-secrets\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.793540 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3d892ed-a6fc-4809-a773-17bc6344b8ee-trusted-ca\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.793604 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-image-registry-private-configuration\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.793637 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:48.793672 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.793704 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92b58442-c40e-4135-8ac0-7b9cfaa800b0-tmp\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.793836 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d892ed-a6fc-4809-a773-17bc6344b8ee-serving-cert\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.793889 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-certificates\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.793942 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/92b58442-c40e-4135-8ac0-7b9cfaa800b0-snapshots\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.793995 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.793995 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793956 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92b58442-c40e-4135-8ac0-7b9cfaa800b0-tmp\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.793995 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.793976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7m6r\" (UniqueName: \"kubernetes.io/projected/62e98056-3996-456a-bef8-e19a6a7d7aeb-kube-api-access-r7m6r\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:57:48.794136 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjhtm\" (UniqueName: \"kubernetes.io/projected/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-kube-api-access-vjhtm\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:48.794136 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.794063 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 20:57:48.794136 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvpk\" (UniqueName: \"kubernetes.io/projected/d0541c9c-1195-40f0-a412-76512e40f592-kube-api-access-ffvpk\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.794136 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.794125 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:49.29410462 +0000 UTC m=+35.582473893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : secret "router-metrics-certs-default" not found Sep 07 20:57:48.794354 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b58442-c40e-4135-8ac0-7b9cfaa800b0-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.794354 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b58442-c40e-4135-8ac0-7b9cfaa800b0-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.794354 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4fdd\" (UniqueName: \"kubernetes.io/projected/92b58442-c40e-4135-8ac0-7b9cfaa800b0-kube-api-access-z4fdd\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.794354 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-trusted-ca\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.794354 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.794354 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794279 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-ca-trust-extracted\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.794653 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d3d892ed-a6fc-4809-a773-17bc6344b8ee-config\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.794653 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vngzl\" (UniqueName: \"kubernetes.io/projected/d3d892ed-a6fc-4809-a773-17bc6344b8ee-kube-api-access-vngzl\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.794653 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92b58442-c40e-4135-8ac0-7b9cfaa800b0-serving-cert\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.794653 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794539 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/92b58442-c40e-4135-8ac0-7b9cfaa800b0-snapshots\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.794653 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.794562 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:49.294544968 +0000 UTC m=+35.582914239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : configmap references non-existent config key: service-ca.crt Sep 07 20:57:48.794653 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-bound-sa-token\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.794653 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-stats-auth\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.794653 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:48.795028 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-default-certificate\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.795028 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.794705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89rgt\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-kube-api-access-89rgt\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.795364 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.795303 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b58442-c40e-4135-8ac0-7b9cfaa800b0-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.796118 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.796053 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b58442-c40e-4135-8ac0-7b9cfaa800b0-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.799261 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.799127 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92b58442-c40e-4135-8ac0-7b9cfaa800b0-serving-cert\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.799361 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.799166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-stats-auth\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.799361 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.799199 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-default-certificate\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.804712 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.803976 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4fdd\" (UniqueName: \"kubernetes.io/projected/92b58442-c40e-4135-8ac0-7b9cfaa800b0-kube-api-access-z4fdd\") pod \"insights-operator-76bcd6ccf5-dkmlh\" (UID: \"92b58442-c40e-4135-8ac0-7b9cfaa800b0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.806014 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.805992 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvpk\" (UniqueName: \"kubernetes.io/projected/d0541c9c-1195-40f0-a412-76512e40f592-kube-api-access-ffvpk\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:48.811067 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.811028 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bdgh2"] Sep 07 20:57:48.811195 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.811177 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.813364 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.813341 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdcf7\"" Sep 07 20:57:48.813466 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.813439 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 20:57:48.813466 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.813444 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 20:57:48.829028 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.828997 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm"] Sep 07 20:57:48.829193 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.829039 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt"] Sep 07 20:57:48.829193 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.829064 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-2cvhw"] Sep 07 20:57:48.829193 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.829082 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph"] Sep 07 20:57:48.829193 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.829106 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z69sv"] Sep 07 20:57:48.829193 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.829130 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bdgh2"] Sep 07 20:57:48.829455 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.829204 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bdgh2" Sep 07 20:57:48.831919 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.831892 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sswpn\"" Sep 07 20:57:48.832054 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.831900 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 20:57:48.832157 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.832144 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 20:57:48.832203 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.832185 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 20:57:48.895972 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.895930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:48.895972 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.895970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b521a461-7fd0-4880-b21d-7895fdbfb842-config\") pod \"service-ca-operator-859f94c4b-zzspm\" (UID: \"b521a461-7fd0-4880-b21d-7895fdbfb842\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.895992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89rgt\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-kube-api-access-89rgt\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvs78\" (UniqueName: \"kubernetes.io/projected/3bc72d5f-9125-45b4-9273-f9cd44a04d48-kube-api-access-rvs78\") pod \"volume-data-source-validator-695c895bd6-7d2ph\" (UID: \"3bc72d5f-9125-45b4-9273-f9cd44a04d48\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph" Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-installation-pull-secrets\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3d892ed-a6fc-4809-a773-17bc6344b8ee-trusted-ca\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3de72ff3-7df7-43cc-9280-ec499a500b25-config-volume\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrqnv\" (UniqueName: \"kubernetes.io/projected/b30b14c4-4646-4edd-8aa1-756b1f8c3fec-kube-api-access-xrqnv\") pod \"network-check-source-685456655f-2cvhw\" (UID: \"b30b14c4-4646-4edd-8aa1-756b1f8c3fec\") " pod="openshift-network-diagnostics/network-check-source-685456655f-2cvhw" Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5vl5\" (UniqueName: \"kubernetes.io/projected/3de72ff3-7df7-43cc-9280-ec499a500b25-kube-api-access-b5vl5\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.896142 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-image-registry-private-configuration\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.896231 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.896250 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls podName:62e98056-3996-456a-bef8-e19a6a7d7aeb nodeName:}" failed. No retries permitted until 2026-09-07 20:57:49.396204614 +0000 UTC m=+35.684573889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nmkph" (UID: "62e98056-3996-456a-bef8-e19a6a7d7aeb") : secret "samples-operator-tls" not found Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.896280 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.896374 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls podName:69ac1738-084d-40e5-b4c1-0bfb0a28cc20 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:49.396355741 +0000 UTC m=+35.684724999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jl648" (UID: "69ac1738-084d-40e5-b4c1-0bfb0a28cc20") : secret "cluster-monitoring-operator-tls" not found Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02a152af-b7b3-4657-b287-9bce30e6bf8d-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-f5xkt\" (UID: \"02a152af-b7b3-4657-b287-9bce30e6bf8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b521a461-7fd0-4880-b21d-7895fdbfb842-serving-cert\") pod \"service-ca-operator-859f94c4b-zzspm\" (UID: \"b521a461-7fd0-4880-b21d-7895fdbfb842\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.896515 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.896531 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb47f9cb8-mxrx7: secret "image-registry-tls" not found Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d892ed-a6fc-4809-a773-17bc6344b8ee-serving-cert\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.896584 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls podName:82e0a9d0-22fd-40e4-a6ee-2101b8faed43 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:49.396568726 +0000 UTC m=+35.684937985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls") pod "image-registry-7bb47f9cb8-mxrx7" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43") : secret "image-registry-tls" not found Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-certificates\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7m6r\" (UniqueName: \"kubernetes.io/projected/62e98056-3996-456a-bef8-e19a6a7d7aeb-kube-api-access-r7m6r\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjhtm\" (UniqueName: \"kubernetes.io/projected/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-kube-api-access-vjhtm\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:48.896796 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3de72ff3-7df7-43cc-9280-ec499a500b25-tmp-dir\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.897531 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2psm\" (UniqueName: \"kubernetes.io/projected/02a152af-b7b3-4657-b287-9bce30e6bf8d-kube-api-access-x2psm\") pod \"kube-storage-version-migrator-operator-8d7dd4675-f5xkt\" (UID: \"02a152af-b7b3-4657-b287-9bce30e6bf8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:48.897531 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-trusted-ca\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.897531 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896848 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:48.897531 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-ca-trust-extracted\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.897531 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02a152af-b7b3-4657-b287-9bce30e6bf8d-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-f5xkt\" (UID: \"02a152af-b7b3-4657-b287-9bce30e6bf8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:48.897531 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.896994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcbkh\" (UniqueName: \"kubernetes.io/projected/b521a461-7fd0-4880-b21d-7895fdbfb842-kube-api-access-lcbkh\") pod \"service-ca-operator-859f94c4b-zzspm\" (UID: \"b521a461-7fd0-4880-b21d-7895fdbfb842\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:48.897531 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.897026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d3d892ed-a6fc-4809-a773-17bc6344b8ee-config\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.897531 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.897059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vngzl\" (UniqueName: \"kubernetes.io/projected/d3d892ed-a6fc-4809-a773-17bc6344b8ee-kube-api-access-vngzl\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.897531 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.897119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-bound-sa-token\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.897944 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.897596 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-ca-trust-extracted\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.897944 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.897907 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-trusted-ca\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.898045 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.897981 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-certificates\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.898045 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.898015 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3d892ed-a6fc-4809-a773-17bc6344b8ee-trusted-ca\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.898154 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.898133 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d3d892ed-a6fc-4809-a773-17bc6344b8ee-config\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.898946 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.898921 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-installation-pull-secrets\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.899049 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.898954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-image-registry-private-configuration\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.899049 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.899015 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d892ed-a6fc-4809-a773-17bc6344b8ee-serving-cert\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.913256 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.913228 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89rgt\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-kube-api-access-89rgt\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.913444 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.913369 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-bound-sa-token\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:48.913515 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.913467 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vngzl\" (UniqueName: \"kubernetes.io/projected/d3d892ed-a6fc-4809-a773-17bc6344b8ee-kube-api-access-vngzl\") pod \"console-operator-85b454874b-ltdbr\" (UID: \"d3d892ed-a6fc-4809-a773-17bc6344b8ee\") " pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:48.913611 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.913590 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvs78\" (UniqueName: \"kubernetes.io/projected/3bc72d5f-9125-45b4-9273-f9cd44a04d48-kube-api-access-rvs78\") pod \"volume-data-source-validator-695c895bd6-7d2ph\" (UID: \"3bc72d5f-9125-45b4-9273-f9cd44a04d48\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph" Sep 07 20:57:48.913776 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.913757 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjhtm\" (UniqueName: \"kubernetes.io/projected/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-kube-api-access-vjhtm\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:48.913776 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.913768 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7m6r\" (UniqueName: \"kubernetes.io/projected/62e98056-3996-456a-bef8-e19a6a7d7aeb-kube-api-access-r7m6r\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:57:48.914482 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.914468 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" Sep 07 20:57:48.965481 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.965431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph" Sep 07 20:57:48.997810 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.997779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbkh\" (UniqueName: \"kubernetes.io/projected/b521a461-7fd0-4880-b21d-7895fdbfb842-kube-api-access-lcbkh\") pod \"service-ca-operator-859f94c4b-zzspm\" (UID: \"b521a461-7fd0-4880-b21d-7895fdbfb842\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:48.998013 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.997840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b521a461-7fd0-4880-b21d-7895fdbfb842-config\") pod \"service-ca-operator-859f94c4b-zzspm\" (UID: \"b521a461-7fd0-4880-b21d-7895fdbfb842\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:48.998013 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.997875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3de72ff3-7df7-43cc-9280-ec499a500b25-config-volume\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.998013 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.997898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrqnv\" (UniqueName: \"kubernetes.io/projected/b30b14c4-4646-4edd-8aa1-756b1f8c3fec-kube-api-access-xrqnv\") pod \"network-check-source-685456655f-2cvhw\" (UID: \"b30b14c4-4646-4edd-8aa1-756b1f8c3fec\") " pod="openshift-network-diagnostics/network-check-source-685456655f-2cvhw" Sep 07 20:57:48.998013 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.997917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5vl5\" (UniqueName: \"kubernetes.io/projected/3de72ff3-7df7-43cc-9280-ec499a500b25-kube-api-access-b5vl5\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.998013 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.997954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02a152af-b7b3-4657-b287-9bce30e6bf8d-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-f5xkt\" (UID: \"02a152af-b7b3-4657-b287-9bce30e6bf8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.998049 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b521a461-7fd0-4880-b21d-7895fdbfb842-serving-cert\") pod \"service-ca-operator-859f94c4b-zzspm\" (UID: \"b521a461-7fd0-4880-b21d-7895fdbfb842\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:48.998117 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls podName:3de72ff3-7df7-43cc-9280-ec499a500b25 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:49.498097429 +0000 UTC m=+35.786466689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls") pod "dns-default-z69sv" (UID: "3de72ff3-7df7-43cc-9280-ec499a500b25") : secret "dns-default-metrics-tls" not found Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3de72ff3-7df7-43cc-9280-ec499a500b25-tmp-dir\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xwst\" (UniqueName: \"kubernetes.io/projected/9ddcc02c-42d3-4264-95da-60499be1e3de-kube-api-access-4xwst\") pod \"ingress-canary-bdgh2\" (UID: \"9ddcc02c-42d3-4264-95da-60499be1e3de\") " pod="openshift-ingress-canary/ingress-canary-bdgh2" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2psm\" (UniqueName: \"kubernetes.io/projected/02a152af-b7b3-4657-b287-9bce30e6bf8d-kube-api-access-x2psm\") pod \"kube-storage-version-migrator-operator-8d7dd4675-f5xkt\" (UID: \"02a152af-b7b3-4657-b287-9bce30e6bf8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ddcc02c-42d3-4264-95da-60499be1e3de-cert\") pod \"ingress-canary-bdgh2\" (UID: \"9ddcc02c-42d3-4264-95da-60499be1e3de\") " pod="openshift-ingress-canary/ingress-canary-bdgh2" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02a152af-b7b3-4657-b287-9bce30e6bf8d-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-f5xkt\" (UID: \"02a152af-b7b3-4657-b287-9bce30e6bf8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998627 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3de72ff3-7df7-43cc-9280-ec499a500b25-tmp-dir\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998638 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3de72ff3-7df7-43cc-9280-ec499a500b25-config-volume\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b521a461-7fd0-4880-b21d-7895fdbfb842-config\") pod \"service-ca-operator-859f94c4b-zzspm\" (UID: \"b521a461-7fd0-4880-b21d-7895fdbfb842\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:48.999008 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:48.998993 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02a152af-b7b3-4657-b287-9bce30e6bf8d-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-f5xkt\" (UID: \"02a152af-b7b3-4657-b287-9bce30e6bf8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:49.000589 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.000562 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b521a461-7fd0-4880-b21d-7895fdbfb842-serving-cert\") pod \"service-ca-operator-859f94c4b-zzspm\" (UID: \"b521a461-7fd0-4880-b21d-7895fdbfb842\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:49.000674 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.000633 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02a152af-b7b3-4657-b287-9bce30e6bf8d-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-f5xkt\" (UID: \"02a152af-b7b3-4657-b287-9bce30e6bf8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:49.007488 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.007428 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5vl5\" (UniqueName: \"kubernetes.io/projected/3de72ff3-7df7-43cc-9280-ec499a500b25-kube-api-access-b5vl5\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:49.007770 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.007744 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcbkh\" (UniqueName: \"kubernetes.io/projected/b521a461-7fd0-4880-b21d-7895fdbfb842-kube-api-access-lcbkh\") pod \"service-ca-operator-859f94c4b-zzspm\" (UID: \"b521a461-7fd0-4880-b21d-7895fdbfb842\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:49.007852 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.007835 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrqnv\" (UniqueName: \"kubernetes.io/projected/b30b14c4-4646-4edd-8aa1-756b1f8c3fec-kube-api-access-xrqnv\") pod \"network-check-source-685456655f-2cvhw\" (UID: \"b30b14c4-4646-4edd-8aa1-756b1f8c3fec\") " pod="openshift-network-diagnostics/network-check-source-685456655f-2cvhw" Sep 07 20:57:49.008136 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.008118 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2psm\" (UniqueName: \"kubernetes.io/projected/02a152af-b7b3-4657-b287-9bce30e6bf8d-kube-api-access-x2psm\") pod \"kube-storage-version-migrator-operator-8d7dd4675-f5xkt\" (UID: \"02a152af-b7b3-4657-b287-9bce30e6bf8d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:49.031229 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.031176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:49.057591 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.057561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" Sep 07 20:57:49.075921 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.075899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-2cvhw" Sep 07 20:57:49.099475 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.099292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xwst\" (UniqueName: \"kubernetes.io/projected/9ddcc02c-42d3-4264-95da-60499be1e3de-kube-api-access-4xwst\") pod \"ingress-canary-bdgh2\" (UID: \"9ddcc02c-42d3-4264-95da-60499be1e3de\") " pod="openshift-ingress-canary/ingress-canary-bdgh2" Sep 07 20:57:49.099475 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.099390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ddcc02c-42d3-4264-95da-60499be1e3de-cert\") pod \"ingress-canary-bdgh2\" (UID: \"9ddcc02c-42d3-4264-95da-60499be1e3de\") " pod="openshift-ingress-canary/ingress-canary-bdgh2" Sep 07 20:57:49.099475 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.099444 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" Sep 07 20:57:49.102551 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.102443 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ddcc02c-42d3-4264-95da-60499be1e3de-cert\") pod \"ingress-canary-bdgh2\" (UID: \"9ddcc02c-42d3-4264-95da-60499be1e3de\") " pod="openshift-ingress-canary/ingress-canary-bdgh2" Sep 07 20:57:49.110972 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.110911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xwst\" (UniqueName: \"kubernetes.io/projected/9ddcc02c-42d3-4264-95da-60499be1e3de-kube-api-access-4xwst\") pod \"ingress-canary-bdgh2\" (UID: \"9ddcc02c-42d3-4264-95da-60499be1e3de\") " pod="openshift-ingress-canary/ingress-canary-bdgh2" Sep 07 20:57:49.139930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.137892 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bdgh2" Sep 07 20:57:49.250810 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.250780 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-dkmlh"] Sep 07 20:57:49.254126 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:49.254095 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b58442_c40e_4135_8ac0_7b9cfaa800b0.slice/crio-bef631e1de706a391a93316464f0ac5854bda2898359d7cd6af4a61795a04966 WatchSource:0}: Error finding container bef631e1de706a391a93316464f0ac5854bda2898359d7cd6af4a61795a04966: Status 404 returned error can't find the container with id bef631e1de706a391a93316464f0ac5854bda2898359d7cd6af4a61795a04966 Sep 07 20:57:49.278804 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.278771 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph"] Sep 07 20:57:49.282303 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:49.282276 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc72d5f_9125_45b4_9273_f9cd44a04d48.slice/crio-d152d07a92819404496119947aa29419de82715cfd766e0d136bd27018e40f38 WatchSource:0}: Error finding container d152d07a92819404496119947aa29419de82715cfd766e0d136bd27018e40f38: Status 404 returned error can't find the container with id d152d07a92819404496119947aa29419de82715cfd766e0d136bd27018e40f38 Sep 07 20:57:49.300846 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.300767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:49.300846 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.300823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:49.301018 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.300920 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 20:57:49.301018 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.300969 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:50.300950848 +0000 UTC m=+36.589320119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : configmap references non-existent config key: service-ca.crt Sep 07 20:57:49.301018 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.300989 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:50.300982628 +0000 UTC m=+36.589351885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : secret "router-metrics-certs-default" not found Sep 07 20:57:49.312742 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.312699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:57:49.312742 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.312721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:57:49.315486 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.315457 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zznrj\"" Sep 07 20:57:49.315640 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.315491 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 20:57:49.315640 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.315508 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 20:57:49.335373 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.335343 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ltdbr"] Sep 07 20:57:49.337864 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:49.337845 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d892ed_a6fc_4809_a773_17bc6344b8ee.slice/crio-ae9d6c4155582ff3cd4d0d37f04c255735ae131a41da4979c0e0c62f9cd4f23d WatchSource:0}: Error finding container ae9d6c4155582ff3cd4d0d37f04c255735ae131a41da4979c0e0c62f9cd4f23d: Status 404 returned error can't find the container with id ae9d6c4155582ff3cd4d0d37f04c255735ae131a41da4979c0e0c62f9cd4f23d Sep 07 20:57:49.354509 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.354462 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt"] Sep 07 20:57:49.359185 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:49.359154 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a152af_b7b3_4657_b287_9bce30e6bf8d.slice/crio-1a1519f8fe1b4156c4801e749443ad397750c7e0c91fdcb53d8a1f8ad67615e2 WatchSource:0}: Error finding container 1a1519f8fe1b4156c4801e749443ad397750c7e0c91fdcb53d8a1f8ad67615e2: Status 404 returned error can't find the container with id 1a1519f8fe1b4156c4801e749443ad397750c7e0c91fdcb53d8a1f8ad67615e2 Sep 07 20:57:49.374616 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.374583 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-2cvhw"] Sep 07 20:57:49.378396 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:49.378365 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30b14c4_4646_4edd_8aa1_756b1f8c3fec.slice/crio-c40fdbf51e68610196e0299ef5f3809056fda5ab9a8ad6e7392616c6b94f468d WatchSource:0}: Error finding container c40fdbf51e68610196e0299ef5f3809056fda5ab9a8ad6e7392616c6b94f468d: Status 404 returned error can't find the container with id c40fdbf51e68610196e0299ef5f3809056fda5ab9a8ad6e7392616c6b94f468d Sep 07 20:57:49.401291 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.401258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:49.401483 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.401304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:49.401483 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.401413 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 20:57:49.401483 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.401475 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls podName:69ac1738-084d-40e5-b4c1-0bfb0a28cc20 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:50.401459881 +0000 UTC m=+36.689829139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jl648" (UID: "69ac1738-084d-40e5-b4c1-0bfb0a28cc20") : secret "cluster-monitoring-operator-tls" not found Sep 07 20:57:49.401655 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.401495 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 20:57:49.401655 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.401517 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb47f9cb8-mxrx7: secret "image-registry-tls" not found Sep 07 20:57:49.401655 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.401558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:57:49.401655 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.401572 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls podName:82e0a9d0-22fd-40e4-a6ee-2101b8faed43 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:50.401553817 +0000 UTC m=+36.689923092 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls") pod "image-registry-7bb47f9cb8-mxrx7" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43") : secret "image-registry-tls" not found Sep 07 20:57:49.401655 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.401631 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 20:57:49.401828 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.401674 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls podName:62e98056-3996-456a-bef8-e19a6a7d7aeb nodeName:}" failed. No retries permitted until 2026-09-07 20:57:50.401662676 +0000 UTC m=+36.690031956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nmkph" (UID: "62e98056-3996-456a-bef8-e19a6a7d7aeb") : secret "samples-operator-tls" not found Sep 07 20:57:49.406056 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.406028 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm"] Sep 07 20:57:49.408667 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:49.408641 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb521a461_7fd0_4880_b21d_7895fdbfb842.slice/crio-b370f184d66b9a3b1174b859a649ff1b0c06445895c87241363872c69465b839 WatchSource:0}: Error finding container b370f184d66b9a3b1174b859a649ff1b0c06445895c87241363872c69465b839: Status 404 returned error can't find the container with id b370f184d66b9a3b1174b859a649ff1b0c06445895c87241363872c69465b839 Sep 07 20:57:49.443196 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.443161 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bdgh2"] Sep 07 20:57:49.446416 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:57:49.446371 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ddcc02c_42d3_4264_95da_60499be1e3de.slice/crio-c5cd424cf54a8a7d962abba3dc34bc06a6878f8912d86547a06cf7da10bad68c WatchSource:0}: Error finding container c5cd424cf54a8a7d962abba3dc34bc06a6878f8912d86547a06cf7da10bad68c: Status 404 returned error can't find the container with id c5cd424cf54a8a7d962abba3dc34bc06a6878f8912d86547a06cf7da10bad68c Sep 07 20:57:49.502488 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.502454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:49.502675 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.502600 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 20:57:49.502675 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:49.502659 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls podName:3de72ff3-7df7-43cc-9280-ec499a500b25 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:50.502645826 +0000 UTC m=+36.791015088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls") pod "dns-default-z69sv" (UID: "3de72ff3-7df7-43cc-9280-ec499a500b25") : secret "dns-default-metrics-tls" not found Sep 07 20:57:49.665774 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.665688 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bdgh2" event={"ID":"9ddcc02c-42d3-4264-95da-60499be1e3de","Type":"ContainerStarted","Data":"c5cd424cf54a8a7d962abba3dc34bc06a6878f8912d86547a06cf7da10bad68c"} Sep 07 20:57:49.670975 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.670937 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" event={"ID":"92b58442-c40e-4135-8ac0-7b9cfaa800b0","Type":"ContainerStarted","Data":"bef631e1de706a391a93316464f0ac5854bda2898359d7cd6af4a61795a04966"} Sep 07 20:57:49.672278 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.672245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" event={"ID":"b521a461-7fd0-4880-b21d-7895fdbfb842","Type":"ContainerStarted","Data":"b370f184d66b9a3b1174b859a649ff1b0c06445895c87241363872c69465b839"} Sep 07 20:57:49.673750 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.673683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-2cvhw" event={"ID":"b30b14c4-4646-4edd-8aa1-756b1f8c3fec","Type":"ContainerStarted","Data":"c40fdbf51e68610196e0299ef5f3809056fda5ab9a8ad6e7392616c6b94f468d"} Sep 07 20:57:49.675079 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.675035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" event={"ID":"d3d892ed-a6fc-4809-a773-17bc6344b8ee","Type":"ContainerStarted","Data":"ae9d6c4155582ff3cd4d0d37f04c255735ae131a41da4979c0e0c62f9cd4f23d"} Sep 07 20:57:49.676481 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.676454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" event={"ID":"02a152af-b7b3-4657-b287-9bce30e6bf8d","Type":"ContainerStarted","Data":"1a1519f8fe1b4156c4801e749443ad397750c7e0c91fdcb53d8a1f8ad67615e2"} Sep 07 20:57:49.677692 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.677666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph" event={"ID":"3bc72d5f-9125-45b4-9273-f9cd44a04d48","Type":"ContainerStarted","Data":"d152d07a92819404496119947aa29419de82715cfd766e0d136bd27018e40f38"} Sep 07 20:57:49.681684 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.681659 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29pbq" event={"ID":"1b594e18-f02a-440a-b194-0e353c2177eb","Type":"ContainerStarted","Data":"cc72584338210f24357162e6f6672d2a69938dc9dd73903e83413b941030d126"} Sep 07 20:57:49.704451 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:49.704390 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-29pbq" podStartSLOduration=6.615097981 podStartE2EDuration="35.704369394s" totalImagesPullingTime="29.089271413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:49.703439679 +0000 UTC m=+35.991808961" watchObservedRunningTime="2026-09-07 20:57:49.704369394 +0000 UTC m=+35.992738675" Sep 07 20:57:50.311368 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:50.310371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:50.311368 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:50.310566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:50.311368 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.310744 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 20:57:50.311368 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.310812 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:52.310792032 +0000 UTC m=+38.599161295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : secret "router-metrics-certs-default" not found Sep 07 20:57:50.311368 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.311306 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:52.31128812 +0000 UTC m=+38.599657392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : configmap references non-existent config key: service-ca.crt Sep 07 20:57:50.316699 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:50.316140 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:57:50.320068 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:50.319467 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qbj94\"" Sep 07 20:57:50.414139 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:50.413123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:57:50.414139 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:50.413193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:50.414139 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:50.413234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:50.414139 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.413399 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 20:57:50.414139 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.413417 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb47f9cb8-mxrx7: secret "image-registry-tls" not found Sep 07 20:57:50.414139 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.413479 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls podName:82e0a9d0-22fd-40e4-a6ee-2101b8faed43 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:52.413459513 +0000 UTC m=+38.701828775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls") pod "image-registry-7bb47f9cb8-mxrx7" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43") : secret "image-registry-tls" not found Sep 07 20:57:50.414139 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.413907 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 20:57:50.414139 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.413956 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls podName:62e98056-3996-456a-bef8-e19a6a7d7aeb nodeName:}" failed. No retries permitted until 2026-09-07 20:57:52.413940724 +0000 UTC m=+38.702309985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nmkph" (UID: "62e98056-3996-456a-bef8-e19a6a7d7aeb") : secret "samples-operator-tls" not found Sep 07 20:57:50.414139 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.414021 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 20:57:50.414139 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.414053 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls podName:69ac1738-084d-40e5-b4c1-0bfb0a28cc20 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:52.414042882 +0000 UTC m=+38.702412142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jl648" (UID: "69ac1738-084d-40e5-b4c1-0bfb0a28cc20") : secret "cluster-monitoring-operator-tls" not found Sep 07 20:57:50.515104 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:50.514160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:50.515104 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.514473 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 20:57:50.515104 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:50.514565 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls podName:3de72ff3-7df7-43cc-9280-ec499a500b25 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:52.514541487 +0000 UTC m=+38.802910747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls") pod "dns-default-z69sv" (UID: "3de72ff3-7df7-43cc-9280-ec499a500b25") : secret "dns-default-metrics-tls" not found Sep 07 20:57:52.335667 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:52.335624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:52.336127 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:52.335712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:52.336127 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.335792 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 20:57:52.336127 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.335861 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:56.335840273 +0000 UTC m=+42.624209530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : secret "router-metrics-certs-default" not found Sep 07 20:57:52.336127 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.335936 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:56.335909139 +0000 UTC m=+42.624278410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : configmap references non-existent config key: service-ca.crt Sep 07 20:57:52.437287 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:52.437196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:57:52.437287 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:52.437258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:52.437538 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.437384 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 20:57:52.437538 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:52.437441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:52.437538 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.437449 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls podName:69ac1738-084d-40e5-b4c1-0bfb0a28cc20 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:56.437431248 +0000 UTC m=+42.725800523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jl648" (UID: "69ac1738-084d-40e5-b4c1-0bfb0a28cc20") : secret "cluster-monitoring-operator-tls" not found Sep 07 20:57:52.437693 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.437577 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 20:57:52.437693 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.437589 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb47f9cb8-mxrx7: secret "image-registry-tls" not found Sep 07 20:57:52.437693 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.437628 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls podName:82e0a9d0-22fd-40e4-a6ee-2101b8faed43 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:56.437616589 +0000 UTC m=+42.725985846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls") pod "image-registry-7bb47f9cb8-mxrx7" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43") : secret "image-registry-tls" not found Sep 07 20:57:52.437693 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.437385 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 20:57:52.437693 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.437657 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls podName:62e98056-3996-456a-bef8-e19a6a7d7aeb nodeName:}" failed. No retries permitted until 2026-09-07 20:57:56.437647542 +0000 UTC m=+42.726016799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nmkph" (UID: "62e98056-3996-456a-bef8-e19a6a7d7aeb") : secret "samples-operator-tls" not found Sep 07 20:57:52.538543 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:52.538503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:52.538755 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.538665 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 20:57:52.538755 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:52.538744 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls podName:3de72ff3-7df7-43cc-9280-ec499a500b25 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:56.538722798 +0000 UTC m=+42.827092056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls") pod "dns-default-z69sv" (UID: "3de72ff3-7df7-43cc-9280-ec499a500b25") : secret "dns-default-metrics-tls" not found Sep 07 20:57:56.373156 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:56.373116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:56.373554 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:56.373193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:57:56.373554 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.373276 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 20:57:56.373554 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.373351 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:04.373336258 +0000 UTC m=+50.661705520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : secret "router-metrics-certs-default" not found Sep 07 20:57:56.373554 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.373365 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:04.373359513 +0000 UTC m=+50.661728771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : configmap references non-existent config key: service-ca.crt Sep 07 20:57:56.474515 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:56.474469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:57:56.474690 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:56.474524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:57:56.474690 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:56.474561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:57:56.474690 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.474622 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 20:57:56.474690 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.474680 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 20:57:56.474848 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.474696 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb47f9cb8-mxrx7: secret "image-registry-tls" not found Sep 07 20:57:56.474848 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.474698 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls podName:62e98056-3996-456a-bef8-e19a6a7d7aeb nodeName:}" failed. No retries permitted until 2026-09-07 20:58:04.474680991 +0000 UTC m=+50.763050249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nmkph" (UID: "62e98056-3996-456a-bef8-e19a6a7d7aeb") : secret "samples-operator-tls" not found Sep 07 20:57:56.474848 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.474734 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls podName:82e0a9d0-22fd-40e4-a6ee-2101b8faed43 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:04.474722933 +0000 UTC m=+50.763092191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls") pod "image-registry-7bb47f9cb8-mxrx7" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43") : secret "image-registry-tls" not found Sep 07 20:57:56.474848 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.474680 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 20:57:56.474848 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.474780 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls podName:69ac1738-084d-40e5-b4c1-0bfb0a28cc20 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:04.474769963 +0000 UTC m=+50.763139224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jl648" (UID: "69ac1738-084d-40e5-b4c1-0bfb0a28cc20") : secret "cluster-monitoring-operator-tls" not found Sep 07 20:57:56.575990 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:56.575951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:57:56.576147 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.576125 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 20:57:56.576232 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:56.576213 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls podName:3de72ff3-7df7-43cc-9280-ec499a500b25 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:04.576190506 +0000 UTC m=+50.864559784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls") pod "dns-default-z69sv" (UID: "3de72ff3-7df7-43cc-9280-ec499a500b25") : secret "dns-default-metrics-tls" not found Sep 07 20:57:57.712326 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.712258 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" event={"ID":"02a152af-b7b3-4657-b287-9bce30e6bf8d","Type":"ContainerStarted","Data":"100ca9f1bb1639c36afa5a0bdf1989f1f3f16b791f52be1982fa08edd6008047"} Sep 07 20:57:57.714439 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.714182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph" event={"ID":"3bc72d5f-9125-45b4-9273-f9cd44a04d48","Type":"ContainerStarted","Data":"52528dcadb93bdd5cba6a73d6f98e58aa1a0284663d4d1d5a1637e119d09496b"} Sep 07 20:57:57.717124 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.716646 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bdgh2" event={"ID":"9ddcc02c-42d3-4264-95da-60499be1e3de","Type":"ContainerStarted","Data":"b12a55d39560bea83b388c47c011ef74b5d19905d3f4be8b02aaf581a33142cd"} Sep 07 20:57:57.719361 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.719333 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" event={"ID":"92b58442-c40e-4135-8ac0-7b9cfaa800b0","Type":"ContainerStarted","Data":"d7929fbf1ebb73771319fc2a246f38977b9b960e4b6de525154dd7c5bafe09ee"} Sep 07 20:57:57.722087 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.721662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" event={"ID":"b521a461-7fd0-4880-b21d-7895fdbfb842","Type":"ContainerStarted","Data":"379cb0f09259e0cf45e5bcfef424f2fe62ef52273da24e3553f39fb0cddc3543"} Sep 07 20:57:57.724456 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.724429 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-2cvhw" event={"ID":"b30b14c4-4646-4edd-8aa1-756b1f8c3fec","Type":"ContainerStarted","Data":"ed53c8a6bd3e80dfadfac0a6a5f7351779493f3fd1e85c89df0c9666b0d6688f"} Sep 07 20:57:57.726178 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.726159 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/0.log" Sep 07 20:57:57.726290 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.726194 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3d892ed-a6fc-4809-a773-17bc6344b8ee" containerID="68e299251a14b37077d49cd0cd448bda0eb3cf8158c1aa4589b826d28583cf7e" exitCode=255 Sep 07 20:57:57.726290 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.726222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" event={"ID":"d3d892ed-a6fc-4809-a773-17bc6344b8ee","Type":"ContainerDied","Data":"68e299251a14b37077d49cd0cd448bda0eb3cf8158c1aa4589b826d28583cf7e"} Sep 07 20:57:57.726447 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.726431 2578 scope.go:117] "RemoveContainer" containerID="68e299251a14b37077d49cd0cd448bda0eb3cf8158c1aa4589b826d28583cf7e" Sep 07 20:57:57.755898 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.755834 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" podStartSLOduration=20.435979498000002 podStartE2EDuration="27.755810865s" totalImagesPullingTime="7.319831367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:57.732714792 +0000 UTC m=+44.021084073" watchObservedRunningTime="2026-09-07 20:57:57.755810865 +0000 UTC m=+44.044180148" Sep 07 20:57:57.756499 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.756464 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" podStartSLOduration=30.33138832 podStartE2EDuration="37.756453184s" totalImagesPullingTime="7.425064864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:57.753917066 +0000 UTC m=+44.042286345" watchObservedRunningTime="2026-09-07 20:57:57.756453184 +0000 UTC m=+44.044822465" Sep 07 20:57:57.790912 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.790851 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" podStartSLOduration=20.52102774 podStartE2EDuration="27.790831017s" totalImagesPullingTime="7.269803277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:57.78926348 +0000 UTC m=+44.077632752" watchObservedRunningTime="2026-09-07 20:57:57.790831017 +0000 UTC m=+44.079200290" Sep 07 20:57:57.809439 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.809382 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bdgh2" podStartSLOduration=2.576878759 podStartE2EDuration="9.809364176s" totalImagesPullingTime="7.232485417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:57.808701256 +0000 UTC m=+44.097070535" watchObservedRunningTime="2026-09-07 20:57:57.809364176 +0000 UTC m=+44.097733456" Sep 07 20:57:57.824005 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:57.823938 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7d2ph" podStartSLOduration=23.613637664 podStartE2EDuration="30.82391395s" totalImagesPullingTime="7.210276286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:57.823899281 +0000 UTC m=+44.112268562" watchObservedRunningTime="2026-09-07 20:57:57.82391395 +0000 UTC m=+44.112283224" Sep 07 20:57:58.423232 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.423159 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-2cvhw" podStartSLOduration=18.111622568 podStartE2EDuration="25.423132189s" totalImagesPullingTime="7.311509621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:57.844346233 +0000 UTC m=+44.132715515" watchObservedRunningTime="2026-09-07 20:57:58.423132189 +0000 UTC m=+44.711501469" Sep 07 20:57:58.423873 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.423845 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hph6v"] Sep 07 20:57:58.440942 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.440901 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hph6v"] Sep 07 20:57:58.441105 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.441062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.443627 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.443594 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n9fsr\"" Sep 07 20:57:58.443789 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.443736 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 20:57:58.444018 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.443994 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 20:57:58.493647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.493592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.493647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.493649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.493917 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.493694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00e98e45-7d53-41aa-9550-b1afa6963552-data-volume\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.493917 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.493735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00e98e45-7d53-41aa-9550-b1afa6963552-crio-socket\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.493917 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.493830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8tsp\" (UniqueName: \"kubernetes.io/projected/00e98e45-7d53-41aa-9550-b1afa6963552-kube-api-access-t8tsp\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.594413 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.594375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.594413 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.594417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.594660 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.594445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00e98e45-7d53-41aa-9550-b1afa6963552-data-volume\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.594660 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.594483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00e98e45-7d53-41aa-9550-b1afa6963552-crio-socket\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.594660 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:58.594519 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 20:57:58.594660 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.594543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8tsp\" (UniqueName: \"kubernetes.io/projected/00e98e45-7d53-41aa-9550-b1afa6963552-kube-api-access-t8tsp\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.594660 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:58.594526 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 20:57:58.594660 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:58.594599 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm podName:00e98e45-7d53-41aa-9550-b1afa6963552 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:59.094577927 +0000 UTC m=+45.382947207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hph6v" (UID: "00e98e45-7d53-41aa-9550-b1afa6963552") : configmap "kube-rbac-proxy" not found Sep 07 20:57:58.594948 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:58.594677 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls podName:00e98e45-7d53-41aa-9550-b1afa6963552 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:59.094657718 +0000 UTC m=+45.383026977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hph6v" (UID: "00e98e45-7d53-41aa-9550-b1afa6963552") : secret "insights-runtime-extractor-tls" not found Sep 07 20:57:58.594948 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.594755 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00e98e45-7d53-41aa-9550-b1afa6963552-crio-socket\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.594948 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.594883 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00e98e45-7d53-41aa-9550-b1afa6963552-data-volume\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.607767 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.607727 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8tsp\" (UniqueName: \"kubernetes.io/projected/00e98e45-7d53-41aa-9550-b1afa6963552-kube-api-access-t8tsp\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:58.731918 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.731890 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/1.log" Sep 07 20:57:58.732357 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.732326 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/0.log" Sep 07 20:57:58.732426 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.732363 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3d892ed-a6fc-4809-a773-17bc6344b8ee" containerID="096f19a6e07b4ca93a6e7c7ebb55cd3deb4afd33bbb2902e93af12c2fe995b81" exitCode=255 Sep 07 20:57:58.732426 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.732396 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" event={"ID":"d3d892ed-a6fc-4809-a773-17bc6344b8ee","Type":"ContainerDied","Data":"096f19a6e07b4ca93a6e7c7ebb55cd3deb4afd33bbb2902e93af12c2fe995b81"} Sep 07 20:57:58.732516 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.732457 2578 scope.go:117] "RemoveContainer" containerID="68e299251a14b37077d49cd0cd448bda0eb3cf8158c1aa4589b826d28583cf7e" Sep 07 20:57:58.732971 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:58.732950 2578 scope.go:117] "RemoveContainer" containerID="096f19a6e07b4ca93a6e7c7ebb55cd3deb4afd33bbb2902e93af12c2fe995b81" Sep 07 20:57:58.733120 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:58.733077 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ltdbr_openshift-console-operator(d3d892ed-a6fc-4809-a773-17bc6344b8ee)\"" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" podUID="d3d892ed-a6fc-4809-a773-17bc6344b8ee" Sep 07 20:57:59.031852 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:59.031769 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:59.031852 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:59.031827 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:57:59.099529 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:59.099483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:59.099529 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:59.099533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:57:59.099823 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:59.099634 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 20:57:59.099823 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:59.099662 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 20:57:59.099823 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:59.099708 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm podName:00e98e45-7d53-41aa-9550-b1afa6963552 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:00.099687309 +0000 UTC m=+46.388056588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hph6v" (UID: "00e98e45-7d53-41aa-9550-b1afa6963552") : configmap "kube-rbac-proxy" not found Sep 07 20:57:59.099823 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:59.099727 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls podName:00e98e45-7d53-41aa-9550-b1afa6963552 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:00.099716171 +0000 UTC m=+46.388085428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hph6v" (UID: "00e98e45-7d53-41aa-9550-b1afa6963552") : secret "insights-runtime-extractor-tls" not found Sep 07 20:57:59.737937 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:59.737901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/1.log" Sep 07 20:57:59.738347 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:59.738255 2578 scope.go:117] "RemoveContainer" containerID="096f19a6e07b4ca93a6e7c7ebb55cd3deb4afd33bbb2902e93af12c2fe995b81" Sep 07 20:57:59.738452 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:57:59.738430 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ltdbr_openshift-console-operator(d3d892ed-a6fc-4809-a773-17bc6344b8ee)\"" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" podUID="d3d892ed-a6fc-4809-a773-17bc6344b8ee" Sep 07 20:57:59.782438 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:57:59.782400 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4fcrz_6f5cbd85-da5a-4640-81f4-1e0761ae9d52/dns-node-resolver/0.log" Sep 07 20:58:00.107452 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:00.107405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:58:00.107452 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:00.107452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:58:00.107657 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:00.107562 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 20:58:00.107657 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:00.107587 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 20:58:00.107657 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:00.107637 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm podName:00e98e45-7d53-41aa-9550-b1afa6963552 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:02.107619048 +0000 UTC m=+48.395988323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hph6v" (UID: "00e98e45-7d53-41aa-9550-b1afa6963552") : configmap "kube-rbac-proxy" not found Sep 07 20:58:00.107657 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:00.107652 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls podName:00e98e45-7d53-41aa-9550-b1afa6963552 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:02.107645695 +0000 UTC m=+48.396014953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hph6v" (UID: "00e98e45-7d53-41aa-9550-b1afa6963552") : secret "insights-runtime-extractor-tls" not found Sep 07 20:58:00.741769 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:00.741731 2578 scope.go:117] "RemoveContainer" containerID="096f19a6e07b4ca93a6e7c7ebb55cd3deb4afd33bbb2902e93af12c2fe995b81" Sep 07 20:58:00.742227 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:00.741952 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ltdbr_openshift-console-operator(d3d892ed-a6fc-4809-a773-17bc6344b8ee)\"" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" podUID="d3d892ed-a6fc-4809-a773-17bc6344b8ee" Sep 07 20:58:01.179701 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:01.179626 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v64xb_413611dd-75b5-46b7-b195-0365dafba1c3/node-ca/0.log" Sep 07 20:58:01.590229 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:01.590188 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bdgh2_9ddcc02c-42d3-4264-95da-60499be1e3de/serve-healthcheck-canary/0.log" Sep 07 20:58:02.125391 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:02.125349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:58:02.125797 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:02.125488 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 20:58:02.125797 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:02.125564 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm podName:00e98e45-7d53-41aa-9550-b1afa6963552 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:06.125543259 +0000 UTC m=+52.413912537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hph6v" (UID: "00e98e45-7d53-41aa-9550-b1afa6963552") : configmap "kube-rbac-proxy" not found Sep 07 20:58:02.125797 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:02.125580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:58:02.125797 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:02.125669 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 20:58:02.125797 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:02.125702 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls podName:00e98e45-7d53-41aa-9550-b1afa6963552 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:06.125694344 +0000 UTC m=+52.414063606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hph6v" (UID: "00e98e45-7d53-41aa-9550-b1afa6963552") : secret "insights-runtime-extractor-tls" not found Sep 07 20:58:04.445505 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:04.445461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:04.445959 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:04.445522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:04.445959 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.445652 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 20:58:04.445959 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.445694 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:20.44567837 +0000 UTC m=+66.734047649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : configmap references non-existent config key: service-ca.crt Sep 07 20:58:04.445959 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.445742 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs podName:d0541c9c-1195-40f0-a412-76512e40f592 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:20.445721899 +0000 UTC m=+66.734091178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs") pod "router-default-78f5cf9fdb-j7c82" (UID: "d0541c9c-1195-40f0-a412-76512e40f592") : secret "router-metrics-certs-default" not found Sep 07 20:58:04.546371 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:04.546304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:58:04.546586 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.546483 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 20:58:04.546586 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.546570 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 20:58:04.546586 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.546584 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb47f9cb8-mxrx7: secret "image-registry-tls" not found Sep 07 20:58:04.546749 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.546594 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls podName:69ac1738-084d-40e5-b4c1-0bfb0a28cc20 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:20.546574107 +0000 UTC m=+66.834943369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jl648" (UID: "69ac1738-084d-40e5-b4c1-0bfb0a28cc20") : secret "cluster-monitoring-operator-tls" not found Sep 07 20:58:04.546749 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:04.546492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:58:04.546749 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.546640 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls podName:82e0a9d0-22fd-40e4-a6ee-2101b8faed43 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:20.546627133 +0000 UTC m=+66.834996391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls") pod "image-registry-7bb47f9cb8-mxrx7" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43") : secret "image-registry-tls" not found Sep 07 20:58:04.546898 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:04.546759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:58:04.546898 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.546845 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 20:58:04.546898 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.546875 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls podName:62e98056-3996-456a-bef8-e19a6a7d7aeb nodeName:}" failed. No retries permitted until 2026-09-07 20:58:20.546867829 +0000 UTC m=+66.835237087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nmkph" (UID: "62e98056-3996-456a-bef8-e19a6a7d7aeb") : secret "samples-operator-tls" not found Sep 07 20:58:04.647333 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:04.647270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:58:04.647520 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.647412 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 20:58:04.647520 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:04.647478 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls podName:3de72ff3-7df7-43cc-9280-ec499a500b25 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:20.647464116 +0000 UTC m=+66.935833373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls") pod "dns-default-z69sv" (UID: "3de72ff3-7df7-43cc-9280-ec499a500b25") : secret "dns-default-metrics-tls" not found Sep 07 20:58:06.162196 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:06.162136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:58:06.162652 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:06.162203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:58:06.162652 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:06.162293 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 20:58:06.162652 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:06.162389 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls podName:00e98e45-7d53-41aa-9550-b1afa6963552 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:14.16237108 +0000 UTC m=+60.450740338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hph6v" (UID: "00e98e45-7d53-41aa-9550-b1afa6963552") : secret "insights-runtime-extractor-tls" not found Sep 07 20:58:06.162859 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:06.162841 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e98e45-7d53-41aa-9550-b1afa6963552-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:58:12.313388 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:12.313352 2578 scope.go:117] "RemoveContainer" containerID="096f19a6e07b4ca93a6e7c7ebb55cd3deb4afd33bbb2902e93af12c2fe995b81" Sep 07 20:58:12.781962 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:12.781933 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/2.log" Sep 07 20:58:12.782402 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:12.782385 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/1.log" Sep 07 20:58:12.782495 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:12.782421 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3d892ed-a6fc-4809-a773-17bc6344b8ee" containerID="04499c6eeac8e1ffd6a3059242b808215329faa3170509bcc76924d751870d42" exitCode=255 Sep 07 20:58:12.782495 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:12.782479 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" event={"ID":"d3d892ed-a6fc-4809-a773-17bc6344b8ee","Type":"ContainerDied","Data":"04499c6eeac8e1ffd6a3059242b808215329faa3170509bcc76924d751870d42"} Sep 07 20:58:12.782576 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:12.782532 2578 scope.go:117] "RemoveContainer" containerID="096f19a6e07b4ca93a6e7c7ebb55cd3deb4afd33bbb2902e93af12c2fe995b81" Sep 07 20:58:12.782969 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:12.782942 2578 scope.go:117] "RemoveContainer" containerID="04499c6eeac8e1ffd6a3059242b808215329faa3170509bcc76924d751870d42" Sep 07 20:58:12.783169 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:12.783142 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-ltdbr_openshift-console-operator(d3d892ed-a6fc-4809-a773-17bc6344b8ee)\"" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" podUID="d3d892ed-a6fc-4809-a773-17bc6344b8ee" Sep 07 20:58:13.652520 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:13.652492 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qjfq" Sep 07 20:58:13.787663 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:13.787631 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/2.log" Sep 07 20:58:14.233889 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:14.233857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:58:14.236730 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:14.236695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e98e45-7d53-41aa-9550-b1afa6963552-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hph6v\" (UID: \"00e98e45-7d53-41aa-9550-b1afa6963552\") " pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:58:14.354221 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:14.354184 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n9fsr\"" Sep 07 20:58:14.361972 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:14.361942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hph6v" Sep 07 20:58:14.639998 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:14.639902 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hph6v"] Sep 07 20:58:14.643477 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:14.643444 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e98e45_7d53_41aa_9550_b1afa6963552.slice/crio-0bed159d09bab97d972bd1cfc694dd2182ef2a21c1526eb54b19b8ca0a7b1819 WatchSource:0}: Error finding container 0bed159d09bab97d972bd1cfc694dd2182ef2a21c1526eb54b19b8ca0a7b1819: Status 404 returned error can't find the container with id 0bed159d09bab97d972bd1cfc694dd2182ef2a21c1526eb54b19b8ca0a7b1819 Sep 07 20:58:14.792096 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:14.792062 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hph6v" event={"ID":"00e98e45-7d53-41aa-9550-b1afa6963552","Type":"ContainerStarted","Data":"95bd37dfce4f58f1fc5243161435ecea584db5303728e504aa40f65aa514a32e"} Sep 07 20:58:14.792522 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:14.792122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hph6v" event={"ID":"00e98e45-7d53-41aa-9550-b1afa6963552","Type":"ContainerStarted","Data":"0bed159d09bab97d972bd1cfc694dd2182ef2a21c1526eb54b19b8ca0a7b1819"} Sep 07 20:58:15.798412 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:15.798374 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hph6v" event={"ID":"00e98e45-7d53-41aa-9550-b1afa6963552","Type":"ContainerStarted","Data":"cf4fca926794418a90c03374513853078b8cebc27c9f369fd3736e8f3efc66fd"} Sep 07 20:58:16.803671 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:16.803632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hph6v" event={"ID":"00e98e45-7d53-41aa-9550-b1afa6963552","Type":"ContainerStarted","Data":"8f0e3cd6d8e922c93fa980ce8bda347e92166875da92ef72f7fb76d2d9ed9e3a"} Sep 07 20:58:16.824362 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:16.824288 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hph6v" podStartSLOduration=17.123779062 podStartE2EDuration="18.824270717s" totalImagesPullingTime="1.700491655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:16.822221022 +0000 UTC m=+63.110590302" watchObservedRunningTime="2026-09-07 20:58:16.824270717 +0000 UTC m=+63.112639997" Sep 07 20:58:19.031970 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.031924 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:58:19.032372 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.031985 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:58:19.032372 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.032298 2578 scope.go:117] "RemoveContainer" containerID="04499c6eeac8e1ffd6a3059242b808215329faa3170509bcc76924d751870d42" Sep 07 20:58:19.032880 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:19.032474 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-ltdbr_openshift-console-operator(d3d892ed-a6fc-4809-a773-17bc6344b8ee)\"" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" podUID="d3d892ed-a6fc-4809-a773-17bc6344b8ee" Sep 07 20:58:19.078289 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.078239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:58:19.080828 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.080806 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 20:58:19.090859 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.090838 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af830417-6366-47ce-868f-221f859ff24e-metrics-certs\") pod \"network-metrics-daemon-5645v\" (UID: \"af830417-6366-47ce-868f-221f859ff24e\") " pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:58:19.179761 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.179702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdnm\" (UniqueName: \"kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm\") pod \"network-check-target-lvmpk\" (UID: \"ec254331-d4df-4295-84bd-ee477edb9b85\") " pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:58:19.180032 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.180000 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:58:19.182613 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.182579 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdnm\" (UniqueName: \"kubernetes.io/projected/ec254331-d4df-4295-84bd-ee477edb9b85-kube-api-access-vcdnm\") pod \"network-check-target-lvmpk\" (UID: \"ec254331-d4df-4295-84bd-ee477edb9b85\") " pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:58:19.182780 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.182764 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 20:58:19.193030 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.193004 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b417cb6-1545-46c2-86bf-f4b5fbffafa7-original-pull-secret\") pod \"global-pull-secret-syncer-khvqk\" (UID: \"6b417cb6-1545-46c2-86bf-f4b5fbffafa7\") " pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:58:19.326571 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.326479 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zznrj\"" Sep 07 20:58:19.328393 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.328373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khvqk" Sep 07 20:58:19.334268 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.334251 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5645v" Sep 07 20:58:19.441833 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.441798 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qbj94\"" Sep 07 20:58:19.448986 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.448952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:58:19.602086 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.602058 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-khvqk"] Sep 07 20:58:19.604071 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:19.604037 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b417cb6_1545_46c2_86bf_f4b5fbffafa7.slice/crio-7788de1498b7aa2842ab5e2d2f863da751ae05bcec18cc08ddff5078be340f65 WatchSource:0}: Error finding container 7788de1498b7aa2842ab5e2d2f863da751ae05bcec18cc08ddff5078be340f65: Status 404 returned error can't find the container with id 7788de1498b7aa2842ab5e2d2f863da751ae05bcec18cc08ddff5078be340f65 Sep 07 20:58:19.608399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.608368 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5645v"] Sep 07 20:58:19.611725 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:19.611699 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf830417_6366_47ce_868f_221f859ff24e.slice/crio-7d8270c390e8dab656fd1d9cab5927ba13c2f6ca25644d5e4b2713a126aa2418 WatchSource:0}: Error finding container 7d8270c390e8dab656fd1d9cab5927ba13c2f6ca25644d5e4b2713a126aa2418: Status 404 returned error can't find the container with id 7d8270c390e8dab656fd1d9cab5927ba13c2f6ca25644d5e4b2713a126aa2418 Sep 07 20:58:19.719409 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.719372 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lvmpk"] Sep 07 20:58:19.722626 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:19.722599 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec254331_d4df_4295_84bd_ee477edb9b85.slice/crio-46185fba5350be7f56c0638d31ece56f0c3897963d01b151ac75ca71af98dfbb WatchSource:0}: Error finding container 46185fba5350be7f56c0638d31ece56f0c3897963d01b151ac75ca71af98dfbb: Status 404 returned error can't find the container with id 46185fba5350be7f56c0638d31ece56f0c3897963d01b151ac75ca71af98dfbb Sep 07 20:58:19.814700 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.814661 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5645v" event={"ID":"af830417-6366-47ce-868f-221f859ff24e","Type":"ContainerStarted","Data":"7d8270c390e8dab656fd1d9cab5927ba13c2f6ca25644d5e4b2713a126aa2418"} Sep 07 20:58:19.815831 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.815802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-khvqk" event={"ID":"6b417cb6-1545-46c2-86bf-f4b5fbffafa7","Type":"ContainerStarted","Data":"7788de1498b7aa2842ab5e2d2f863da751ae05bcec18cc08ddff5078be340f65"} Sep 07 20:58:19.817355 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.817328 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lvmpk" event={"ID":"ec254331-d4df-4295-84bd-ee477edb9b85","Type":"ContainerStarted","Data":"86b8d75b77422e05019eb5beb935d133bfc0ff0a07bf1dfab2b7bfbb32c0f0ea"} Sep 07 20:58:19.817468 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.817375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lvmpk" event={"ID":"ec254331-d4df-4295-84bd-ee477edb9b85","Type":"ContainerStarted","Data":"46185fba5350be7f56c0638d31ece56f0c3897963d01b151ac75ca71af98dfbb"} Sep 07 20:58:19.817468 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.817452 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:58:19.836580 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:19.836526 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lvmpk" podStartSLOduration=65.836507595 podStartE2EDuration="1m5.836507595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:19.835556009 +0000 UTC m=+66.123925290" watchObservedRunningTime="2026-09-07 20:58:19.836507595 +0000 UTC m=+66.124876874" Sep 07 20:58:20.492116 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.492073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:20.492639 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.492236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:20.492944 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.492891 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0541c9c-1195-40f0-a412-76512e40f592-service-ca-bundle\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:20.495350 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.495301 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0541c9c-1195-40f0-a412-76512e40f592-metrics-certs\") pod \"router-default-78f5cf9fdb-j7c82\" (UID: \"d0541c9c-1195-40f0-a412-76512e40f592\") " pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:20.593499 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.593413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:58:20.593499 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.593487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:58:20.593798 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.593525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:58:20.596846 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.596786 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") pod \"image-registry-7bb47f9cb8-mxrx7\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:58:20.597334 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.597261 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62e98056-3996-456a-bef8-e19a6a7d7aeb-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nmkph\" (UID: \"62e98056-3996-456a-bef8-e19a6a7d7aeb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:58:20.597479 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.597453 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69ac1738-084d-40e5-b4c1-0bfb0a28cc20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jl648\" (UID: \"69ac1738-084d-40e5-b4c1-0bfb0a28cc20\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:58:20.694244 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.694210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:58:20.697074 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.697044 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de72ff3-7df7-43cc-9280-ec499a500b25-metrics-tls\") pod \"dns-default-z69sv\" (UID: \"3de72ff3-7df7-43cc-9280-ec499a500b25\") " pod="openshift-dns/dns-default-z69sv" Sep 07 20:58:20.729324 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.729280 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qwnfj\"" Sep 07 20:58:20.737436 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.737410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:20.745025 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.744959 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hqz49\"" Sep 07 20:58:20.754207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.753961 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" Sep 07 20:58:20.793056 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.793026 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-47zm6\"" Sep 07 20:58:20.801014 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.800786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:58:20.816478 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.816407 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kx5ls\"" Sep 07 20:58:20.826390 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.825160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" Sep 07 20:58:20.923170 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.923130 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdcf7\"" Sep 07 20:58:20.931520 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:20.931492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z69sv" Sep 07 20:58:21.026625 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.026551 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78f5cf9fdb-j7c82"] Sep 07 20:58:21.051653 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.051572 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648"] Sep 07 20:58:21.060737 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:21.060620 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ac1738_084d_40e5_b4c1_0bfb0a28cc20.slice/crio-1df595bacebfac6c7ffbb0d592034e6300651b0980dc0a5b75bc17e50fe1e306 WatchSource:0}: Error finding container 1df595bacebfac6c7ffbb0d592034e6300651b0980dc0a5b75bc17e50fe1e306: Status 404 returned error can't find the container with id 1df595bacebfac6c7ffbb0d592034e6300651b0980dc0a5b75bc17e50fe1e306 Sep 07 20:58:21.098785 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.098722 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bb47f9cb8-mxrx7"] Sep 07 20:58:21.102620 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:21.102586 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e0a9d0_22fd_40e4_a6ee_2101b8faed43.slice/crio-bdd4c9514aeae6ec992c9238e762b2000a4d6625190ee7af63a51c32a98c226a WatchSource:0}: Error finding container bdd4c9514aeae6ec992c9238e762b2000a4d6625190ee7af63a51c32a98c226a: Status 404 returned error can't find the container with id bdd4c9514aeae6ec992c9238e762b2000a4d6625190ee7af63a51c32a98c226a Sep 07 20:58:21.137425 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.137377 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph"] Sep 07 20:58:21.223518 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.223482 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z69sv"] Sep 07 20:58:21.228110 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:21.228065 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de72ff3_7df7_43cc_9280_ec499a500b25.slice/crio-311bfac9c1d6e2ee1e6ce68925f43f18df00791f13af61896bb40d360ef17cfe WatchSource:0}: Error finding container 311bfac9c1d6e2ee1e6ce68925f43f18df00791f13af61896bb40d360ef17cfe: Status 404 returned error can't find the container with id 311bfac9c1d6e2ee1e6ce68925f43f18df00791f13af61896bb40d360ef17cfe Sep 07 20:58:21.829849 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.829707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z69sv" event={"ID":"3de72ff3-7df7-43cc-9280-ec499a500b25","Type":"ContainerStarted","Data":"311bfac9c1d6e2ee1e6ce68925f43f18df00791f13af61896bb40d360ef17cfe"} Sep 07 20:58:21.832967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.832631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" event={"ID":"82e0a9d0-22fd-40e4-a6ee-2101b8faed43","Type":"ContainerStarted","Data":"f303fee38e3283d6ea416baf06066c657d747737a8ddf22f23366bd1a37d512f"} Sep 07 20:58:21.832967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.832705 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:58:21.832967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.832730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" event={"ID":"82e0a9d0-22fd-40e4-a6ee-2101b8faed43","Type":"ContainerStarted","Data":"bdd4c9514aeae6ec992c9238e762b2000a4d6625190ee7af63a51c32a98c226a"} Sep 07 20:58:21.834960 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.834928 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" event={"ID":"69ac1738-084d-40e5-b4c1-0bfb0a28cc20","Type":"ContainerStarted","Data":"1df595bacebfac6c7ffbb0d592034e6300651b0980dc0a5b75bc17e50fe1e306"} Sep 07 20:58:21.838429 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.837891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5645v" event={"ID":"af830417-6366-47ce-868f-221f859ff24e","Type":"ContainerStarted","Data":"f49af0fad637b5b113e85901f9d4531eb16a6eb6a0b10219fe15e56f9e9efb4d"} Sep 07 20:58:21.838429 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.837944 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5645v" event={"ID":"af830417-6366-47ce-868f-221f859ff24e","Type":"ContainerStarted","Data":"4c6845898fbfc7d2dd7e11528c503da992c3f4e409d5adcba5ca87c4c7a439a9"} Sep 07 20:58:21.841389 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.841360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" event={"ID":"62e98056-3996-456a-bef8-e19a6a7d7aeb","Type":"ContainerStarted","Data":"d684a3ae8bbee608ab414b42cd1222dd3c21ecd11b949379520aa2d5aa4ee03e"} Sep 07 20:58:21.843595 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.843562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" event={"ID":"d0541c9c-1195-40f0-a412-76512e40f592","Type":"ContainerStarted","Data":"2cd5d429d2373cc7653329f6288c8479ca10a7b471b76ca85577da9df0cfd8bf"} Sep 07 20:58:21.843704 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.843617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" event={"ID":"d0541c9c-1195-40f0-a412-76512e40f592","Type":"ContainerStarted","Data":"602bb6d878d3d295b8c161c1dc8fb91026a0e98993399f7ef82ec2d5caad34e4"} Sep 07 20:58:21.855063 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.854804 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" podStartSLOduration=51.854787271 podStartE2EDuration="51.854787271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:21.85315509 +0000 UTC m=+68.141524371" watchObservedRunningTime="2026-09-07 20:58:21.854787271 +0000 UTC m=+68.143156550" Sep 07 20:58:21.874060 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:21.872791 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" podStartSLOduration=61.872767778 podStartE2EDuration="1m1.872767778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:21.87199521 +0000 UTC m=+68.160364527" watchObservedRunningTime="2026-09-07 20:58:21.872767778 +0000 UTC m=+68.161137060" Sep 07 20:58:22.737786 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:22.737741 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:22.741508 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:22.741477 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:22.762229 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:22.762168 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5645v" podStartSLOduration=67.659751873 podStartE2EDuration="1m8.762146947s" totalImagesPullingTime="1.102395074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:21.889867148 +0000 UTC m=+68.178236429" watchObservedRunningTime="2026-09-07 20:58:22.762146947 +0000 UTC m=+69.050516280" Sep 07 20:58:22.848608 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:22.848569 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:22.849973 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:22.849946 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78f5cf9fdb-j7c82" Sep 07 20:58:23.773567 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:23.773526 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bb47f9cb8-mxrx7"] Sep 07 20:58:23.863043 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:23.863010 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-886bb9cd9-8g86m"] Sep 07 20:58:23.874069 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:23.874036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:23.880939 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:23.880906 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-886bb9cd9-8g86m"] Sep 07 20:58:24.027807 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.027710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-ca-trust-extracted\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.027807 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.027752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-bound-sa-token\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.027807 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.027776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-trusted-ca\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.028100 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.027865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-image-registry-private-configuration\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.028100 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.027889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtc9v\" (UniqueName: \"kubernetes.io/projected/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-kube-api-access-gtc9v\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.028100 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.027960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-registry-certificates\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.028100 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.028002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-registry-tls\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.028100 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.028047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-installation-pull-secrets\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.128647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.128588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-trusted-ca\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.128863 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.128659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-image-registry-private-configuration\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.128863 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.128694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtc9v\" (UniqueName: \"kubernetes.io/projected/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-kube-api-access-gtc9v\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.128863 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.128737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-registry-certificates\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.128863 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.128763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-registry-tls\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.128863 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.128809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-installation-pull-secrets\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.129099 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.128866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-ca-trust-extracted\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.129099 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.128888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-bound-sa-token\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.130119 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.130067 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-registry-certificates\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.130426 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.130379 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-ca-trust-extracted\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.131082 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.131059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-trusted-ca\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.132712 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.132681 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-installation-pull-secrets\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.133139 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.133112 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-image-registry-private-configuration\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.133967 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.133924 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-registry-tls\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.145152 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.145119 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-bound-sa-token\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.145700 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.145676 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtc9v\" (UniqueName: \"kubernetes.io/projected/2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411-kube-api-access-gtc9v\") pod \"image-registry-886bb9cd9-8g86m\" (UID: \"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411\") " pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:24.185891 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:24.185830 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:26.325713 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.325642 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-886bb9cd9-8g86m"] Sep 07 20:58:26.868253 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.868213 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" event={"ID":"62e98056-3996-456a-bef8-e19a6a7d7aeb","Type":"ContainerStarted","Data":"6a2fac562a0a7b49dc7707bac6b7366c20489a03b84a209f7deda508280dc2df"} Sep 07 20:58:26.868463 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.868271 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" event={"ID":"62e98056-3996-456a-bef8-e19a6a7d7aeb","Type":"ContainerStarted","Data":"57e826b8dd7877e752326d37703bdb9f4bd6d65e7b19524a157cee675b2abc20"} Sep 07 20:58:26.869845 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.869814 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" event={"ID":"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411","Type":"ContainerStarted","Data":"861b793a275e8ec7c2e468948c15d8af28af2cd291d37fc083db5cf59a928792"} Sep 07 20:58:26.869959 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.869862 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" event={"ID":"2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411","Type":"ContainerStarted","Data":"2c1d8d88be0b0d6b17f9141c778fb0beadcf3497b10b917da587016bf3ea2d81"} Sep 07 20:58:26.869959 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.869888 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:26.871363 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.871335 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-khvqk" event={"ID":"6b417cb6-1545-46c2-86bf-f4b5fbffafa7","Type":"ContainerStarted","Data":"5a2779729d4fd8980146614263614e9a664eec1778fc774e93e1e87338d9cf26"} Sep 07 20:58:26.873012 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.872971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z69sv" event={"ID":"3de72ff3-7df7-43cc-9280-ec499a500b25","Type":"ContainerStarted","Data":"26abf9db068848e1c92dce18b17eebb60beb2d25af60215e11b67e0a583973ea"} Sep 07 20:58:26.873117 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.873021 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z69sv" Sep 07 20:58:26.873117 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.873046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z69sv" event={"ID":"3de72ff3-7df7-43cc-9280-ec499a500b25","Type":"ContainerStarted","Data":"d7132d958aea65b86abd5068b6cf309e019f2e4f0fc8161ad237c05ab431fece"} Sep 07 20:58:26.874421 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.874398 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" event={"ID":"69ac1738-084d-40e5-b4c1-0bfb0a28cc20","Type":"ContainerStarted","Data":"f98559f2f99d6ccb3f4ea2003f1375b6f8b6135bb7b189e40fefef5b40d7e766"} Sep 07 20:58:26.889203 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.889153 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nmkph" podStartSLOduration=55.043943919 podStartE2EDuration="59.889136851s" totalImagesPullingTime="4.845192932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:26.887286204 +0000 UTC m=+73.175655481" watchObservedRunningTime="2026-09-07 20:58:26.889136851 +0000 UTC m=+73.177506168" Sep 07 20:58:26.912347 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.910278 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-khvqk" podStartSLOduration=66.484360929 podStartE2EDuration="1m12.910253683s" totalImagesPullingTime="6.425892754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:26.907644583 +0000 UTC m=+73.196013882" watchObservedRunningTime="2026-09-07 20:58:26.910253683 +0000 UTC m=+73.198622965" Sep 07 20:58:26.929432 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.929367 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z69sv" podStartSLOduration=34.122724471 podStartE2EDuration="38.929346665s" totalImagesPullingTime="4.806622194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:26.928368137 +0000 UTC m=+73.216737416" watchObservedRunningTime="2026-09-07 20:58:26.929346665 +0000 UTC m=+73.217715990" Sep 07 20:58:26.950507 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.950445 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" podStartSLOduration=3.950429013 podStartE2EDuration="3.950429013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:26.949849309 +0000 UTC m=+73.238218580" watchObservedRunningTime="2026-09-07 20:58:26.950429013 +0000 UTC m=+73.238798292" Sep 07 20:58:26.966696 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:26.966635 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jl648" podStartSLOduration=61.997510653 podStartE2EDuration="1m6.966615524s" totalImagesPullingTime="4.969104871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:26.96470863 +0000 UTC m=+73.253077910" watchObservedRunningTime="2026-09-07 20:58:26.966615524 +0000 UTC m=+73.254984804" Sep 07 20:58:34.314587 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:34.314554 2578 scope.go:117] "RemoveContainer" containerID="04499c6eeac8e1ffd6a3059242b808215329faa3170509bcc76924d751870d42" Sep 07 20:58:34.906248 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:34.906218 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/2.log" Sep 07 20:58:34.906456 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:34.906293 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" event={"ID":"d3d892ed-a6fc-4809-a773-17bc6344b8ee","Type":"ContainerStarted","Data":"d761341d4928aa0df31022bcc9c2693dbcbe03aef32842992544815324c170f5"} Sep 07 20:58:34.906600 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:34.906575 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:58:34.911576 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:34.911552 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" Sep 07 20:58:34.932160 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:34.932102 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-ltdbr" podStartSLOduration=59.590792491 podStartE2EDuration="1m6.932083716s" totalImagesPullingTime="7.341291225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:34.930736144 +0000 UTC m=+81.219105425" watchObservedRunningTime="2026-09-07 20:58:34.932083716 +0000 UTC m=+81.220452996" Sep 07 20:58:36.881359 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:36.881179 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z69sv" Sep 07 20:58:37.300800 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.300760 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8jgjt"] Sep 07 20:58:37.304140 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.304114 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.306423 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.306402 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 20:58:37.306917 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.306898 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f8l9n\"" Sep 07 20:58:37.307496 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.307469 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 20:58:37.307603 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.307495 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 20:58:37.307603 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.307469 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 20:58:37.444407 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.444363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.444569 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.444424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-tls\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.444569 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.444451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee996f6f-f088-4e7d-8660-c9b9883c77f7-metrics-client-ca\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.444569 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.444505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htq6h\" (UniqueName: \"kubernetes.io/projected/ee996f6f-f088-4e7d-8660-c9b9883c77f7-kube-api-access-htq6h\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.444569 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.444536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee996f6f-f088-4e7d-8660-c9b9883c77f7-root\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.444569 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.444561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-textfile\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.444737 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.444600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.444737 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.444624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee996f6f-f088-4e7d-8660-c9b9883c77f7-sys\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.444737 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.444657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-wtmp\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546036 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.545973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-tls\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546188 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee996f6f-f088-4e7d-8660-c9b9883c77f7-metrics-client-ca\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546188 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htq6h\" (UniqueName: \"kubernetes.io/projected/ee996f6f-f088-4e7d-8660-c9b9883c77f7-kube-api-access-htq6h\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546188 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee996f6f-f088-4e7d-8660-c9b9883c77f7-root\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546188 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-textfile\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546188 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546457 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee996f6f-f088-4e7d-8660-c9b9883c77f7-sys\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546457 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546222 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee996f6f-f088-4e7d-8660-c9b9883c77f7-root\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546457 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-wtmp\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546457 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546457 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546340 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee996f6f-f088-4e7d-8660-c9b9883c77f7-sys\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546457 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546393 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-wtmp\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.546786 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.546758 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-textfile\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.547134 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.547108 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee996f6f-f088-4e7d-8660-c9b9883c77f7-metrics-client-ca\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.547270 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.547113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.548864 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.548832 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-tls\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.549464 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.549444 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee996f6f-f088-4e7d-8660-c9b9883c77f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.559850 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.559772 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htq6h\" (UniqueName: \"kubernetes.io/projected/ee996f6f-f088-4e7d-8660-c9b9883c77f7-kube-api-access-htq6h\") pod \"node-exporter-8jgjt\" (UID: \"ee996f6f-f088-4e7d-8660-c9b9883c77f7\") " pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.613751 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.613711 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8jgjt" Sep 07 20:58:37.626512 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:37.626473 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee996f6f_f088_4e7d_8660_c9b9883c77f7.slice/crio-c1d216a916e78b1795dfdada0330f14e83fe5c35bb497f8e3114354296363aa7 WatchSource:0}: Error finding container c1d216a916e78b1795dfdada0330f14e83fe5c35bb497f8e3114354296363aa7: Status 404 returned error can't find the container with id c1d216a916e78b1795dfdada0330f14e83fe5c35bb497f8e3114354296363aa7 Sep 07 20:58:37.918433 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:37.918343 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jgjt" event={"ID":"ee996f6f-f088-4e7d-8660-c9b9883c77f7","Type":"ContainerStarted","Data":"c1d216a916e78b1795dfdada0330f14e83fe5c35bb497f8e3114354296363aa7"} Sep 07 20:58:38.320286 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.320254 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 20:58:38.323303 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.323270 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.325707 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.325644 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 20:58:38.325857 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.325830 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-95q87\"" Sep 07 20:58:38.325989 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.325887 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 20:58:38.326219 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.326114 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 20:58:38.326219 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.326169 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 20:58:38.326698 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.326497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 20:58:38.326698 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.326518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 20:58:38.326698 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.326529 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 20:58:38.326698 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.326553 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 20:58:38.326698 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.326557 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 20:58:38.335223 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.335159 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 20:58:38.454727 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.454679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.454727 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.454727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.454984 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.454754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.454984 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.454784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.454984 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.454817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.454984 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.454844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-config-volume\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.454984 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.454860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-config-out\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.454984 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.454926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.454984 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.454950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn42j\" (UniqueName: \"kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-kube-api-access-sn42j\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.454984 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.454983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.455399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.455048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.455399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.455135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-web-config\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.455399 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.455197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-tls-assets\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556464 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-web-config\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556614 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-tls-assets\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556614 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556614 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556614 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556614 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556852 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556852 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-config-volume\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556852 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-config-out\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556852 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556852 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn42j\" (UniqueName: \"kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-kube-api-access-sn42j\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556852 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556768 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.556852 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.556795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.558066 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:58:38.558036 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-trusted-ca-bundle podName:866b7305-bc25-4b93-948f-10b816d92b57 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:39.058011422 +0000 UTC m=+85.346380696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "866b7305-bc25-4b93-948f-10b816d92b57") : configmap references non-existent config key: ca-bundle.crt Sep 07 20:58:38.559351 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.559290 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.559647 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.559467 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.560618 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.560572 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.560618 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.560592 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-config-out\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.562078 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.562051 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.562183 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.562092 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.562183 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.562113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-tls-assets\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.562281 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.562203 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.562281 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.562208 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-config-volume\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.562724 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.562708 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-web-config\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.563443 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.563419 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.571081 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.571010 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn42j\" (UniqueName: \"kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-kube-api-access-sn42j\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:38.927480 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.927390 2578 generic.go:356] "Generic (PLEG): container finished" podID="ee996f6f-f088-4e7d-8660-c9b9883c77f7" containerID="722e3ee36eceaeeb2087e84a34ad02da40787cc2f310b60f279ce8aff08ce565" exitCode=0 Sep 07 20:58:38.927861 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:38.927473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jgjt" event={"ID":"ee996f6f-f088-4e7d-8660-c9b9883c77f7","Type":"ContainerDied","Data":"722e3ee36eceaeeb2087e84a34ad02da40787cc2f310b60f279ce8aff08ce565"} Sep 07 20:58:39.061698 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:39.061666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:39.062551 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:39.062522 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:39.236433 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:39.236397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:58:39.519103 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:39.519076 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 20:58:39.520204 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:39.520164 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866b7305_bc25_4b93_948f_10b816d92b57.slice/crio-03b56056b2605e63502e006c2103b52f3f91b0d56ad544391696d6631b79b072 WatchSource:0}: Error finding container 03b56056b2605e63502e006c2103b52f3f91b0d56ad544391696d6631b79b072: Status 404 returned error can't find the container with id 03b56056b2605e63502e006c2103b52f3f91b0d56ad544391696d6631b79b072 Sep 07 20:58:39.935247 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:39.935142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jgjt" event={"ID":"ee996f6f-f088-4e7d-8660-c9b9883c77f7","Type":"ContainerStarted","Data":"b473beb2bfab98bafed9e3797d10621cd2f122547c044ee64fcfa21e21561d3b"} Sep 07 20:58:39.935247 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:39.935216 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jgjt" event={"ID":"ee996f6f-f088-4e7d-8660-c9b9883c77f7","Type":"ContainerStarted","Data":"038056ac7964032322f8f9bf7fb2eac17a833a74151fd60610c425092573e697"} Sep 07 20:58:39.936611 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:39.936584 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerStarted","Data":"03b56056b2605e63502e006c2103b52f3f91b0d56ad544391696d6631b79b072"} Sep 07 20:58:39.957422 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:39.957350 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8jgjt" podStartSLOduration=2.006266953 podStartE2EDuration="2.957303046s" totalImagesPullingTime="885.073069ms" totalInitContainerRuntime="65.963024ms" isStatefulPod=true podCreationTimestamp="2026-09-07 20:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:39.956259185 +0000 UTC m=+86.244628467" watchObservedRunningTime="2026-09-07 20:58:39.957303046 +0000 UTC m=+86.245672324" Sep 07 20:58:40.941736 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:40.941699 2578 generic.go:356] "Generic (PLEG): container finished" podID="866b7305-bc25-4b93-948f-10b816d92b57" containerID="1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df" exitCode=0 Sep 07 20:58:40.942278 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:40.941791 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerDied","Data":"1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df"} Sep 07 20:58:41.663382 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.663344 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c7dd5847b-xqp5z"] Sep 07 20:58:41.666716 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.666689 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.669522 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.669497 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 20:58:41.669677 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.669539 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 07 20:58:41.669677 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.669534 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 07 20:58:41.669677 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.669575 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 07 20:58:41.671053 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.671030 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rkfxh\"" Sep 07 20:58:41.671225 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.671206 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-em2urs2dfur94\"" Sep 07 20:58:41.677366 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.677339 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c7dd5847b-xqp5z"] Sep 07 20:58:41.685973 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.685940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6f3b2b65-6539-4442-8712-72afaa26dbfd-secret-metrics-server-tls\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.686138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.685983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv8qd\" (UniqueName: \"kubernetes.io/projected/6f3b2b65-6539-4442-8712-72afaa26dbfd-kube-api-access-sv8qd\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.686138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.686008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f3b2b65-6539-4442-8712-72afaa26dbfd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.686138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.686112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6f3b2b65-6539-4442-8712-72afaa26dbfd-secret-metrics-server-client-certs\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.686339 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.686162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6f3b2b65-6539-4442-8712-72afaa26dbfd-metrics-server-audit-profiles\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.686339 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.686198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f3b2b65-6539-4442-8712-72afaa26dbfd-client-ca-bundle\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.686339 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.686260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6f3b2b65-6539-4442-8712-72afaa26dbfd-audit-log\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.787780 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.787742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6f3b2b65-6539-4442-8712-72afaa26dbfd-secret-metrics-server-tls\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.787780 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.787783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv8qd\" (UniqueName: \"kubernetes.io/projected/6f3b2b65-6539-4442-8712-72afaa26dbfd-kube-api-access-sv8qd\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.788028 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.787819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f3b2b65-6539-4442-8712-72afaa26dbfd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.788028 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.787868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6f3b2b65-6539-4442-8712-72afaa26dbfd-secret-metrics-server-client-certs\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.788028 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.787896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6f3b2b65-6539-4442-8712-72afaa26dbfd-metrics-server-audit-profiles\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.788028 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.787924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f3b2b65-6539-4442-8712-72afaa26dbfd-client-ca-bundle\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.788028 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.787983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6f3b2b65-6539-4442-8712-72afaa26dbfd-audit-log\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.788558 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.788509 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6f3b2b65-6539-4442-8712-72afaa26dbfd-audit-log\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.788783 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.788752 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f3b2b65-6539-4442-8712-72afaa26dbfd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.789077 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.789052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6f3b2b65-6539-4442-8712-72afaa26dbfd-metrics-server-audit-profiles\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.791176 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.791148 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6f3b2b65-6539-4442-8712-72afaa26dbfd-secret-metrics-server-tls\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.791343 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.791296 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f3b2b65-6539-4442-8712-72afaa26dbfd-client-ca-bundle\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.791801 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.791780 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6f3b2b65-6539-4442-8712-72afaa26dbfd-secret-metrics-server-client-certs\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.802191 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.802151 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv8qd\" (UniqueName: \"kubernetes.io/projected/6f3b2b65-6539-4442-8712-72afaa26dbfd-kube-api-access-sv8qd\") pod \"metrics-server-6c7dd5847b-xqp5z\" (UID: \"6f3b2b65-6539-4442-8712-72afaa26dbfd\") " pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:41.979380 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:41.979342 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:58:42.450901 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:42.450862 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c7dd5847b-xqp5z"] Sep 07 20:58:42.462537 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:42.462507 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f3b2b65_6539_4442_8712_72afaa26dbfd.slice/crio-7c82450d12cbd65b83bd6971e9c092e007042d148ea00a3ce223f7e603df30e3 WatchSource:0}: Error finding container 7c82450d12cbd65b83bd6971e9c092e007042d148ea00a3ce223f7e603df30e3: Status 404 returned error can't find the container with id 7c82450d12cbd65b83bd6971e9c092e007042d148ea00a3ce223f7e603df30e3 Sep 07 20:58:42.956719 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:42.956629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerStarted","Data":"d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0"} Sep 07 20:58:42.956883 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:42.956726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerStarted","Data":"363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5"} Sep 07 20:58:42.956883 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:42.956769 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerStarted","Data":"37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15"} Sep 07 20:58:42.956883 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:42.956811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerStarted","Data":"1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be"} Sep 07 20:58:42.956883 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:42.956851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerStarted","Data":"6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620"} Sep 07 20:58:42.958213 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:42.958186 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" event={"ID":"6f3b2b65-6539-4442-8712-72afaa26dbfd","Type":"ContainerStarted","Data":"7c82450d12cbd65b83bd6971e9c092e007042d148ea00a3ce223f7e603df30e3"} Sep 07 20:58:43.858461 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:43.858430 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:58:43.966780 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:43.966736 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerStarted","Data":"4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a"} Sep 07 20:58:43.968447 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:43.968420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" event={"ID":"6f3b2b65-6539-4442-8712-72afaa26dbfd","Type":"ContainerStarted","Data":"bb15427a78f32163f98c449f1ea033bcf78af3754e39eee360c66dca163a55a5"} Sep 07 20:58:43.993376 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:43.993297 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.1292680170000002 podStartE2EDuration="5.993280362s" totalImagesPullingTime="2.848006397s" totalInitContainerRuntime="16.005948ms" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:43.991652908 +0000 UTC m=+90.280022170" watchObservedRunningTime="2026-09-07 20:58:43.993280362 +0000 UTC m=+90.281649641" Sep 07 20:58:44.010027 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.009972 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" podStartSLOduration=1.7047691729999999 podStartE2EDuration="3.009955032s" totalImagesPullingTime="1.305185859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:44.009490312 +0000 UTC m=+90.297859592" watchObservedRunningTime="2026-09-07 20:58:44.009955032 +0000 UTC m=+90.298324369" Sep 07 20:58:44.363258 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.363217 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b68d6c87c-t99kr"] Sep 07 20:58:44.367152 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.367124 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.369658 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.369629 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 07 20:58:44.369825 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.369629 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2l2zf\"" Sep 07 20:58:44.369825 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.369743 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 07 20:58:44.369825 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.369756 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 07 20:58:44.370052 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.370033 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 07 20:58:44.370154 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.370132 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 07 20:58:44.370640 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.370619 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 07 20:58:44.370721 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.370647 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 07 20:58:44.378885 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.378853 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b68d6c87c-t99kr"] Sep 07 20:58:44.412879 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.412828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-console-config\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.413070 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.412887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-service-ca\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.413070 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.412933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-oauth-serving-cert\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.413070 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.412969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-oauth-config\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.413070 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.413009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-serving-cert\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.413070 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.413057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgzg\" (UniqueName: \"kubernetes.io/projected/9e507026-ebd3-4c77-9f13-b77e75be7535-kube-api-access-lpgzg\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.514451 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.514405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgzg\" (UniqueName: \"kubernetes.io/projected/9e507026-ebd3-4c77-9f13-b77e75be7535-kube-api-access-lpgzg\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.514622 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.514496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-console-config\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.514622 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.514531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-service-ca\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.514622 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.514557 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-oauth-serving-cert\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.514622 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.514594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-oauth-config\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.514833 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.514791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-serving-cert\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.515375 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.515345 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-service-ca\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.515485 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.515354 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-oauth-serving-cert\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.515485 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.515355 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-console-config\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.516986 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.516967 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-oauth-config\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.517241 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.517219 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-serving-cert\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.528139 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.528100 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgzg\" (UniqueName: \"kubernetes.io/projected/9e507026-ebd3-4c77-9f13-b77e75be7535-kube-api-access-lpgzg\") pod \"console-6b68d6c87c-t99kr\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.686671 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.686569 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:44.968084 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:44.967917 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b68d6c87c-t99kr"] Sep 07 20:58:44.970782 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:58:44.970751 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e507026_ebd3_4c77_9f13_b77e75be7535.slice/crio-7c98f4f03870c7f23b3f047957294cce872509c4a62d2e235ef711cf8cc6c568 WatchSource:0}: Error finding container 7c98f4f03870c7f23b3f047957294cce872509c4a62d2e235ef711cf8cc6c568: Status 404 returned error can't find the container with id 7c98f4f03870c7f23b3f047957294cce872509c4a62d2e235ef711cf8cc6c568 Sep 07 20:58:45.981801 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:45.981761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b68d6c87c-t99kr" event={"ID":"9e507026-ebd3-4c77-9f13-b77e75be7535","Type":"ContainerStarted","Data":"7c98f4f03870c7f23b3f047957294cce872509c4a62d2e235ef711cf8cc6c568"} Sep 07 20:58:47.883397 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:47.883293 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-886bb9cd9-8g86m" Sep 07 20:58:47.997389 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:47.997348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b68d6c87c-t99kr" event={"ID":"9e507026-ebd3-4c77-9f13-b77e75be7535","Type":"ContainerStarted","Data":"a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781"} Sep 07 20:58:48.014416 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:48.014363 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b68d6c87c-t99kr" podStartSLOduration=1.359679061 podStartE2EDuration="4.014347226s" totalImagesPullingTime="2.654668165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:48.014329059 +0000 UTC m=+94.302698338" watchObservedRunningTime="2026-09-07 20:58:48.014347226 +0000 UTC m=+94.302716506" Sep 07 20:58:48.875735 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:48.875689 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" podUID="82e0a9d0-22fd-40e4-a6ee-2101b8faed43" containerName="registry" containerID="cri-o://f303fee38e3283d6ea416baf06066c657d747737a8ddf22f23366bd1a37d512f" gracePeriod=30 Sep 07 20:58:49.006771 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.006731 2578 generic.go:356] "Generic (PLEG): container finished" podID="82e0a9d0-22fd-40e4-a6ee-2101b8faed43" containerID="f303fee38e3283d6ea416baf06066c657d747737a8ddf22f23366bd1a37d512f" exitCode=0 Sep 07 20:58:49.007164 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.006806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" event={"ID":"82e0a9d0-22fd-40e4-a6ee-2101b8faed43","Type":"ContainerDied","Data":"f303fee38e3283d6ea416baf06066c657d747737a8ddf22f23366bd1a37d512f"} Sep 07 20:58:49.117664 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.117635 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:58:49.155541 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.155459 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-certificates\") pod \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " Sep 07 20:58:49.155541 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.155496 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-ca-trust-extracted\") pod \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " Sep 07 20:58:49.155787 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.155541 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") pod \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " Sep 07 20:58:49.155787 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.155691 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-trusted-ca\") pod \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " Sep 07 20:58:49.155787 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.155731 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-image-registry-private-configuration\") pod \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " Sep 07 20:58:49.155787 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.155759 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-bound-sa-token\") pod \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " Sep 07 20:58:49.155969 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.155846 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-installation-pull-secrets\") pod \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " Sep 07 20:58:49.155969 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.155875 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89rgt\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-kube-api-access-89rgt\") pod \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\" (UID: \"82e0a9d0-22fd-40e4-a6ee-2101b8faed43\") " Sep 07 20:58:49.155969 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.155932 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "82e0a9d0-22fd-40e4-a6ee-2101b8faed43" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 20:58:49.156175 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.156155 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-certificates\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:58:49.156248 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.156175 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "82e0a9d0-22fd-40e4-a6ee-2101b8faed43" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 20:58:49.158812 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.158782 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "82e0a9d0-22fd-40e4-a6ee-2101b8faed43" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 20:58:49.158949 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.158864 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "82e0a9d0-22fd-40e4-a6ee-2101b8faed43" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 20:58:49.158949 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.158897 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "82e0a9d0-22fd-40e4-a6ee-2101b8faed43" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:58:49.159047 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.159032 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "82e0a9d0-22fd-40e4-a6ee-2101b8faed43" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:58:49.159085 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.159077 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-kube-api-access-89rgt" (OuterVolumeSpecName: "kube-api-access-89rgt") pod "82e0a9d0-22fd-40e4-a6ee-2101b8faed43" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43"). InnerVolumeSpecName "kube-api-access-89rgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 20:58:49.166621 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.166589 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "82e0a9d0-22fd-40e4-a6ee-2101b8faed43" (UID: "82e0a9d0-22fd-40e4-a6ee-2101b8faed43"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 20:58:49.256875 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.256832 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-registry-tls\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:58:49.256875 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.256866 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-trusted-ca\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:58:49.256875 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.256876 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-image-registry-private-configuration\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:58:49.256875 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.256886 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-bound-sa-token\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:58:49.257174 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.256900 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-installation-pull-secrets\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:58:49.257174 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.256909 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89rgt\" (UniqueName: \"kubernetes.io/projected/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-kube-api-access-89rgt\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:58:49.257174 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:49.256918 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82e0a9d0-22fd-40e4-a6ee-2101b8faed43-ca-trust-extracted\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:58:50.012394 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:50.012362 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" event={"ID":"82e0a9d0-22fd-40e4-a6ee-2101b8faed43","Type":"ContainerDied","Data":"bdd4c9514aeae6ec992c9238e762b2000a4d6625190ee7af63a51c32a98c226a"} Sep 07 20:58:50.012841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:50.012420 2578 scope.go:117] "RemoveContainer" containerID="f303fee38e3283d6ea416baf06066c657d747737a8ddf22f23366bd1a37d512f" Sep 07 20:58:50.012841 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:50.012371 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bb47f9cb8-mxrx7" Sep 07 20:58:50.037095 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:50.037057 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bb47f9cb8-mxrx7"] Sep 07 20:58:50.041652 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:50.041619 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bb47f9cb8-mxrx7"] Sep 07 20:58:50.318777 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:50.318697 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82e0a9d0-22fd-40e4-a6ee-2101b8faed43" path="/var/lib/kubelet/pods/82e0a9d0-22fd-40e4-a6ee-2101b8faed43/volumes" Sep 07 20:58:50.824855 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:50.824825 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lvmpk" Sep 07 20:58:54.687296 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:54.687258 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:54.687688 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:54.687337 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:54.692666 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:54.692641 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:55.039050 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:55.039019 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:58:56.940518 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:58:56.940483 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b68d6c87c-t99kr"] Sep 07 20:59:01.979828 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:01.979785 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:59:01.980407 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:01.979868 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:59:08.086735 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:08.086694 2578 generic.go:356] "Generic (PLEG): container finished" podID="92b58442-c40e-4135-8ac0-7b9cfaa800b0" containerID="d7929fbf1ebb73771319fc2a246f38977b9b960e4b6de525154dd7c5bafe09ee" exitCode=0 Sep 07 20:59:08.087193 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:08.086768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" event={"ID":"92b58442-c40e-4135-8ac0-7b9cfaa800b0","Type":"ContainerDied","Data":"d7929fbf1ebb73771319fc2a246f38977b9b960e4b6de525154dd7c5bafe09ee"} Sep 07 20:59:08.087305 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:08.087281 2578 scope.go:117] "RemoveContainer" containerID="d7929fbf1ebb73771319fc2a246f38977b9b960e4b6de525154dd7c5bafe09ee" Sep 07 20:59:08.088515 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:08.088486 2578 generic.go:356] "Generic (PLEG): container finished" podID="b521a461-7fd0-4880-b21d-7895fdbfb842" containerID="379cb0f09259e0cf45e5bcfef424f2fe62ef52273da24e3553f39fb0cddc3543" exitCode=0 Sep 07 20:59:08.088620 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:08.088556 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" event={"ID":"b521a461-7fd0-4880-b21d-7895fdbfb842","Type":"ContainerDied","Data":"379cb0f09259e0cf45e5bcfef424f2fe62ef52273da24e3553f39fb0cddc3543"} Sep 07 20:59:08.088900 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:08.088884 2578 scope.go:117] "RemoveContainer" containerID="379cb0f09259e0cf45e5bcfef424f2fe62ef52273da24e3553f39fb0cddc3543" Sep 07 20:59:09.095137 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:09.095100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-dkmlh" event={"ID":"92b58442-c40e-4135-8ac0-7b9cfaa800b0","Type":"ContainerStarted","Data":"f8999c1dcbf1a25429e675253a852a22be734d57fe68e882ca905f50f2c31b5c"} Sep 07 20:59:09.096983 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:09.096952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zzspm" event={"ID":"b521a461-7fd0-4880-b21d-7895fdbfb842","Type":"ContainerStarted","Data":"946ece8153f2ac26b37bfac8bbe356cb3cd8cebbb5b22eedaff1015d80b25ce7"} Sep 07 20:59:21.988834 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:21.988796 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:59:21.993142 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:21.993111 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c7dd5847b-xqp5z" Sep 07 20:59:22.063207 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.063157 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b68d6c87c-t99kr" podUID="9e507026-ebd3-4c77-9f13-b77e75be7535" containerName="console" containerID="cri-o://a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781" gracePeriod=15 Sep 07 20:59:22.349145 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.349119 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:59:22.465089 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.465053 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-serving-cert\") pod \"9e507026-ebd3-4c77-9f13-b77e75be7535\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " Sep 07 20:59:22.465275 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.465144 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-oauth-config\") pod \"9e507026-ebd3-4c77-9f13-b77e75be7535\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " Sep 07 20:59:22.465275 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.465168 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-oauth-serving-cert\") pod \"9e507026-ebd3-4c77-9f13-b77e75be7535\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " Sep 07 20:59:22.465275 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.465209 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-service-ca\") pod \"9e507026-ebd3-4c77-9f13-b77e75be7535\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " Sep 07 20:59:22.465275 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.465245 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-console-config\") pod \"9e507026-ebd3-4c77-9f13-b77e75be7535\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " Sep 07 20:59:22.465516 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.465278 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpgzg\" (UniqueName: \"kubernetes.io/projected/9e507026-ebd3-4c77-9f13-b77e75be7535-kube-api-access-lpgzg\") pod \"9e507026-ebd3-4c77-9f13-b77e75be7535\" (UID: \"9e507026-ebd3-4c77-9f13-b77e75be7535\") " Sep 07 20:59:22.465587 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.465564 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e507026-ebd3-4c77-9f13-b77e75be7535" (UID: "9e507026-ebd3-4c77-9f13-b77e75be7535"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 20:59:22.465746 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.465715 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e507026-ebd3-4c77-9f13-b77e75be7535" (UID: "9e507026-ebd3-4c77-9f13-b77e75be7535"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 20:59:22.465869 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.465812 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-console-config" (OuterVolumeSpecName: "console-config") pod "9e507026-ebd3-4c77-9f13-b77e75be7535" (UID: "9e507026-ebd3-4c77-9f13-b77e75be7535"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 20:59:22.467589 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.467563 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e507026-ebd3-4c77-9f13-b77e75be7535" (UID: "9e507026-ebd3-4c77-9f13-b77e75be7535"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:59:22.467703 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.467603 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e507026-ebd3-4c77-9f13-b77e75be7535-kube-api-access-lpgzg" (OuterVolumeSpecName: "kube-api-access-lpgzg") pod "9e507026-ebd3-4c77-9f13-b77e75be7535" (UID: "9e507026-ebd3-4c77-9f13-b77e75be7535"). InnerVolumeSpecName "kube-api-access-lpgzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 20:59:22.467774 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.467709 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e507026-ebd3-4c77-9f13-b77e75be7535" (UID: "9e507026-ebd3-4c77-9f13-b77e75be7535"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:59:22.566481 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.566382 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-serving-cert\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:22.566481 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.566415 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e507026-ebd3-4c77-9f13-b77e75be7535-console-oauth-config\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:22.566481 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.566426 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-oauth-serving-cert\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:22.566481 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.566435 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-service-ca\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:22.566481 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.566444 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e507026-ebd3-4c77-9f13-b77e75be7535-console-config\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:22.566481 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:22.566453 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpgzg\" (UniqueName: \"kubernetes.io/projected/9e507026-ebd3-4c77-9f13-b77e75be7535-kube-api-access-lpgzg\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:23.159180 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:23.159146 2578 generic.go:356] "Generic (PLEG): container finished" podID="9e507026-ebd3-4c77-9f13-b77e75be7535" containerID="a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781" exitCode=0 Sep 07 20:59:23.159616 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:23.159193 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b68d6c87c-t99kr" Sep 07 20:59:23.159616 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:23.159239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b68d6c87c-t99kr" event={"ID":"9e507026-ebd3-4c77-9f13-b77e75be7535","Type":"ContainerDied","Data":"a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781"} Sep 07 20:59:23.159616 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:23.159292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b68d6c87c-t99kr" event={"ID":"9e507026-ebd3-4c77-9f13-b77e75be7535","Type":"ContainerDied","Data":"7c98f4f03870c7f23b3f047957294cce872509c4a62d2e235ef711cf8cc6c568"} Sep 07 20:59:23.159616 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:23.159328 2578 scope.go:117] "RemoveContainer" containerID="a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781" Sep 07 20:59:23.167953 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:23.167932 2578 scope.go:117] "RemoveContainer" containerID="a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781" Sep 07 20:59:23.168273 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:59:23.168251 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781\": container with ID starting with a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781 not found: ID does not exist" containerID="a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781" Sep 07 20:59:23.168377 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:23.168281 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781"} err="failed to get container status \"a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781\": rpc error: code = NotFound desc = could not find container \"a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781\": container with ID starting with a6ed4f61aaa441e2d6bda450d8dfa52be35b149a26e44e5e21b9aceafb20f781 not found: ID does not exist" Sep 07 20:59:23.181780 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:23.181747 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b68d6c87c-t99kr"] Sep 07 20:59:23.184929 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:23.184901 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b68d6c87c-t99kr"] Sep 07 20:59:24.317933 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:24.317898 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e507026-ebd3-4c77-9f13-b77e75be7535" path="/var/lib/kubelet/pods/9e507026-ebd3-4c77-9f13-b77e75be7535/volumes" Sep 07 20:59:28.180669 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:28.180634 2578 generic.go:356] "Generic (PLEG): container finished" podID="02a152af-b7b3-4657-b287-9bce30e6bf8d" containerID="100ca9f1bb1639c36afa5a0bdf1989f1f3f16b791f52be1982fa08edd6008047" exitCode=0 Sep 07 20:59:28.181107 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:28.180718 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" event={"ID":"02a152af-b7b3-4657-b287-9bce30e6bf8d","Type":"ContainerDied","Data":"100ca9f1bb1639c36afa5a0bdf1989f1f3f16b791f52be1982fa08edd6008047"} Sep 07 20:59:28.181107 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:28.181046 2578 scope.go:117] "RemoveContainer" containerID="100ca9f1bb1639c36afa5a0bdf1989f1f3f16b791f52be1982fa08edd6008047" Sep 07 20:59:29.186598 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:29.186564 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-f5xkt" event={"ID":"02a152af-b7b3-4657-b287-9bce30e6bf8d","Type":"ContainerStarted","Data":"497cd3c488352a2c54eec1e1fbcbcfbd3b3310f0baf05389de5160bd279bb12f"} Sep 07 20:59:57.598412 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:57.598370 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 20:59:57.598914 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:57.598657 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="alertmanager" containerID="cri-o://6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620" gracePeriod=120 Sep 07 20:59:57.598914 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:57.598723 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy-metric" containerID="cri-o://d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0" gracePeriod=120 Sep 07 20:59:57.598914 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:57.598757 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="prom-label-proxy" containerID="cri-o://4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a" gracePeriod=120 Sep 07 20:59:57.598914 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:57.598777 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="config-reloader" containerID="cri-o://1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be" gracePeriod=120 Sep 07 20:59:57.598914 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:57.598765 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy-web" containerID="cri-o://37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15" gracePeriod=120 Sep 07 20:59:57.598914 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:57.598827 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy" containerID="cri-o://363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5" gracePeriod=120 Sep 07 20:59:58.318435 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.318260 2578 generic.go:356] "Generic (PLEG): container finished" podID="866b7305-bc25-4b93-948f-10b816d92b57" containerID="4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a" exitCode=0 Sep 07 20:59:58.318435 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.318302 2578 generic.go:356] "Generic (PLEG): container finished" podID="866b7305-bc25-4b93-948f-10b816d92b57" containerID="363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5" exitCode=0 Sep 07 20:59:58.318435 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.318361 2578 generic.go:356] "Generic (PLEG): container finished" podID="866b7305-bc25-4b93-948f-10b816d92b57" containerID="1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be" exitCode=0 Sep 07 20:59:58.318435 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.318371 2578 generic.go:356] "Generic (PLEG): container finished" podID="866b7305-bc25-4b93-948f-10b816d92b57" containerID="6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620" exitCode=0 Sep 07 20:59:58.322769 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.319153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerDied","Data":"4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a"} Sep 07 20:59:58.322769 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.319263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerDied","Data":"363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5"} Sep 07 20:59:58.322769 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.319352 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerDied","Data":"1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be"} Sep 07 20:59:58.322769 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.319405 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerDied","Data":"6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620"} Sep 07 20:59:58.850563 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.850536 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:58.974648 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.974548 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-config-volume\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.974648 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.974596 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-cluster-tls-config\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.974648 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.974628 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-metrics-client-ca\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.974916 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.974664 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.974916 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.974691 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-main-tls\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.974916 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.974724 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-web\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.974916 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.974756 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-tls-assets\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.974916 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.974811 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-metric\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.975169 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.975106 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-trusted-ca-bundle\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.975169 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.975149 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-config-out\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.975169 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.975153 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 20:59:58.975357 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.975204 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn42j\" (UniqueName: \"kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-kube-api-access-sn42j\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.975357 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.975243 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-main-db\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.975357 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.975270 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-web-config\") pod \"866b7305-bc25-4b93-948f-10b816d92b57\" (UID: \"866b7305-bc25-4b93-948f-10b816d92b57\") " Sep 07 20:59:58.975608 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.975585 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-metrics-client-ca\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:58.976429 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.976261 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 20:59:58.976429 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.976381 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 20:59:58.977924 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.977889 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:59:58.978571 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.978428 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-config-volume" (OuterVolumeSpecName: "config-volume") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:59:58.978571 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.978537 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 20:59:58.978753 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.978605 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:59:58.978954 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.978914 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:59:58.979349 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.979305 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:59:58.979349 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.979330 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-config-out" (OuterVolumeSpecName: "config-out") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 20:59:58.979518 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.979359 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-kube-api-access-sn42j" (OuterVolumeSpecName: "kube-api-access-sn42j") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "kube-api-access-sn42j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 20:59:58.982076 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.982055 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:59:58.988889 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:58.988862 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-web-config" (OuterVolumeSpecName: "web-config") pod "866b7305-bc25-4b93-948f-10b816d92b57" (UID: "866b7305-bc25-4b93-948f-10b816d92b57"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 20:59:59.076712 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076671 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-config-volume\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076712 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076706 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-cluster-tls-config\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076712 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076718 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076729 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-main-tls\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076739 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076747 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-tls-assets\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076756 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076764 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076772 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-config-out\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076780 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn42j\" (UniqueName: \"kubernetes.io/projected/866b7305-bc25-4b93-948f-10b816d92b57-kube-api-access-sn42j\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076788 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/866b7305-bc25-4b93-948f-10b816d92b57-alertmanager-main-db\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.076930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.076817 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/866b7305-bc25-4b93-948f-10b816d92b57-web-config\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 20:59:59.325977 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.325940 2578 generic.go:356] "Generic (PLEG): container finished" podID="866b7305-bc25-4b93-948f-10b816d92b57" containerID="d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0" exitCode=0 Sep 07 20:59:59.325977 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.325968 2578 generic.go:356] "Generic (PLEG): container finished" podID="866b7305-bc25-4b93-948f-10b816d92b57" containerID="37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15" exitCode=0 Sep 07 20:59:59.326215 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.325996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerDied","Data":"d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0"} Sep 07 20:59:59.326215 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.326020 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.326215 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.326054 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerDied","Data":"37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15"} Sep 07 20:59:59.326215 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.326082 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"866b7305-bc25-4b93-948f-10b816d92b57","Type":"ContainerDied","Data":"03b56056b2605e63502e006c2103b52f3f91b0d56ad544391696d6631b79b072"} Sep 07 20:59:59.326215 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.326113 2578 scope.go:117] "RemoveContainer" containerID="4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a" Sep 07 20:59:59.334077 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.334058 2578 scope.go:117] "RemoveContainer" containerID="d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0" Sep 07 20:59:59.341930 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.341907 2578 scope.go:117] "RemoveContainer" containerID="363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5" Sep 07 20:59:59.349065 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.349041 2578 scope.go:117] "RemoveContainer" containerID="37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15" Sep 07 20:59:59.353195 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.353159 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 20:59:59.359475 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.359448 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 20:59:59.359603 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.359589 2578 scope.go:117] "RemoveContainer" containerID="1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be" Sep 07 20:59:59.380588 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.380566 2578 scope.go:117] "RemoveContainer" containerID="6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620" Sep 07 20:59:59.387740 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.387713 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 20:59:59.387998 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.387983 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy-web" Sep 07 20:59:59.387998 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.387997 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy-web" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388008 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e507026-ebd3-4c77-9f13-b77e75be7535" containerName="console" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388014 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e507026-ebd3-4c77-9f13-b77e75be7535" containerName="console" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388024 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="config-reloader" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388029 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="config-reloader" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388038 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="alertmanager" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388043 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="alertmanager" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388052 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82e0a9d0-22fd-40e4-a6ee-2101b8faed43" containerName="registry" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388057 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="82e0a9d0-22fd-40e4-a6ee-2101b8faed43" containerName="registry" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388064 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy-metric" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388069 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy-metric" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388074 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="prom-label-proxy" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388080 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="prom-label-proxy" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388086 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="init-config-reloader" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388091 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="init-config-reloader" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388099 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy" Sep 07 20:59:59.388138 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388104 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy" Sep 07 20:59:59.389061 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388150 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy-web" Sep 07 20:59:59.389061 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388158 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy" Sep 07 20:59:59.389061 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388166 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="kube-rbac-proxy-metric" Sep 07 20:59:59.389061 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388171 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e507026-ebd3-4c77-9f13-b77e75be7535" containerName="console" Sep 07 20:59:59.389061 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388177 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="config-reloader" Sep 07 20:59:59.389061 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388183 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="82e0a9d0-22fd-40e4-a6ee-2101b8faed43" containerName="registry" Sep 07 20:59:59.389061 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388188 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="prom-label-proxy" Sep 07 20:59:59.389061 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.388193 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="866b7305-bc25-4b93-948f-10b816d92b57" containerName="alertmanager" Sep 07 20:59:59.389421 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.389340 2578 scope.go:117] "RemoveContainer" containerID="1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df" Sep 07 20:59:59.393422 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.393401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.396100 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.396077 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 20:59:59.396224 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.396203 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 20:59:59.396285 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.396235 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 20:59:59.396285 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.396212 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 20:59:59.396663 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.396646 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 20:59:59.396730 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.396714 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 20:59:59.396836 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.396820 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-95q87\"" Sep 07 20:59:59.396888 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.396849 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 20:59:59.396936 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.396850 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 20:59:59.398428 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.398407 2578 scope.go:117] "RemoveContainer" containerID="4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a" Sep 07 20:59:59.398797 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:59:59.398771 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a\": container with ID starting with 4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a not found: ID does not exist" containerID="4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a" Sep 07 20:59:59.398886 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.398804 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a"} err="failed to get container status \"4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a\": rpc error: code = NotFound desc = could not find container \"4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a\": container with ID starting with 4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a not found: ID does not exist" Sep 07 20:59:59.398886 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.398823 2578 scope.go:117] "RemoveContainer" containerID="d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0" Sep 07 20:59:59.399201 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:59:59.399180 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0\": container with ID starting with d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0 not found: ID does not exist" containerID="d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0" Sep 07 20:59:59.399268 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.399209 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0"} err="failed to get container status \"d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0\": rpc error: code = NotFound desc = could not find container \"d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0\": container with ID starting with d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0 not found: ID does not exist" Sep 07 20:59:59.399268 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.399225 2578 scope.go:117] "RemoveContainer" containerID="363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5" Sep 07 20:59:59.399616 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:59:59.399591 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5\": container with ID starting with 363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5 not found: ID does not exist" containerID="363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5" Sep 07 20:59:59.399714 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.399620 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5"} err="failed to get container status \"363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5\": rpc error: code = NotFound desc = could not find container \"363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5\": container with ID starting with 363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5 not found: ID does not exist" Sep 07 20:59:59.399714 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.399654 2578 scope.go:117] "RemoveContainer" containerID="37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15" Sep 07 20:59:59.400082 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:59:59.400056 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15\": container with ID starting with 37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15 not found: ID does not exist" containerID="37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15" Sep 07 20:59:59.400177 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.400088 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15"} err="failed to get container status \"37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15\": rpc error: code = NotFound desc = could not find container \"37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15\": container with ID starting with 37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15 not found: ID does not exist" Sep 07 20:59:59.400177 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.400106 2578 scope.go:117] "RemoveContainer" containerID="1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be" Sep 07 20:59:59.400444 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:59:59.400424 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be\": container with ID starting with 1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be not found: ID does not exist" containerID="1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be" Sep 07 20:59:59.400526 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.400449 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be"} err="failed to get container status \"1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be\": rpc error: code = NotFound desc = could not find container \"1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be\": container with ID starting with 1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be not found: ID does not exist" Sep 07 20:59:59.400526 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.400473 2578 scope.go:117] "RemoveContainer" containerID="6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620" Sep 07 20:59:59.400842 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:59:59.400818 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620\": container with ID starting with 6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620 not found: ID does not exist" containerID="6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620" Sep 07 20:59:59.400955 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.400854 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620"} err="failed to get container status \"6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620\": rpc error: code = NotFound desc = could not find container \"6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620\": container with ID starting with 6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620 not found: ID does not exist" Sep 07 20:59:59.400955 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.400880 2578 scope.go:117] "RemoveContainer" containerID="1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df" Sep 07 20:59:59.401450 ip-10-0-140-24 kubenswrapper[2578]: E0907 20:59:59.401324 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df\": container with ID starting with 1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df not found: ID does not exist" containerID="1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df" Sep 07 20:59:59.401450 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.401358 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df"} err="failed to get container status \"1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df\": rpc error: code = NotFound desc = could not find container \"1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df\": container with ID starting with 1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df not found: ID does not exist" Sep 07 20:59:59.401450 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.401388 2578 scope.go:117] "RemoveContainer" containerID="4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a" Sep 07 20:59:59.401792 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.401769 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a"} err="failed to get container status \"4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a\": rpc error: code = NotFound desc = could not find container \"4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a\": container with ID starting with 4c180f406b9a35f797463f5f2365ad42166e1d8f369cbd3dec43de311868bf5a not found: ID does not exist" Sep 07 20:59:59.401900 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.401794 2578 scope.go:117] "RemoveContainer" containerID="d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0" Sep 07 20:59:59.402157 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.402136 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0"} err="failed to get container status \"d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0\": rpc error: code = NotFound desc = could not find container \"d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0\": container with ID starting with d3dc3a2514da725b042fcc9f587e4ec421ac6b85632b3d867ac8ca200623f1d0 not found: ID does not exist" Sep 07 20:59:59.402241 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.402157 2578 scope.go:117] "RemoveContainer" containerID="363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5" Sep 07 20:59:59.402454 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.402430 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5"} err="failed to get container status \"363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5\": rpc error: code = NotFound desc = could not find container \"363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5\": container with ID starting with 363cdd582a29563ac900892ac6bf1db2ea209981ebbcaf0cbf28e0600d8941f5 not found: ID does not exist" Sep 07 20:59:59.402515 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.402457 2578 scope.go:117] "RemoveContainer" containerID="37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15" Sep 07 20:59:59.402790 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.402771 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15"} err="failed to get container status \"37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15\": rpc error: code = NotFound desc = could not find container \"37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15\": container with ID starting with 37f323f74bf313bdf29f9d064702d4536ebc3a7c973f123bcf8c402f2b46ff15 not found: ID does not exist" Sep 07 20:59:59.402951 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.402791 2578 scope.go:117] "RemoveContainer" containerID="1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be" Sep 07 20:59:59.403106 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.403077 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be"} err="failed to get container status \"1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be\": rpc error: code = NotFound desc = could not find container \"1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be\": container with ID starting with 1012fb5d506a0ecf8b06251e74e2e9c2a77f990db6e79e6fbe764e2e91e511be not found: ID does not exist" Sep 07 20:59:59.403106 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.403105 2578 scope.go:117] "RemoveContainer" containerID="6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620" Sep 07 20:59:59.403529 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.403508 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 20:59:59.403624 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.403576 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620"} err="failed to get container status \"6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620\": rpc error: code = NotFound desc = could not find container \"6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620\": container with ID starting with 6a2f6d5822c7a0702ad59798894b0454020f38e54481c812b788b4e9b5792620 not found: ID does not exist" Sep 07 20:59:59.403624 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.403597 2578 scope.go:117] "RemoveContainer" containerID="1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df" Sep 07 20:59:59.403969 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.403921 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df"} err="failed to get container status \"1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df\": rpc error: code = NotFound desc = could not find container \"1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df\": container with ID starting with 1cde3bbd32fc8c9235a855458047c8571efa4a3690f081ccf21c689480b518df not found: ID does not exist" Sep 07 20:59:59.405436 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.405414 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 20:59:59.480391 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480391 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480620 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f86be6e-6786-4d58-8276-85ca7f0c0951-config-out\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480620 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47rb6\" (UniqueName: \"kubernetes.io/projected/8f86be6e-6786-4d58-8276-85ca7f0c0951-kube-api-access-47rb6\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480620 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-web-config\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480620 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f86be6e-6786-4d58-8276-85ca7f0c0951-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480620 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480620 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f86be6e-6786-4d58-8276-85ca7f0c0951-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480821 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480630 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f86be6e-6786-4d58-8276-85ca7f0c0951-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480821 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480821 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f86be6e-6786-4d58-8276-85ca7f0c0951-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480821 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.480821 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.480763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581233 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47rb6\" (UniqueName: \"kubernetes.io/projected/8f86be6e-6786-4d58-8276-85ca7f0c0951-kube-api-access-47rb6\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581233 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-web-config\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581462 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f86be6e-6786-4d58-8276-85ca7f0c0951-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581462 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581462 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f86be6e-6786-4d58-8276-85ca7f0c0951-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581462 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f86be6e-6786-4d58-8276-85ca7f0c0951-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581462 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581725 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f86be6e-6786-4d58-8276-85ca7f0c0951-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581725 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581725 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581725 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581725 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.581725 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f86be6e-6786-4d58-8276-85ca7f0c0951-config-out\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.582016 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.581805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f86be6e-6786-4d58-8276-85ca7f0c0951-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.582652 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.582552 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f86be6e-6786-4d58-8276-85ca7f0c0951-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.582904 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.582867 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f86be6e-6786-4d58-8276-85ca7f0c0951-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.584709 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.584679 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f86be6e-6786-4d58-8276-85ca7f0c0951-config-out\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.584836 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.584726 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.584836 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.584745 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.584836 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.584794 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.584836 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.584821 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f86be6e-6786-4d58-8276-85ca7f0c0951-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.585053 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.584995 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-web-config\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.585638 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.585613 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.585832 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.585812 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.586081 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.586065 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f86be6e-6786-4d58-8276-85ca7f0c0951-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.590410 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.590384 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47rb6\" (UniqueName: \"kubernetes.io/projected/8f86be6e-6786-4d58-8276-85ca7f0c0951-kube-api-access-47rb6\") pod \"alertmanager-main-0\" (UID: \"8f86be6e-6786-4d58-8276-85ca7f0c0951\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.704939 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.704898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 20:59:59.988520 ip-10-0-140-24 kubenswrapper[2578]: I0907 20:59:59.988483 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 20:59:59.992384 ip-10-0-140-24 kubenswrapper[2578]: W0907 20:59:59.992355 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f86be6e_6786_4d58_8276_85ca7f0c0951.slice/crio-0c589e315e3af516aa6e1ec59927cfad739781db0eabedee1e8c4dc03de9f373 WatchSource:0}: Error finding container 0c589e315e3af516aa6e1ec59927cfad739781db0eabedee1e8c4dc03de9f373: Status 404 returned error can't find the container with id 0c589e315e3af516aa6e1ec59927cfad739781db0eabedee1e8c4dc03de9f373 Sep 07 21:00:00.317560 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:00.317475 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="866b7305-bc25-4b93-948f-10b816d92b57" path="/var/lib/kubelet/pods/866b7305-bc25-4b93-948f-10b816d92b57/volumes" Sep 07 21:00:00.331256 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:00.331226 2578 generic.go:356] "Generic (PLEG): container finished" podID="8f86be6e-6786-4d58-8276-85ca7f0c0951" containerID="2fc7edae9d5660f5280a8f6888556d436f4e4fc08ddbe1f6e47da7b5b3852cb1" exitCode=0 Sep 07 21:00:00.331426 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:00.331334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f86be6e-6786-4d58-8276-85ca7f0c0951","Type":"ContainerDied","Data":"2fc7edae9d5660f5280a8f6888556d436f4e4fc08ddbe1f6e47da7b5b3852cb1"} Sep 07 21:00:00.331426 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:00.331417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f86be6e-6786-4d58-8276-85ca7f0c0951","Type":"ContainerStarted","Data":"0c589e315e3af516aa6e1ec59927cfad739781db0eabedee1e8c4dc03de9f373"} Sep 07 21:00:01.339737 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.339690 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f86be6e-6786-4d58-8276-85ca7f0c0951","Type":"ContainerStarted","Data":"31e4d2a831579039c312134a3355ccfb371eb0597a284f7f4d90e6a5d2d164c4"} Sep 07 21:00:01.340181 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.339782 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f86be6e-6786-4d58-8276-85ca7f0c0951","Type":"ContainerStarted","Data":"e6fc6a4bf0553e1565c9038934991f3915752d880d327444c3bdfb4dcb75d8f3"} Sep 07 21:00:01.340181 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.339825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f86be6e-6786-4d58-8276-85ca7f0c0951","Type":"ContainerStarted","Data":"5cbc23ea0584d4dcffb2b46732c394e61222cdd7c66568d5060cfc9d0fbcbb04"} Sep 07 21:00:01.340181 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.339860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f86be6e-6786-4d58-8276-85ca7f0c0951","Type":"ContainerStarted","Data":"7f7ffe6407a27a75f329590d447d0a19ef0ab5e4afb5a9da0716c131606100c0"} Sep 07 21:00:01.340181 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.339896 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f86be6e-6786-4d58-8276-85ca7f0c0951","Type":"ContainerStarted","Data":"f47f33c982367ff41013cff95e30400136edb2b76761857041e7813012c97d27"} Sep 07 21:00:01.340181 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.339932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f86be6e-6786-4d58-8276-85ca7f0c0951","Type":"ContainerStarted","Data":"d4c98c7c5c1e0b53a7638c19fce95d94136d778752c8323242139a2da8fef579"} Sep 07 21:00:01.368232 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.368173 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.349918922 podStartE2EDuration="2.368153572s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.23465ms" isStatefulPod=false podCreationTimestamp="2026-09-07 20:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:00:01.365911121 +0000 UTC m=+167.654280410" watchObservedRunningTime="2026-09-07 21:00:01.368153572 +0000 UTC m=+167.656522852" Sep 07 21:00:01.654407 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.654302 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-867f8f95dc-p44xc"] Sep 07 21:00:01.657500 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.657483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.659903 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.659881 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 07 21:00:01.660035 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.660015 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 07 21:00:01.660210 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.660191 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 07 21:00:01.660258 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.660231 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 07 21:00:01.660464 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.660435 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 07 21:00:01.660538 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.660518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-llvk9\"" Sep 07 21:00:01.664765 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.664739 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 07 21:00:01.675299 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.675262 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-867f8f95dc-p44xc"] Sep 07 21:00:01.803009 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.802965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-telemeter-client-tls\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.803172 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.803022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-federate-client-tls\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.803172 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.803075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/926d68a2-a440-4104-af72-16bc21378a5f-metrics-client-ca\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.803172 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.803096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-secret-telemeter-client\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.803172 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.803136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td99x\" (UniqueName: \"kubernetes.io/projected/926d68a2-a440-4104-af72-16bc21378a5f-kube-api-access-td99x\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.803340 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.803227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/926d68a2-a440-4104-af72-16bc21378a5f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.803340 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.803285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.803407 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.803371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/926d68a2-a440-4104-af72-16bc21378a5f-serving-certs-ca-bundle\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.904036 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.903992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/926d68a2-a440-4104-af72-16bc21378a5f-serving-certs-ca-bundle\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.904036 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.904040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-telemeter-client-tls\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.904292 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.904064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-federate-client-tls\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.904292 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.904084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/926d68a2-a440-4104-af72-16bc21378a5f-metrics-client-ca\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.904292 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.904102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-secret-telemeter-client\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.904292 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.904221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td99x\" (UniqueName: \"kubernetes.io/projected/926d68a2-a440-4104-af72-16bc21378a5f-kube-api-access-td99x\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.904292 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.904282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/926d68a2-a440-4104-af72-16bc21378a5f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.904597 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.904372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.904975 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.904946 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/926d68a2-a440-4104-af72-16bc21378a5f-metrics-client-ca\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.905115 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.905000 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/926d68a2-a440-4104-af72-16bc21378a5f-serving-certs-ca-bundle\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.905299 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.905277 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/926d68a2-a440-4104-af72-16bc21378a5f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.906780 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.906759 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-secret-telemeter-client\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.906903 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.906864 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-federate-client-tls\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.907071 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.907050 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-telemeter-client-tls\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.907170 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.907150 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/926d68a2-a440-4104-af72-16bc21378a5f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.916401 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.916367 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td99x\" (UniqueName: \"kubernetes.io/projected/926d68a2-a440-4104-af72-16bc21378a5f-kube-api-access-td99x\") pod \"telemeter-client-867f8f95dc-p44xc\" (UID: \"926d68a2-a440-4104-af72-16bc21378a5f\") " pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:01.967753 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:01.967713 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" Sep 07 21:00:02.279792 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:02.279768 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-867f8f95dc-p44xc"] Sep 07 21:00:02.281755 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:00:02.281724 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926d68a2_a440_4104_af72_16bc21378a5f.slice/crio-2b339572db1460acdeca5dfefad9e71b4156753812bfc756e575a57c3f0b8be8 WatchSource:0}: Error finding container 2b339572db1460acdeca5dfefad9e71b4156753812bfc756e575a57c3f0b8be8: Status 404 returned error can't find the container with id 2b339572db1460acdeca5dfefad9e71b4156753812bfc756e575a57c3f0b8be8 Sep 07 21:00:02.344592 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:02.344550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" event={"ID":"926d68a2-a440-4104-af72-16bc21378a5f","Type":"ContainerStarted","Data":"2b339572db1460acdeca5dfefad9e71b4156753812bfc756e575a57c3f0b8be8"} Sep 07 21:00:05.361709 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.361670 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" event={"ID":"926d68a2-a440-4104-af72-16bc21378a5f","Type":"ContainerStarted","Data":"2ac544fd1fdf13c373a39f169b6ddca0fc8b9739c3647e308adb7c7336f0032e"} Sep 07 21:00:05.362153 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.361735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" event={"ID":"926d68a2-a440-4104-af72-16bc21378a5f","Type":"ContainerStarted","Data":"2274ffb847f78de1cf127be6c657097150f6ac5ff130d1071f52b3590a8bbf16"} Sep 07 21:00:05.362153 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.361764 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" event={"ID":"926d68a2-a440-4104-af72-16bc21378a5f","Type":"ContainerStarted","Data":"4fac0bbbc94ce85c238a314e9aa48d394a90b006faf41a2a5f1332798821ad73"} Sep 07 21:00:05.389525 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.389462 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-867f8f95dc-p44xc" podStartSLOduration=2.217974358 podStartE2EDuration="4.38944306s" totalImagesPullingTime="2.171468702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:00:05.388950293 +0000 UTC m=+171.677319575" watchObservedRunningTime="2026-09-07 21:00:05.38944306 +0000 UTC m=+171.677812339" Sep 07 21:00:05.480938 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.480895 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-846646cb-9nlvh"] Sep 07 21:00:05.485073 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.485042 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.488966 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.487877 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 07 21:00:05.488966 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.488211 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2l2zf\"" Sep 07 21:00:05.488966 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.488668 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 07 21:00:05.488966 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.488840 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 07 21:00:05.489386 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.489035 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 07 21:00:05.489386 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.489069 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 07 21:00:05.489386 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.489088 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 07 21:00:05.489386 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.489163 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 07 21:00:05.493064 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.493036 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 07 21:00:05.498378 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.498345 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846646cb-9nlvh"] Sep 07 21:00:05.639918 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.639821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-oauth-serving-cert\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.639918 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.639861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-serving-cert\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.639918 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.639881 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-console-config\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.639918 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.639914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-service-ca\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.640164 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.639971 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5nsj\" (UniqueName: \"kubernetes.io/projected/aca354a6-756e-4e7a-863e-428979844b77-kube-api-access-r5nsj\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.640164 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.639997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-oauth-config\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.640164 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.640031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-trusted-ca-bundle\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.741495 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.741459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-oauth-serving-cert\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.741495 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.741501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-serving-cert\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.741712 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.741528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-console-config\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.741712 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.741571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-service-ca\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.741712 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.741590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5nsj\" (UniqueName: \"kubernetes.io/projected/aca354a6-756e-4e7a-863e-428979844b77-kube-api-access-r5nsj\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.741712 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.741628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-oauth-config\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.741712 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.741692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-trusted-ca-bundle\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.742478 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.742448 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-oauth-serving-cert\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.742685 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.742456 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-console-config\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.742685 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.742495 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-service-ca\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.742833 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.742753 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-trusted-ca-bundle\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.744353 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.744332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-serving-cert\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.744701 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.744681 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-oauth-config\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.750453 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.750426 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5nsj\" (UniqueName: \"kubernetes.io/projected/aca354a6-756e-4e7a-863e-428979844b77-kube-api-access-r5nsj\") pod \"console-846646cb-9nlvh\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:05.799536 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:05.799492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:06.077984 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:06.077892 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846646cb-9nlvh"] Sep 07 21:00:06.081234 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:00:06.081191 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca354a6_756e_4e7a_863e_428979844b77.slice/crio-1ec2d35fe582a14c2e83de237808f9d0c1cbf4b345e54c66f88dd787b5dd73c6 WatchSource:0}: Error finding container 1ec2d35fe582a14c2e83de237808f9d0c1cbf4b345e54c66f88dd787b5dd73c6: Status 404 returned error can't find the container with id 1ec2d35fe582a14c2e83de237808f9d0c1cbf4b345e54c66f88dd787b5dd73c6 Sep 07 21:00:06.367684 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:06.367580 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846646cb-9nlvh" event={"ID":"aca354a6-756e-4e7a-863e-428979844b77","Type":"ContainerStarted","Data":"0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6"} Sep 07 21:00:06.367684 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:06.367642 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846646cb-9nlvh" event={"ID":"aca354a6-756e-4e7a-863e-428979844b77","Type":"ContainerStarted","Data":"1ec2d35fe582a14c2e83de237808f9d0c1cbf4b345e54c66f88dd787b5dd73c6"} Sep 07 21:00:06.388334 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:06.388253 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-846646cb-9nlvh" podStartSLOduration=1.388233469 podStartE2EDuration="1.388233469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:00:06.385881743 +0000 UTC m=+172.674251023" watchObservedRunningTime="2026-09-07 21:00:06.388233469 +0000 UTC m=+172.676602749" Sep 07 21:00:15.800750 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:15.800701 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:15.801176 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:15.800777 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:15.805890 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:15.805856 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:00:16.413186 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:00:16.413156 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:01:35.085016 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.084981 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8495b89769-shmbx"] Sep 07 21:01:35.088527 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.088497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.106515 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.106478 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8495b89769-shmbx"] Sep 07 21:01:35.243740 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.243700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-service-ca\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.243740 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.243741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwqg4\" (UniqueName: \"kubernetes.io/projected/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-kube-api-access-pwqg4\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.243964 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.243785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-serving-cert\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.243964 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.243824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-trusted-ca-bundle\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.243964 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.243843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-config\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.243964 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.243882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-oauth-serving-cert\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.243964 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.243907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-oauth-config\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.344592 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.344502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-oauth-serving-cert\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.344592 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.344548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-oauth-config\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.344592 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.344589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-service-ca\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.344934 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.344607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwqg4\" (UniqueName: \"kubernetes.io/projected/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-kube-api-access-pwqg4\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.344934 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.344755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-serving-cert\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.344934 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.344808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-trusted-ca-bundle\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.344934 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.344846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-config\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.345408 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.345384 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-oauth-serving-cert\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.345672 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.345648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-service-ca\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.345765 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.345674 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-config\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.345956 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.345933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-trusted-ca-bundle\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.347238 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.347216 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-oauth-config\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.347818 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.347797 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-serving-cert\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.353469 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.353433 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwqg4\" (UniqueName: \"kubernetes.io/projected/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-kube-api-access-pwqg4\") pod \"console-8495b89769-shmbx\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.400802 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.400757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:35.679026 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.678937 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8495b89769-shmbx"] Sep 07 21:01:35.682359 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:01:35.682306 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842a5300_cf0b_4ed5_9297_0bd7bde19b4b.slice/crio-a8db972f16ff696dba335013c875e15049e323594bce8688f1d31d1beb2346bf WatchSource:0}: Error finding container a8db972f16ff696dba335013c875e15049e323594bce8688f1d31d1beb2346bf: Status 404 returned error can't find the container with id a8db972f16ff696dba335013c875e15049e323594bce8688f1d31d1beb2346bf Sep 07 21:01:35.729345 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:35.729292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8495b89769-shmbx" event={"ID":"842a5300-cf0b-4ed5-9297-0bd7bde19b4b","Type":"ContainerStarted","Data":"a8db972f16ff696dba335013c875e15049e323594bce8688f1d31d1beb2346bf"} Sep 07 21:01:36.735282 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:36.735188 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8495b89769-shmbx" event={"ID":"842a5300-cf0b-4ed5-9297-0bd7bde19b4b","Type":"ContainerStarted","Data":"1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6"} Sep 07 21:01:36.760038 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:36.759958 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8495b89769-shmbx" podStartSLOduration=1.7599346630000001 podStartE2EDuration="1.759934663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:36.757533656 +0000 UTC m=+263.045902937" watchObservedRunningTime="2026-09-07 21:01:36.759934663 +0000 UTC m=+263.048303944" Sep 07 21:01:45.401824 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:45.401772 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:45.402270 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:45.401844 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:45.407004 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:45.406971 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:45.776918 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:45.776886 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:01:45.829500 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:01:45.829456 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846646cb-9nlvh"] Sep 07 21:02:10.852769 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:10.852710 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-846646cb-9nlvh" podUID="aca354a6-756e-4e7a-863e-428979844b77" containerName="console" containerID="cri-o://0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6" gracePeriod=15 Sep 07 21:02:11.093005 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.092974 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:02:11.169096 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169007 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-serving-cert\") pod \"aca354a6-756e-4e7a-863e-428979844b77\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " Sep 07 21:02:11.169096 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169059 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5nsj\" (UniqueName: \"kubernetes.io/projected/aca354a6-756e-4e7a-863e-428979844b77-kube-api-access-r5nsj\") pod \"aca354a6-756e-4e7a-863e-428979844b77\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " Sep 07 21:02:11.169096 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169086 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-oauth-config\") pod \"aca354a6-756e-4e7a-863e-428979844b77\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " Sep 07 21:02:11.169377 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169125 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-oauth-serving-cert\") pod \"aca354a6-756e-4e7a-863e-428979844b77\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " Sep 07 21:02:11.169377 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169162 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-trusted-ca-bundle\") pod \"aca354a6-756e-4e7a-863e-428979844b77\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " Sep 07 21:02:11.169377 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169199 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-console-config\") pod \"aca354a6-756e-4e7a-863e-428979844b77\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " Sep 07 21:02:11.169377 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169256 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-service-ca\") pod \"aca354a6-756e-4e7a-863e-428979844b77\" (UID: \"aca354a6-756e-4e7a-863e-428979844b77\") " Sep 07 21:02:11.169654 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169627 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aca354a6-756e-4e7a-863e-428979844b77" (UID: "aca354a6-756e-4e7a-863e-428979844b77"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 21:02:11.169758 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169641 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aca354a6-756e-4e7a-863e-428979844b77" (UID: "aca354a6-756e-4e7a-863e-428979844b77"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 21:02:11.169819 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169631 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-console-config" (OuterVolumeSpecName: "console-config") pod "aca354a6-756e-4e7a-863e-428979844b77" (UID: "aca354a6-756e-4e7a-863e-428979844b77"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 21:02:11.169819 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.169806 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-service-ca" (OuterVolumeSpecName: "service-ca") pod "aca354a6-756e-4e7a-863e-428979844b77" (UID: "aca354a6-756e-4e7a-863e-428979844b77"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 21:02:11.171348 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.171328 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aca354a6-756e-4e7a-863e-428979844b77-kube-api-access-r5nsj" (OuterVolumeSpecName: "kube-api-access-r5nsj") pod "aca354a6-756e-4e7a-863e-428979844b77" (UID: "aca354a6-756e-4e7a-863e-428979844b77"). InnerVolumeSpecName "kube-api-access-r5nsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 21:02:11.171770 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.171737 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aca354a6-756e-4e7a-863e-428979844b77" (UID: "aca354a6-756e-4e7a-863e-428979844b77"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 21:02:11.171850 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.171747 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aca354a6-756e-4e7a-863e-428979844b77" (UID: "aca354a6-756e-4e7a-863e-428979844b77"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 21:02:11.270770 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.270735 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-console-config\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:11.270770 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.270766 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-service-ca\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:11.270770 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.270774 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-serving-cert\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:11.270999 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.270783 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5nsj\" (UniqueName: \"kubernetes.io/projected/aca354a6-756e-4e7a-863e-428979844b77-kube-api-access-r5nsj\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:11.270999 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.270793 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aca354a6-756e-4e7a-863e-428979844b77-console-oauth-config\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:11.270999 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.270802 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-oauth-serving-cert\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:11.270999 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.270810 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aca354a6-756e-4e7a-863e-428979844b77-trusted-ca-bundle\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:11.880552 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.880508 2578 generic.go:356] "Generic (PLEG): container finished" podID="aca354a6-756e-4e7a-863e-428979844b77" containerID="0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6" exitCode=0 Sep 07 21:02:11.881055 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.880572 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846646cb-9nlvh" Sep 07 21:02:11.881055 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.880576 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846646cb-9nlvh" event={"ID":"aca354a6-756e-4e7a-863e-428979844b77","Type":"ContainerDied","Data":"0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6"} Sep 07 21:02:11.881055 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.880659 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846646cb-9nlvh" event={"ID":"aca354a6-756e-4e7a-863e-428979844b77","Type":"ContainerDied","Data":"1ec2d35fe582a14c2e83de237808f9d0c1cbf4b345e54c66f88dd787b5dd73c6"} Sep 07 21:02:11.881055 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.880680 2578 scope.go:117] "RemoveContainer" containerID="0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6" Sep 07 21:02:11.889648 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.889630 2578 scope.go:117] "RemoveContainer" containerID="0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6" Sep 07 21:02:11.889980 ip-10-0-140-24 kubenswrapper[2578]: E0907 21:02:11.889956 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6\": container with ID starting with 0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6 not found: ID does not exist" containerID="0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6" Sep 07 21:02:11.890048 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.889994 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6"} err="failed to get container status \"0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6\": rpc error: code = NotFound desc = could not find container \"0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6\": container with ID starting with 0e818e1fe5c994d8857f9ab0d6d375bae5f98148f0fd8a7ff2b4c3b35e06e0b6 not found: ID does not exist" Sep 07 21:02:11.902977 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.902945 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846646cb-9nlvh"] Sep 07 21:02:11.905759 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:11.905734 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-846646cb-9nlvh"] Sep 07 21:02:12.318464 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:12.318427 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aca354a6-756e-4e7a-863e-428979844b77" path="/var/lib/kubelet/pods/aca354a6-756e-4e7a-863e-428979844b77/volumes" Sep 07 21:02:14.222073 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:14.222041 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/2.log" Sep 07 21:02:14.224666 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:14.224631 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/2.log" Sep 07 21:02:14.234533 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:14.234501 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-acl-logging/0.log" Sep 07 21:02:14.236871 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:14.236848 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-acl-logging/0.log" Sep 07 21:02:14.237704 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:14.237686 2578 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 21:02:17.775695 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.775657 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j"] Sep 07 21:02:17.778179 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.775978 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca354a6-756e-4e7a-863e-428979844b77" containerName="console" Sep 07 21:02:17.778179 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.775990 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca354a6-756e-4e7a-863e-428979844b77" containerName="console" Sep 07 21:02:17.778179 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.776060 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aca354a6-756e-4e7a-863e-428979844b77" containerName="console" Sep 07 21:02:17.779059 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.779037 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd"] Sep 07 21:02:17.779184 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.779167 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:17.782306 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.782275 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bxd4k\"" Sep 07 21:02:17.782306 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.782278 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 07 21:02:17.782592 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.782575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:17.783382 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.783365 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 07 21:02:17.789377 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.789352 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j"] Sep 07 21:02:17.796883 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.796855 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd"] Sep 07 21:02:17.927799 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.927758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:17.927988 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.927823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txc4s\" (UniqueName: \"kubernetes.io/projected/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-kube-api-access-txc4s\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:17.927988 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.927908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:17.928068 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.927992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snlg8\" (UniqueName: \"kubernetes.io/projected/4111d65b-54da-4b23-abde-59e9a59ce446-kube-api-access-snlg8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:17.928068 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.928021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:17.928068 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:17.928048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:18.029057 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.028942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snlg8\" (UniqueName: \"kubernetes.io/projected/4111d65b-54da-4b23-abde-59e9a59ce446-kube-api-access-snlg8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:18.029057 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.028991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:18.029057 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.029014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:18.029057 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.029047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:18.029431 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.029083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txc4s\" (UniqueName: \"kubernetes.io/projected/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-kube-api-access-txc4s\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:18.029431 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.029164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:18.029516 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.029447 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:18.029516 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.029477 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:18.029581 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.029522 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:18.029581 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.029569 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:18.038143 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.038097 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txc4s\" (UniqueName: \"kubernetes.io/projected/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-kube-api-access-txc4s\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:18.039302 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.039278 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snlg8\" (UniqueName: \"kubernetes.io/projected/4111d65b-54da-4b23-abde-59e9a59ce446-kube-api-access-snlg8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:18.090448 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.090409 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:18.097814 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.097787 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:18.168875 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.168837 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt"] Sep 07 21:02:18.172439 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.172412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.175153 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.175129 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 07 21:02:18.175244 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.175227 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xm9j4\"" Sep 07 21:02:18.175383 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.175306 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 07 21:02:18.175383 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.175129 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 07 21:02:18.175468 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.175444 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 07 21:02:18.183772 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.183707 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt"] Sep 07 21:02:18.231188 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.231148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.231391 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.231207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.231391 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.231273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b64ece-77d5-4271-8b9d-7e5473d24f29-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.231391 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.231357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5p5v\" (UniqueName: \"kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-kube-api-access-d5p5v\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.231516 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.231424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.231516 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.231455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.231516 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.231476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.332853 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.332753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.332853 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.332800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.333046 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.332921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.333046 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.332999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.333126 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.333054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.333126 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.333088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b64ece-77d5-4271-8b9d-7e5473d24f29-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.333216 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.333122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5p5v\" (UniqueName: \"kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-kube-api-access-d5p5v\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.333541 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.333514 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.335418 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.335387 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b64ece-77d5-4271-8b9d-7e5473d24f29-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.335525 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.335427 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.335525 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.335450 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.335609 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.335522 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.341976 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.341954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.342263 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.342247 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5p5v\" (UniqueName: \"kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-kube-api-access-d5p5v\") pod \"istiod-openshift-gateway-7b7995d5cd-9s2bt\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.370367 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.370339 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j"] Sep 07 21:02:18.372418 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:02:18.372389 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4111d65b_54da_4b23_abde_59e9a59ce446.slice/crio-f3302d89d0187ee9bccb2e970967f53c156e3e82a9f2b8e7abe3767fd7d0c028 WatchSource:0}: Error finding container f3302d89d0187ee9bccb2e970967f53c156e3e82a9f2b8e7abe3767fd7d0c028: Status 404 returned error can't find the container with id f3302d89d0187ee9bccb2e970967f53c156e3e82a9f2b8e7abe3767fd7d0c028 Sep 07 21:02:18.374494 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.374477 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 21:02:18.382735 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.382701 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd"] Sep 07 21:02:18.385581 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:02:18.385555 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f600a6e_4bc1_4cdc_afc0_677b5b0803a1.slice/crio-e0cf52d4caf8eb78a4a1ffd5e837dfafbb9039ffc82e11655d9f781699c78339 WatchSource:0}: Error finding container e0cf52d4caf8eb78a4a1ffd5e837dfafbb9039ffc82e11655d9f781699c78339: Status 404 returned error can't find the container with id e0cf52d4caf8eb78a4a1ffd5e837dfafbb9039ffc82e11655d9f781699c78339 Sep 07 21:02:18.485523 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.485476 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:18.761971 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.761933 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt"] Sep 07 21:02:18.765009 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:02:18.764978 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b64ece_77d5_4271_8b9d_7e5473d24f29.slice/crio-187ceafe6250bbff8c79d63adb1c6e24402b2d885ffcf4e5f322229059d9ceb9 WatchSource:0}: Error finding container 187ceafe6250bbff8c79d63adb1c6e24402b2d885ffcf4e5f322229059d9ceb9: Status 404 returned error can't find the container with id 187ceafe6250bbff8c79d63adb1c6e24402b2d885ffcf4e5f322229059d9ceb9 Sep 07 21:02:18.919484 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.919430 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" event={"ID":"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1","Type":"ContainerStarted","Data":"e0cf52d4caf8eb78a4a1ffd5e837dfafbb9039ffc82e11655d9f781699c78339"} Sep 07 21:02:18.921631 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.921580 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" event={"ID":"4111d65b-54da-4b23-abde-59e9a59ce446","Type":"ContainerStarted","Data":"f3302d89d0187ee9bccb2e970967f53c156e3e82a9f2b8e7abe3767fd7d0c028"} Sep 07 21:02:18.923293 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:18.923259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" event={"ID":"87b64ece-77d5-4271-8b9d-7e5473d24f29","Type":"ContainerStarted","Data":"187ceafe6250bbff8c79d63adb1c6e24402b2d885ffcf4e5f322229059d9ceb9"} Sep 07 21:02:21.823296 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:21.823242 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 07 21:02:21.823760 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:21.823367 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 07 21:02:21.946264 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:21.946222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" event={"ID":"87b64ece-77d5-4271-8b9d-7e5473d24f29","Type":"ContainerStarted","Data":"6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18"} Sep 07 21:02:21.946587 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:21.946564 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:21.974281 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:21.974210 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" podStartSLOduration=0.918462192 podStartE2EDuration="3.974185723s" totalImagesPullingTime="3.055723531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:21.971680947 +0000 UTC m=+308.260050228" watchObservedRunningTime="2026-09-07 21:02:21.974185723 +0000 UTC m=+308.262555003" Sep 07 21:02:22.954462 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:22.954421 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-9s2bt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 07 21:02:22.954938 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:22.954492 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" podUID="87b64ece-77d5-4271-8b9d-7e5473d24f29" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 07 21:02:24.962977 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:24.962942 2578 generic.go:356] "Generic (PLEG): container finished" podID="4111d65b-54da-4b23-abde-59e9a59ce446" containerID="19c915b533e4cd72c4601122243cd083cc12dfe5543517dc10b5e718fea5d66b" exitCode=0 Sep 07 21:02:24.963436 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:24.963027 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" event={"ID":"4111d65b-54da-4b23-abde-59e9a59ce446","Type":"ContainerDied","Data":"19c915b533e4cd72c4601122243cd083cc12dfe5543517dc10b5e718fea5d66b"} Sep 07 21:02:24.964843 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:24.964819 2578 generic.go:356] "Generic (PLEG): container finished" podID="7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" containerID="407739bd443ad8a53620e79a3b08b0bfbc4c2a1b79968da40875c589546dfac2" exitCode=0 Sep 07 21:02:24.964934 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:24.964897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" event={"ID":"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1","Type":"ContainerDied","Data":"407739bd443ad8a53620e79a3b08b0bfbc4c2a1b79968da40875c589546dfac2"} Sep 07 21:02:25.954330 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:25.953830 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:02:27.981675 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:27.981645 2578 generic.go:356] "Generic (PLEG): container finished" podID="7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" containerID="4eebedeb46f1bd1cd7c500461ef02843aba764a8a1212fe69a24989c87d9c9f7" exitCode=0 Sep 07 21:02:27.982118 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:27.981726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" event={"ID":"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1","Type":"ContainerDied","Data":"4eebedeb46f1bd1cd7c500461ef02843aba764a8a1212fe69a24989c87d9c9f7"} Sep 07 21:02:27.983885 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:27.983860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" event={"ID":"4111d65b-54da-4b23-abde-59e9a59ce446","Type":"ContainerStarted","Data":"7da785ba394c9f9cb3717abd9c5f02d64bf3527bb3c257bf04d6315dfde79c4f"} Sep 07 21:02:28.992807 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:28.992763 2578 generic.go:356] "Generic (PLEG): container finished" podID="4111d65b-54da-4b23-abde-59e9a59ce446" containerID="7da785ba394c9f9cb3717abd9c5f02d64bf3527bb3c257bf04d6315dfde79c4f" exitCode=0 Sep 07 21:02:28.993328 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:28.992920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" event={"ID":"4111d65b-54da-4b23-abde-59e9a59ce446","Type":"ContainerDied","Data":"7da785ba394c9f9cb3717abd9c5f02d64bf3527bb3c257bf04d6315dfde79c4f"} Sep 07 21:02:35.028592 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:35.028561 2578 generic.go:356] "Generic (PLEG): container finished" podID="4111d65b-54da-4b23-abde-59e9a59ce446" containerID="2c36115ea066ff1543ad2ae99c0f95a3aeac11d689352d2b75a1d9a5a15b069a" exitCode=0 Sep 07 21:02:35.028923 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:35.028592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" event={"ID":"4111d65b-54da-4b23-abde-59e9a59ce446","Type":"ContainerDied","Data":"2c36115ea066ff1543ad2ae99c0f95a3aeac11d689352d2b75a1d9a5a15b069a"} Sep 07 21:02:35.030982 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:35.030959 2578 generic.go:356] "Generic (PLEG): container finished" podID="7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" containerID="c163224fd591ba70507d8963a0a2ddcff0cdc7d999fa679c01f58f08330e0341" exitCode=0 Sep 07 21:02:35.031083 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:35.031023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" event={"ID":"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1","Type":"ContainerDied","Data":"c163224fd591ba70507d8963a0a2ddcff0cdc7d999fa679c01f58f08330e0341"} Sep 07 21:02:36.175431 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.175397 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:36.200334 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.200282 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:36.207440 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.207410 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-bundle\") pod \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " Sep 07 21:02:36.207610 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.207449 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-util\") pod \"4111d65b-54da-4b23-abde-59e9a59ce446\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " Sep 07 21:02:36.207610 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.207482 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txc4s\" (UniqueName: \"kubernetes.io/projected/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-kube-api-access-txc4s\") pod \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " Sep 07 21:02:36.207610 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.207496 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-util\") pod \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\" (UID: \"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1\") " Sep 07 21:02:36.207610 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.207511 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snlg8\" (UniqueName: \"kubernetes.io/projected/4111d65b-54da-4b23-abde-59e9a59ce446-kube-api-access-snlg8\") pod \"4111d65b-54da-4b23-abde-59e9a59ce446\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " Sep 07 21:02:36.207610 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.207526 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-bundle\") pod \"4111d65b-54da-4b23-abde-59e9a59ce446\" (UID: \"4111d65b-54da-4b23-abde-59e9a59ce446\") " Sep 07 21:02:36.207888 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.207864 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-bundle" (OuterVolumeSpecName: "bundle") pod "7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" (UID: "7f600a6e-4bc1-4cdc-afc0-677b5b0803a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 21:02:36.208587 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.208562 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-bundle" (OuterVolumeSpecName: "bundle") pod "4111d65b-54da-4b23-abde-59e9a59ce446" (UID: "4111d65b-54da-4b23-abde-59e9a59ce446"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 21:02:36.210362 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.210331 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-kube-api-access-txc4s" (OuterVolumeSpecName: "kube-api-access-txc4s") pod "7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" (UID: "7f600a6e-4bc1-4cdc-afc0-677b5b0803a1"). InnerVolumeSpecName "kube-api-access-txc4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 21:02:36.210482 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.210376 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4111d65b-54da-4b23-abde-59e9a59ce446-kube-api-access-snlg8" (OuterVolumeSpecName: "kube-api-access-snlg8") pod "4111d65b-54da-4b23-abde-59e9a59ce446" (UID: "4111d65b-54da-4b23-abde-59e9a59ce446"). InnerVolumeSpecName "kube-api-access-snlg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 21:02:36.212396 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.212370 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-util" (OuterVolumeSpecName: "util") pod "4111d65b-54da-4b23-abde-59e9a59ce446" (UID: "4111d65b-54da-4b23-abde-59e9a59ce446"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 21:02:36.213153 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.213128 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-util" (OuterVolumeSpecName: "util") pod "7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" (UID: "7f600a6e-4bc1-4cdc-afc0-677b5b0803a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 21:02:36.308751 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.308654 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-bundle\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:36.308751 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.308691 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-util\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:36.308751 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.308702 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txc4s\" (UniqueName: \"kubernetes.io/projected/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-kube-api-access-txc4s\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:36.308751 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.308712 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f600a6e-4bc1-4cdc-afc0-677b5b0803a1-util\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:36.308751 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.308721 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snlg8\" (UniqueName: \"kubernetes.io/projected/4111d65b-54da-4b23-abde-59e9a59ce446-kube-api-access-snlg8\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:36.308751 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:36.308730 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4111d65b-54da-4b23-abde-59e9a59ce446-bundle\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:02:37.041233 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:37.041200 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" Sep 07 21:02:37.041233 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:37.041210 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekmnfd" event={"ID":"7f600a6e-4bc1-4cdc-afc0-677b5b0803a1","Type":"ContainerDied","Data":"e0cf52d4caf8eb78a4a1ffd5e837dfafbb9039ffc82e11655d9f781699c78339"} Sep 07 21:02:37.041529 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:37.041262 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0cf52d4caf8eb78a4a1ffd5e837dfafbb9039ffc82e11655d9f781699c78339" Sep 07 21:02:37.043448 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:37.043398 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" event={"ID":"4111d65b-54da-4b23-abde-59e9a59ce446","Type":"ContainerDied","Data":"f3302d89d0187ee9bccb2e970967f53c156e3e82a9f2b8e7abe3767fd7d0c028"} Sep 07 21:02:37.043608 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:37.043458 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3302d89d0187ee9bccb2e970967f53c156e3e82a9f2b8e7abe3767fd7d0c028" Sep 07 21:02:37.043608 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:37.043465 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402bf6j" Sep 07 21:02:51.480853 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.480810 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm"] Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481145 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" containerName="pull" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481156 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" containerName="pull" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481177 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4111d65b-54da-4b23-abde-59e9a59ce446" containerName="util" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481182 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4111d65b-54da-4b23-abde-59e9a59ce446" containerName="util" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481193 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" containerName="util" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481199 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" containerName="util" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481205 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" containerName="extract" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481211 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" containerName="extract" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481226 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4111d65b-54da-4b23-abde-59e9a59ce446" containerName="extract" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481233 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4111d65b-54da-4b23-abde-59e9a59ce446" containerName="extract" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481249 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4111d65b-54da-4b23-abde-59e9a59ce446" containerName="pull" Sep 07 21:02:51.481285 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481254 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4111d65b-54da-4b23-abde-59e9a59ce446" containerName="pull" Sep 07 21:02:51.481658 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481338 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4111d65b-54da-4b23-abde-59e9a59ce446" containerName="extract" Sep 07 21:02:51.481658 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.481349 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f600a6e-4bc1-4cdc-afc0-677b5b0803a1" containerName="extract" Sep 07 21:02:51.487242 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.487213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.494951 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.494925 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 07 21:02:51.495348 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.495325 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 07 21:02:51.495348 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.495341 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 07 21:02:51.495522 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.495336 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 07 21:02:51.495522 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.495394 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-tglfj\"" Sep 07 21:02:51.495673 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.495657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 07 21:02:51.523166 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.523130 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm"] Sep 07 21:02:51.534664 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.534631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv99l\" (UniqueName: \"kubernetes.io/projected/c938cfa0-db7d-4d53-8966-320364d6d028-kube-api-access-xv99l\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.534873 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.534696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c938cfa0-db7d-4d53-8966-320364d6d028-manifests\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.534873 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.534758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c938cfa0-db7d-4d53-8966-320364d6d028-metrics-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.534873 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.534788 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c938cfa0-db7d-4d53-8966-320364d6d028-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.534873 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.534853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c938cfa0-db7d-4d53-8966-320364d6d028-tmp\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.535105 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.534915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c938cfa0-db7d-4d53-8966-320364d6d028-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.635900 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.635851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c938cfa0-db7d-4d53-8966-320364d6d028-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.635900 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.635900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv99l\" (UniqueName: \"kubernetes.io/projected/c938cfa0-db7d-4d53-8966-320364d6d028-kube-api-access-xv99l\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.636153 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.635975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c938cfa0-db7d-4d53-8966-320364d6d028-manifests\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.636153 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.636028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c938cfa0-db7d-4d53-8966-320364d6d028-metrics-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.636153 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.636051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c938cfa0-db7d-4d53-8966-320364d6d028-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.636153 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.636085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c938cfa0-db7d-4d53-8966-320364d6d028-tmp\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.636545 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.636511 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c938cfa0-db7d-4d53-8966-320364d6d028-manifests\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.638538 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.638510 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c938cfa0-db7d-4d53-8966-320364d6d028-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.638671 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.638607 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c938cfa0-db7d-4d53-8966-320364d6d028-metrics-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.638671 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.638664 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c938cfa0-db7d-4d53-8966-320364d6d028-tmp\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.638912 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.638892 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c938cfa0-db7d-4d53-8966-320364d6d028-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.659486 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.659453 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv99l\" (UniqueName: \"kubernetes.io/projected/c938cfa0-db7d-4d53-8966-320364d6d028-kube-api-access-xv99l\") pod \"opendatahub-operator-controller-manager-84dd88468f-b45cm\" (UID: \"c938cfa0-db7d-4d53-8966-320364d6d028\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:51.797512 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:51.797451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:52.103367 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:52.103269 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm"] Sep 07 21:02:52.106887 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:02:52.106857 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc938cfa0_db7d_4d53_8966_320364d6d028.slice/crio-f86229829c3e33231b4323091d39291cf27a38317ef2f6a0e6906d9752a341c8 WatchSource:0}: Error finding container f86229829c3e33231b4323091d39291cf27a38317ef2f6a0e6906d9752a341c8: Status 404 returned error can't find the container with id f86229829c3e33231b4323091d39291cf27a38317ef2f6a0e6906d9752a341c8 Sep 07 21:02:53.115299 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:53.115249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" event={"ID":"c938cfa0-db7d-4d53-8966-320364d6d028","Type":"ContainerStarted","Data":"f86229829c3e33231b4323091d39291cf27a38317ef2f6a0e6906d9752a341c8"} Sep 07 21:02:55.126516 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:55.126470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" event={"ID":"c938cfa0-db7d-4d53-8966-320364d6d028","Type":"ContainerStarted","Data":"ffe3c373733cf8a68b07f6c072114647f85f3f1d06b171ae79e1bbc0b02cad81"} Sep 07 21:02:56.132933 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:56.132894 2578 generic.go:356] "Generic (PLEG): container finished" podID="c938cfa0-db7d-4d53-8966-320364d6d028" containerID="ffe3c373733cf8a68b07f6c072114647f85f3f1d06b171ae79e1bbc0b02cad81" exitCode=0 Sep 07 21:02:56.132933 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:56.132943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" event={"ID":"c938cfa0-db7d-4d53-8966-320364d6d028","Type":"ContainerDied","Data":"ffe3c373733cf8a68b07f6c072114647f85f3f1d06b171ae79e1bbc0b02cad81"} Sep 07 21:02:57.139980 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:57.139942 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" event={"ID":"c938cfa0-db7d-4d53-8966-320364d6d028","Type":"ContainerStarted","Data":"0dd2df2dfbfc5501ef64b59c5b0fb78f30fe2bae500fed5fb036d4a904dd47a0"} Sep 07 21:02:57.140441 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:57.140056 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:02:57.164637 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:02:57.164573 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" podStartSLOduration=2.316898246 podStartE2EDuration="6.164552245s" totalImagesPullingTime="3.275349362s" totalInitContainerRuntime="572.304637ms" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:57.161792463 +0000 UTC m=+343.450161744" watchObservedRunningTime="2026-09-07 21:02:57.164552245 +0000 UTC m=+343.452921525" Sep 07 21:03:08.147800 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:08.147716 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-b45cm" Sep 07 21:03:23.743208 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:23.743166 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn"] Sep 07 21:03:23.747977 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:23.747953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:23.750438 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:23.750406 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 07 21:03:23.750587 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:23.750475 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rtg5d\"" Sep 07 21:03:23.751552 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:23.751515 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 07 21:03:23.757643 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:23.757611 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn"] Sep 07 21:03:23.945668 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:23.945633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08d4b66e-d613-4a37-a458-584a20a92d7c-tmp\") pod \"kube-auth-proxy-7dd8c6c7d4-wlnbn\" (UID: \"08d4b66e-d613-4a37-a458-584a20a92d7c\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:23.945668 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:23.945675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs2m6\" (UniqueName: \"kubernetes.io/projected/08d4b66e-d613-4a37-a458-584a20a92d7c-kube-api-access-bs2m6\") pod \"kube-auth-proxy-7dd8c6c7d4-wlnbn\" (UID: \"08d4b66e-d613-4a37-a458-584a20a92d7c\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:23.945899 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:23.945758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d4b66e-d613-4a37-a458-584a20a92d7c-tls-certs\") pod \"kube-auth-proxy-7dd8c6c7d4-wlnbn\" (UID: \"08d4b66e-d613-4a37-a458-584a20a92d7c\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:24.046391 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.046280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08d4b66e-d613-4a37-a458-584a20a92d7c-tmp\") pod \"kube-auth-proxy-7dd8c6c7d4-wlnbn\" (UID: \"08d4b66e-d613-4a37-a458-584a20a92d7c\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:24.046391 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.046335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs2m6\" (UniqueName: \"kubernetes.io/projected/08d4b66e-d613-4a37-a458-584a20a92d7c-kube-api-access-bs2m6\") pod \"kube-auth-proxy-7dd8c6c7d4-wlnbn\" (UID: \"08d4b66e-d613-4a37-a458-584a20a92d7c\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:24.046629 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.046408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d4b66e-d613-4a37-a458-584a20a92d7c-tls-certs\") pod \"kube-auth-proxy-7dd8c6c7d4-wlnbn\" (UID: \"08d4b66e-d613-4a37-a458-584a20a92d7c\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:24.048839 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.048806 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08d4b66e-d613-4a37-a458-584a20a92d7c-tmp\") pod \"kube-auth-proxy-7dd8c6c7d4-wlnbn\" (UID: \"08d4b66e-d613-4a37-a458-584a20a92d7c\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:24.048997 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.048982 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d4b66e-d613-4a37-a458-584a20a92d7c-tls-certs\") pod \"kube-auth-proxy-7dd8c6c7d4-wlnbn\" (UID: \"08d4b66e-d613-4a37-a458-584a20a92d7c\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:24.058325 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.058293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs2m6\" (UniqueName: \"kubernetes.io/projected/08d4b66e-d613-4a37-a458-584a20a92d7c-kube-api-access-bs2m6\") pod \"kube-auth-proxy-7dd8c6c7d4-wlnbn\" (UID: \"08d4b66e-d613-4a37-a458-584a20a92d7c\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:24.060137 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.060117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" Sep 07 21:03:24.341655 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.341614 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn"] Sep 07 21:03:24.343913 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:03:24.343875 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d4b66e_d613_4a37_a458_584a20a92d7c.slice/crio-23179534edf75d4887cf5a80f06db74bd43a8adec243b8e408bb658b9f6a4c7f WatchSource:0}: Error finding container 23179534edf75d4887cf5a80f06db74bd43a8adec243b8e408bb658b9f6a4c7f: Status 404 returned error can't find the container with id 23179534edf75d4887cf5a80f06db74bd43a8adec243b8e408bb658b9f6a4c7f Sep 07 21:03:24.693178 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.693078 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-d26pb"] Sep 07 21:03:24.697695 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.697670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" Sep 07 21:03:24.700648 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.700618 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 07 21:03:24.700803 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.700762 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 07 21:03:24.702005 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.701982 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-v49f8\"" Sep 07 21:03:24.702273 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.702249 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 07 21:03:24.716638 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.716603 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-d26pb"] Sep 07 21:03:24.750506 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.750471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/abfebae6-f2c5-46d2-a233-d60f35f880b1-data\") pod \"postgres-69fb4594cf-d26pb\" (UID: \"abfebae6-f2c5-46d2-a233-d60f35f880b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" Sep 07 21:03:24.750905 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.750528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpqj\" (UniqueName: \"kubernetes.io/projected/abfebae6-f2c5-46d2-a233-d60f35f880b1-kube-api-access-wnpqj\") pod \"postgres-69fb4594cf-d26pb\" (UID: \"abfebae6-f2c5-46d2-a233-d60f35f880b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" Sep 07 21:03:24.851702 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.851658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/abfebae6-f2c5-46d2-a233-d60f35f880b1-data\") pod \"postgres-69fb4594cf-d26pb\" (UID: \"abfebae6-f2c5-46d2-a233-d60f35f880b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" Sep 07 21:03:24.851907 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.851752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpqj\" (UniqueName: \"kubernetes.io/projected/abfebae6-f2c5-46d2-a233-d60f35f880b1-kube-api-access-wnpqj\") pod \"postgres-69fb4594cf-d26pb\" (UID: \"abfebae6-f2c5-46d2-a233-d60f35f880b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" Sep 07 21:03:24.852069 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.852046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/abfebae6-f2c5-46d2-a233-d60f35f880b1-data\") pod \"postgres-69fb4594cf-d26pb\" (UID: \"abfebae6-f2c5-46d2-a233-d60f35f880b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" Sep 07 21:03:24.864376 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.864344 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpqj\" (UniqueName: \"kubernetes.io/projected/abfebae6-f2c5-46d2-a233-d60f35f880b1-kube-api-access-wnpqj\") pod \"postgres-69fb4594cf-d26pb\" (UID: \"abfebae6-f2c5-46d2-a233-d60f35f880b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" Sep 07 21:03:24.949701 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.949595 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt"] Sep 07 21:03:24.953193 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.953164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:24.956780 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.956754 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 07 21:03:24.957079 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.957063 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-d5ncp\"" Sep 07 21:03:24.957416 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.957402 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 07 21:03:24.963252 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.963225 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Sep 07 21:03:24.977787 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:24.977757 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt"] Sep 07 21:03:25.009455 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.009419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" Sep 07 21:03:25.154121 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.154070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb9m7\" (UniqueName: \"kubernetes.io/projected/eb1feaac-c016-44cc-a6f8-b85336170fd2-kube-api-access-mb9m7\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.154304 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.154128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb1feaac-c016-44cc-a6f8-b85336170fd2-manifests\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.154304 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.154160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb1feaac-c016-44cc-a6f8-b85336170fd2-tmp\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.154304 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.154180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb1feaac-c016-44cc-a6f8-b85336170fd2-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.254847 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.254805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb1feaac-c016-44cc-a6f8-b85336170fd2-tmp\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.255109 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.254854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb1feaac-c016-44cc-a6f8-b85336170fd2-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.255109 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.254994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb9m7\" (UniqueName: \"kubernetes.io/projected/eb1feaac-c016-44cc-a6f8-b85336170fd2-kube-api-access-mb9m7\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.255109 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.255032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb1feaac-c016-44cc-a6f8-b85336170fd2-manifests\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.255518 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.255299 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb1feaac-c016-44cc-a6f8-b85336170fd2-tmp\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.255518 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.255471 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb1feaac-c016-44cc-a6f8-b85336170fd2-manifests\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.256348 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.256306 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb1feaac-c016-44cc-a6f8-b85336170fd2-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.264357 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.264324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb9m7\" (UniqueName: \"kubernetes.io/projected/eb1feaac-c016-44cc-a6f8-b85336170fd2-kube-api-access-mb9m7\") pod \"kserve-module-controller-manager-54765d59fd-9hdpt\" (UID: \"eb1feaac-c016-44cc-a6f8-b85336170fd2\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.264563 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.264507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:25.277222 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.277177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" event={"ID":"08d4b66e-d613-4a37-a458-584a20a92d7c","Type":"ContainerStarted","Data":"23179534edf75d4887cf5a80f06db74bd43a8adec243b8e408bb658b9f6a4c7f"} Sep 07 21:03:25.306595 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.306557 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-d26pb"] Sep 07 21:03:25.311070 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:03:25.311028 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabfebae6_f2c5_46d2_a233_d60f35f880b1.slice/crio-cbbcea19119c016b55b2286f7c3e03d4ed4082abf53c678a8838e4cbeedeedbf WatchSource:0}: Error finding container cbbcea19119c016b55b2286f7c3e03d4ed4082abf53c678a8838e4cbeedeedbf: Status 404 returned error can't find the container with id cbbcea19119c016b55b2286f7c3e03d4ed4082abf53c678a8838e4cbeedeedbf Sep 07 21:03:25.564772 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:25.564154 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt"] Sep 07 21:03:25.570841 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:03:25.570801 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1feaac_c016_44cc_a6f8_b85336170fd2.slice/crio-423bd5aca5fce768706d3c97f17bdb47bba625ebdbf29ae1f4777d8d852a1aae WatchSource:0}: Error finding container 423bd5aca5fce768706d3c97f17bdb47bba625ebdbf29ae1f4777d8d852a1aae: Status 404 returned error can't find the container with id 423bd5aca5fce768706d3c97f17bdb47bba625ebdbf29ae1f4777d8d852a1aae Sep 07 21:03:26.284218 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:26.284172 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" event={"ID":"eb1feaac-c016-44cc-a6f8-b85336170fd2","Type":"ContainerStarted","Data":"423bd5aca5fce768706d3c97f17bdb47bba625ebdbf29ae1f4777d8d852a1aae"} Sep 07 21:03:26.285733 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:26.285699 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" event={"ID":"abfebae6-f2c5-46d2-a233-d60f35f880b1","Type":"ContainerStarted","Data":"cbbcea19119c016b55b2286f7c3e03d4ed4082abf53c678a8838e4cbeedeedbf"} Sep 07 21:03:27.297419 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:27.297159 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" event={"ID":"08d4b66e-d613-4a37-a458-584a20a92d7c","Type":"ContainerStarted","Data":"4e9c7c2bc14d59fad51bfb4c12a549ce9b7c8a297963d019f213951c317eaf52"} Sep 07 21:03:27.315710 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:27.315635 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-wlnbn" podStartSLOduration=1.808677949 podStartE2EDuration="4.315611637s" totalImagesPullingTime="2.506933688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:27.313461702 +0000 UTC m=+373.601831002" watchObservedRunningTime="2026-09-07 21:03:27.315611637 +0000 UTC m=+373.603980918" Sep 07 21:03:32.327668 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:32.327627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" event={"ID":"abfebae6-f2c5-46d2-a233-d60f35f880b1","Type":"ContainerStarted","Data":"10b2d804c8b361563389012a350f0d25715653ac226dcae8dc0396319a4e2ce9"} Sep 07 21:03:32.328176 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:32.327816 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" Sep 07 21:03:32.329283 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:32.329249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" event={"ID":"eb1feaac-c016-44cc-a6f8-b85336170fd2","Type":"ContainerStarted","Data":"3dd412bddbfb36814ad9e6193b74ede3456196aa855cda37686bd33eddb1a55b"} Sep 07 21:03:32.329445 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:32.329347 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:03:32.347704 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:32.347641 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" podStartSLOduration=2.317298585 podStartE2EDuration="8.347622261s" totalImagesPullingTime="6.030323676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:32.34567063 +0000 UTC m=+378.634039924" watchObservedRunningTime="2026-09-07 21:03:32.347622261 +0000 UTC m=+378.635991540" Sep 07 21:03:32.364728 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:32.364665 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" podStartSLOduration=2.667884336 podStartE2EDuration="8.36464627s" totalImagesPullingTime="5.696761934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:32.363615922 +0000 UTC m=+378.651985203" watchObservedRunningTime="2026-09-07 21:03:32.36464627 +0000 UTC m=+378.653015550" Sep 07 21:03:38.364799 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:38.364760 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-d26pb" Sep 07 21:03:53.336863 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:03:53.336826 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-9hdpt" Sep 07 21:04:03.259230 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:03.259188 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8495b89769-shmbx"] Sep 07 21:04:19.999130 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:19.999090 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx"] Sep 07 21:04:20.002514 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.002493 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" Sep 07 21:04:20.007542 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.007512 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 07 21:04:20.007744 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.007725 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pjst2\"" Sep 07 21:04:20.020131 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.020101 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx"] Sep 07 21:04:20.078287 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.078232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mwbh\" (UniqueName: \"kubernetes.io/projected/5f89942b-7153-4786-9e76-82cf05c2dc50-kube-api-access-5mwbh\") pod \"payload-pre-processing-59fbc47bf8-7z2hx\" (UID: \"5f89942b-7153-4786-9e76-82cf05c2dc50\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" Sep 07 21:04:20.078525 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.078298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f89942b-7153-4786-9e76-82cf05c2dc50-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7z2hx\" (UID: \"5f89942b-7153-4786-9e76-82cf05c2dc50\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" Sep 07 21:04:20.112442 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.112404 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wb8rt"] Sep 07 21:04:20.114849 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.114831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" Sep 07 21:04:20.127911 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.127871 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wb8rt"] Sep 07 21:04:20.179439 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.179399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f89942b-7153-4786-9e76-82cf05c2dc50-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7z2hx\" (UID: \"5f89942b-7153-4786-9e76-82cf05c2dc50\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" Sep 07 21:04:20.179654 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.179456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79a4514f-df2e-420c-8574-f29b4495d7b1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wb8rt\" (UID: \"79a4514f-df2e-420c-8574-f29b4495d7b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" Sep 07 21:04:20.179654 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.179498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cvr5\" (UniqueName: \"kubernetes.io/projected/79a4514f-df2e-420c-8574-f29b4495d7b1-kube-api-access-5cvr5\") pod \"payload-processing-5b54b7fbb7-wb8rt\" (UID: \"79a4514f-df2e-420c-8574-f29b4495d7b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" Sep 07 21:04:20.179654 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.179607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mwbh\" (UniqueName: \"kubernetes.io/projected/5f89942b-7153-4786-9e76-82cf05c2dc50-kube-api-access-5mwbh\") pod \"payload-pre-processing-59fbc47bf8-7z2hx\" (UID: \"5f89942b-7153-4786-9e76-82cf05c2dc50\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" Sep 07 21:04:20.180228 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.180200 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f89942b-7153-4786-9e76-82cf05c2dc50-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7z2hx\" (UID: \"5f89942b-7153-4786-9e76-82cf05c2dc50\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" Sep 07 21:04:20.188433 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.188406 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mwbh\" (UniqueName: \"kubernetes.io/projected/5f89942b-7153-4786-9e76-82cf05c2dc50-kube-api-access-5mwbh\") pod \"payload-pre-processing-59fbc47bf8-7z2hx\" (UID: \"5f89942b-7153-4786-9e76-82cf05c2dc50\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" Sep 07 21:04:20.280136 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.280044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79a4514f-df2e-420c-8574-f29b4495d7b1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wb8rt\" (UID: \"79a4514f-df2e-420c-8574-f29b4495d7b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" Sep 07 21:04:20.280136 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.280100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cvr5\" (UniqueName: \"kubernetes.io/projected/79a4514f-df2e-420c-8574-f29b4495d7b1-kube-api-access-5cvr5\") pod \"payload-processing-5b54b7fbb7-wb8rt\" (UID: \"79a4514f-df2e-420c-8574-f29b4495d7b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" Sep 07 21:04:20.280879 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.280851 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79a4514f-df2e-420c-8574-f29b4495d7b1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wb8rt\" (UID: \"79a4514f-df2e-420c-8574-f29b4495d7b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" Sep 07 21:04:20.294266 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.294227 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cvr5\" (UniqueName: \"kubernetes.io/projected/79a4514f-df2e-420c-8574-f29b4495d7b1-kube-api-access-5cvr5\") pod \"payload-processing-5b54b7fbb7-wb8rt\" (UID: \"79a4514f-df2e-420c-8574-f29b4495d7b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" Sep 07 21:04:20.312892 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.312853 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" Sep 07 21:04:20.428960 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.428923 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" Sep 07 21:04:20.609781 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.609688 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx"] Sep 07 21:04:20.613046 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:04:20.613017 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f89942b_7153_4786_9e76_82cf05c2dc50.slice/crio-546a38c6bd2b265a622910df2f27c61c60648a0a6de2eb91154bfbfa4278762f WatchSource:0}: Error finding container 546a38c6bd2b265a622910df2f27c61c60648a0a6de2eb91154bfbfa4278762f: Status 404 returned error can't find the container with id 546a38c6bd2b265a622910df2f27c61c60648a0a6de2eb91154bfbfa4278762f Sep 07 21:04:20.720011 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:20.719927 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wb8rt"] Sep 07 21:04:20.721927 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:04:20.721892 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a4514f_df2e_420c_8574_f29b4495d7b1.slice/crio-84a1016b5136863c5fb1ff3ac4fc3351b2bfa87d301d012e07ef69a4364cde01 WatchSource:0}: Error finding container 84a1016b5136863c5fb1ff3ac4fc3351b2bfa87d301d012e07ef69a4364cde01: Status 404 returned error can't find the container with id 84a1016b5136863c5fb1ff3ac4fc3351b2bfa87d301d012e07ef69a4364cde01 Sep 07 21:04:21.600651 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.600546 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" event={"ID":"79a4514f-df2e-420c-8574-f29b4495d7b1","Type":"ContainerStarted","Data":"84a1016b5136863c5fb1ff3ac4fc3351b2bfa87d301d012e07ef69a4364cde01"} Sep 07 21:04:21.602788 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.602701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" event={"ID":"5f89942b-7153-4786-9e76-82cf05c2dc50","Type":"ContainerStarted","Data":"546a38c6bd2b265a622910df2f27c61c60648a0a6de2eb91154bfbfa4278762f"} Sep 07 21:04:21.634343 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.633274 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-pw92s"] Sep 07 21:04:21.636878 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.636848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:21.650511 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.649883 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Sep 07 21:04:21.650511 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.650131 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 07 21:04:21.650511 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.650346 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-p97hx\"" Sep 07 21:04:21.678081 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.678041 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-pw92s"] Sep 07 21:04:21.700099 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.699839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0f14214-c890-4d50-915b-e03d1a1463e5-cert\") pod \"odh-model-controller-bb7b75cc4-pw92s\" (UID: \"b0f14214-c890-4d50-915b-e03d1a1463e5\") " pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:21.700099 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.699952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhkw6\" (UniqueName: \"kubernetes.io/projected/b0f14214-c890-4d50-915b-e03d1a1463e5-kube-api-access-xhkw6\") pod \"odh-model-controller-bb7b75cc4-pw92s\" (UID: \"b0f14214-c890-4d50-915b-e03d1a1463e5\") " pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:21.700099 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.699996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f14214-c890-4d50-915b-e03d1a1463e5-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-pw92s\" (UID: \"b0f14214-c890-4d50-915b-e03d1a1463e5\") " pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:21.801797 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.801691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0f14214-c890-4d50-915b-e03d1a1463e5-cert\") pod \"odh-model-controller-bb7b75cc4-pw92s\" (UID: \"b0f14214-c890-4d50-915b-e03d1a1463e5\") " pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:21.802295 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.802105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkw6\" (UniqueName: \"kubernetes.io/projected/b0f14214-c890-4d50-915b-e03d1a1463e5-kube-api-access-xhkw6\") pod \"odh-model-controller-bb7b75cc4-pw92s\" (UID: \"b0f14214-c890-4d50-915b-e03d1a1463e5\") " pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:21.802295 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.802162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f14214-c890-4d50-915b-e03d1a1463e5-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-pw92s\" (UID: \"b0f14214-c890-4d50-915b-e03d1a1463e5\") " pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:21.805834 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.805806 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f14214-c890-4d50-915b-e03d1a1463e5-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-pw92s\" (UID: \"b0f14214-c890-4d50-915b-e03d1a1463e5\") " pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:21.807635 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.807606 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0f14214-c890-4d50-915b-e03d1a1463e5-cert\") pod \"odh-model-controller-bb7b75cc4-pw92s\" (UID: \"b0f14214-c890-4d50-915b-e03d1a1463e5\") " pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:21.812389 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.812294 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhkw6\" (UniqueName: \"kubernetes.io/projected/b0f14214-c890-4d50-915b-e03d1a1463e5-kube-api-access-xhkw6\") pod \"odh-model-controller-bb7b75cc4-pw92s\" (UID: \"b0f14214-c890-4d50-915b-e03d1a1463e5\") " pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:21.955187 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:21.954911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:22.000800 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.000766 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp"] Sep 07 21:04:22.003466 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.003434 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.017952 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.017877 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp"] Sep 07 21:04:22.105095 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.105015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/93777457-8356-4721-9caa-bb7ab41d1d5d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.105095 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.105068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.105384 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.105149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.105384 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.105262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.105507 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.105398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crgmm\" (UniqueName: \"kubernetes.io/projected/93777457-8356-4721-9caa-bb7ab41d1d5d-kube-api-access-crgmm\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.105507 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.105437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/93777457-8356-4721-9caa-bb7ab41d1d5d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.105507 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.105467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.207107 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.206986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crgmm\" (UniqueName: \"kubernetes.io/projected/93777457-8356-4721-9caa-bb7ab41d1d5d-kube-api-access-crgmm\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.207107 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.207041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/93777457-8356-4721-9caa-bb7ab41d1d5d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.207107 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.207070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.207451 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.207158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/93777457-8356-4721-9caa-bb7ab41d1d5d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.207451 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.207181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.207451 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.207208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.207451 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.207334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.208304 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.208247 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.210251 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.210194 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/93777457-8356-4721-9caa-bb7ab41d1d5d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.210404 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.210262 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/93777457-8356-4721-9caa-bb7ab41d1d5d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.210404 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.210297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.210699 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.210678 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.216650 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.216618 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93777457-8356-4721-9caa-bb7ab41d1d5d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.217140 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.217096 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crgmm\" (UniqueName: \"kubernetes.io/projected/93777457-8356-4721-9caa-bb7ab41d1d5d-kube-api-access-crgmm\") pod \"istiod-openshift-gateway-5677ccb49b-xx2jp\" (UID: \"93777457-8356-4721-9caa-bb7ab41d1d5d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.258519 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.258478 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-pw92s"] Sep 07 21:04:22.318127 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.318094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:22.538754 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:04:22.538715 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f14214_c890_4d50_915b_e03d1a1463e5.slice/crio-3aa3bdf72382a29779ed3e8e46336696f64a55b4a0d6951d42cf093cf874d279 WatchSource:0}: Error finding container 3aa3bdf72382a29779ed3e8e46336696f64a55b4a0d6951d42cf093cf874d279: Status 404 returned error can't find the container with id 3aa3bdf72382a29779ed3e8e46336696f64a55b4a0d6951d42cf093cf874d279 Sep 07 21:04:22.614927 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.614826 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" event={"ID":"b0f14214-c890-4d50-915b-e03d1a1463e5","Type":"ContainerStarted","Data":"3aa3bdf72382a29779ed3e8e46336696f64a55b4a0d6951d42cf093cf874d279"} Sep 07 21:04:22.834128 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.834035 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp"] Sep 07 21:04:22.838088 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:04:22.838044 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93777457_8356_4721_9caa_bb7ab41d1d5d.slice/crio-4b88c03cf927e5aa87fb11a8f8bab45a50f19cead8d73eca4dfc1939fb66ad6c WatchSource:0}: Error finding container 4b88c03cf927e5aa87fb11a8f8bab45a50f19cead8d73eca4dfc1939fb66ad6c: Status 404 returned error can't find the container with id 4b88c03cf927e5aa87fb11a8f8bab45a50f19cead8d73eca4dfc1939fb66ad6c Sep 07 21:04:22.841002 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.840966 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 07 21:04:22.841099 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:22.841034 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 07 21:04:23.625209 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.625084 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" event={"ID":"93777457-8356-4721-9caa-bb7ab41d1d5d","Type":"ContainerStarted","Data":"1369d1f6533a6f90958beaedc4187dfd6eea741babcdf80d7c16eae8750ebb6e"} Sep 07 21:04:23.625209 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.625149 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" event={"ID":"93777457-8356-4721-9caa-bb7ab41d1d5d","Type":"ContainerStarted","Data":"4b88c03cf927e5aa87fb11a8f8bab45a50f19cead8d73eca4dfc1939fb66ad6c"} Sep 07 21:04:23.625209 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.625176 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:23.628219 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.628188 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-xx2jp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 07 21:04:23.628379 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.628247 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" podUID="93777457-8356-4721-9caa-bb7ab41d1d5d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 07 21:04:23.629205 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.629146 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" event={"ID":"5f89942b-7153-4786-9e76-82cf05c2dc50","Type":"ContainerStarted","Data":"ee7840ae754cda237b6c5236465c7b804319a0f7cac977b9066976c39c40fe17"} Sep 07 21:04:23.629711 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.629491 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" Sep 07 21:04:23.631653 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.631592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" event={"ID":"79a4514f-df2e-420c-8574-f29b4495d7b1","Type":"ContainerStarted","Data":"32d1c664603c1bad7c3e72ba476ffda770d2af53f6613c175ab69ffab1cedd48"} Sep 07 21:04:23.632131 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.632082 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" Sep 07 21:04:23.646944 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.646883 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" podStartSLOduration=2.646866479 podStartE2EDuration="2.646866479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:04:23.643778726 +0000 UTC m=+429.932148044" watchObservedRunningTime="2026-09-07 21:04:23.646866479 +0000 UTC m=+429.935235761" Sep 07 21:04:23.660442 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.660377 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" podStartSLOduration=1.806456864 podStartE2EDuration="3.660356362s" totalImagesPullingTime="1.853899498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:04:23.658256207 +0000 UTC m=+429.946625486" watchObservedRunningTime="2026-09-07 21:04:23.660356362 +0000 UTC m=+429.948725642" Sep 07 21:04:23.676023 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:23.675949 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" podStartSLOduration=2.7005233669999997 podStartE2EDuration="4.675924191s" totalImagesPullingTime="1.975400824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:04:23.673261303 +0000 UTC m=+429.961630597" watchObservedRunningTime="2026-09-07 21:04:23.675924191 +0000 UTC m=+429.964293472" Sep 07 21:04:24.639213 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:24.639183 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xx2jp" Sep 07 21:04:24.689862 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:24.689731 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt"] Sep 07 21:04:24.690074 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:24.690036 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" podUID="87b64ece-77d5-4271-8b9d-7e5473d24f29" containerName="discovery" containerID="cri-o://6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18" gracePeriod=30 Sep 07 21:04:25.516260 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.516230 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:04:25.643853 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.643744 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5p5v\" (UniqueName: \"kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-kube-api-access-d5p5v\") pod \"87b64ece-77d5-4271-8b9d-7e5473d24f29\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " Sep 07 21:04:25.643853 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.643786 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b64ece-77d5-4271-8b9d-7e5473d24f29-local-certs\") pod \"87b64ece-77d5-4271-8b9d-7e5473d24f29\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " Sep 07 21:04:25.643853 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.643853 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-kubeconfig\") pod \"87b64ece-77d5-4271-8b9d-7e5473d24f29\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " Sep 07 21:04:25.644508 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.643885 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-ca-configmap\") pod \"87b64ece-77d5-4271-8b9d-7e5473d24f29\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " Sep 07 21:04:25.644508 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.643925 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-dns-cert\") pod \"87b64ece-77d5-4271-8b9d-7e5473d24f29\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " Sep 07 21:04:25.644508 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.643990 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-cacerts\") pod \"87b64ece-77d5-4271-8b9d-7e5473d24f29\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " Sep 07 21:04:25.644508 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.644012 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-token\") pod \"87b64ece-77d5-4271-8b9d-7e5473d24f29\" (UID: \"87b64ece-77d5-4271-8b9d-7e5473d24f29\") " Sep 07 21:04:25.644846 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.644814 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "87b64ece-77d5-4271-8b9d-7e5473d24f29" (UID: "87b64ece-77d5-4271-8b9d-7e5473d24f29"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 21:04:25.646199 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.646163 2578 generic.go:356] "Generic (PLEG): container finished" podID="87b64ece-77d5-4271-8b9d-7e5473d24f29" containerID="6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18" exitCode=0 Sep 07 21:04:25.647962 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.646639 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" Sep 07 21:04:25.647962 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.646663 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" event={"ID":"87b64ece-77d5-4271-8b9d-7e5473d24f29","Type":"ContainerDied","Data":"6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18"} Sep 07 21:04:25.647962 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.647292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt" event={"ID":"87b64ece-77d5-4271-8b9d-7e5473d24f29","Type":"ContainerDied","Data":"187ceafe6250bbff8c79d63adb1c6e24402b2d885ffcf4e5f322229059d9ceb9"} Sep 07 21:04:25.647962 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.647369 2578 scope.go:117] "RemoveContainer" containerID="6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18" Sep 07 21:04:25.647962 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.647650 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-kube-api-access-d5p5v" (OuterVolumeSpecName: "kube-api-access-d5p5v") pod "87b64ece-77d5-4271-8b9d-7e5473d24f29" (UID: "87b64ece-77d5-4271-8b9d-7e5473d24f29"). InnerVolumeSpecName "kube-api-access-d5p5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 21:04:25.647962 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.647723 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "87b64ece-77d5-4271-8b9d-7e5473d24f29" (UID: "87b64ece-77d5-4271-8b9d-7e5473d24f29"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 21:04:25.647962 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.647757 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-cacerts" (OuterVolumeSpecName: "cacerts") pod "87b64ece-77d5-4271-8b9d-7e5473d24f29" (UID: "87b64ece-77d5-4271-8b9d-7e5473d24f29"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 21:04:25.647962 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.647804 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-token" (OuterVolumeSpecName: "istio-token") pod "87b64ece-77d5-4271-8b9d-7e5473d24f29" (UID: "87b64ece-77d5-4271-8b9d-7e5473d24f29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 21:04:25.648528 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.648105 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87b64ece-77d5-4271-8b9d-7e5473d24f29-local-certs" (OuterVolumeSpecName: "local-certs") pod "87b64ece-77d5-4271-8b9d-7e5473d24f29" (UID: "87b64ece-77d5-4271-8b9d-7e5473d24f29"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 21:04:25.649073 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.648963 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "87b64ece-77d5-4271-8b9d-7e5473d24f29" (UID: "87b64ece-77d5-4271-8b9d-7e5473d24f29"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 21:04:25.650506 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.650477 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" event={"ID":"b0f14214-c890-4d50-915b-e03d1a1463e5","Type":"ContainerStarted","Data":"546d6d053109ae6390203eb217888bd7ad3d35a54ba29c0c0e93912ee8cb8e14"} Sep 07 21:04:25.650684 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.650667 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:25.665198 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.665171 2578 scope.go:117] "RemoveContainer" containerID="6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18" Sep 07 21:04:25.665595 ip-10-0-140-24 kubenswrapper[2578]: E0907 21:04:25.665572 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18\": container with ID starting with 6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18 not found: ID does not exist" containerID="6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18" Sep 07 21:04:25.665670 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.665612 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18"} err="failed to get container status \"6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18\": rpc error: code = NotFound desc = could not find container \"6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18\": container with ID starting with 6aaa1ecf94d0246b79286d7ebfc31b308253d9ce3a8434c34a10f70ad8e32d18 not found: ID does not exist" Sep 07 21:04:25.669845 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.669794 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" podStartSLOduration=1.800106869 podStartE2EDuration="4.669777519s" totalImagesPullingTime="2.86967065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:04:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:04:25.66752085 +0000 UTC m=+431.955890129" watchObservedRunningTime="2026-09-07 21:04:25.669777519 +0000 UTC m=+431.958146799" Sep 07 21:04:25.746228 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.746194 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-dns-cert\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:25.746228 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.746226 2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-cacerts\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:25.746515 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.746239 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-token\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:25.746515 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.746253 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5p5v\" (UniqueName: \"kubernetes.io/projected/87b64ece-77d5-4271-8b9d-7e5473d24f29-kube-api-access-d5p5v\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:25.746515 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.746264 2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b64ece-77d5-4271-8b9d-7e5473d24f29-local-certs\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:25.746515 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.746276 2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-kubeconfig\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:25.746515 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.746287 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87b64ece-77d5-4271-8b9d-7e5473d24f29-istio-csr-ca-configmap\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:25.969878 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.969839 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt"] Sep 07 21:04:25.974082 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:25.974049 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9s2bt"] Sep 07 21:04:26.318876 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:26.318844 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87b64ece-77d5-4271-8b9d-7e5473d24f29" path="/var/lib/kubelet/pods/87b64ece-77d5-4271-8b9d-7e5473d24f29/volumes" Sep 07 21:04:28.288196 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.288143 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8495b89769-shmbx" podUID="842a5300-cf0b-4ed5-9297-0bd7bde19b4b" containerName="console" containerID="cri-o://1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6" gracePeriod=15 Sep 07 21:04:28.528440 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.528412 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:04:28.673755 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.673660 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-service-ca\") pod \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " Sep 07 21:04:28.673755 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.673701 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-trusted-ca-bundle\") pod \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " Sep 07 21:04:28.673755 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.673756 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-serving-cert\") pod \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " Sep 07 21:04:28.674273 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.673797 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwqg4\" (UniqueName: \"kubernetes.io/projected/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-kube-api-access-pwqg4\") pod \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " Sep 07 21:04:28.674273 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.673821 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-oauth-config\") pod \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " Sep 07 21:04:28.674273 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.673889 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-config\") pod \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " Sep 07 21:04:28.674273 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.673926 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-oauth-serving-cert\") pod \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\" (UID: \"842a5300-cf0b-4ed5-9297-0bd7bde19b4b\") " Sep 07 21:04:28.674273 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.674258 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-service-ca" (OuterVolumeSpecName: "service-ca") pod "842a5300-cf0b-4ed5-9297-0bd7bde19b4b" (UID: "842a5300-cf0b-4ed5-9297-0bd7bde19b4b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 21:04:28.674524 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.674274 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "842a5300-cf0b-4ed5-9297-0bd7bde19b4b" (UID: "842a5300-cf0b-4ed5-9297-0bd7bde19b4b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 21:04:28.674524 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.674355 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-config" (OuterVolumeSpecName: "console-config") pod "842a5300-cf0b-4ed5-9297-0bd7bde19b4b" (UID: "842a5300-cf0b-4ed5-9297-0bd7bde19b4b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 21:04:28.674618 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.674514 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "842a5300-cf0b-4ed5-9297-0bd7bde19b4b" (UID: "842a5300-cf0b-4ed5-9297-0bd7bde19b4b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 21:04:28.675857 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.675830 2578 generic.go:356] "Generic (PLEG): container finished" podID="842a5300-cf0b-4ed5-9297-0bd7bde19b4b" containerID="1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6" exitCode=0 Sep 07 21:04:28.675989 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.675901 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8495b89769-shmbx" Sep 07 21:04:28.675989 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.675908 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8495b89769-shmbx" event={"ID":"842a5300-cf0b-4ed5-9297-0bd7bde19b4b","Type":"ContainerDied","Data":"1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6"} Sep 07 21:04:28.676129 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.676003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8495b89769-shmbx" event={"ID":"842a5300-cf0b-4ed5-9297-0bd7bde19b4b","Type":"ContainerDied","Data":"a8db972f16ff696dba335013c875e15049e323594bce8688f1d31d1beb2346bf"} Sep 07 21:04:28.676129 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.676050 2578 scope.go:117] "RemoveContainer" containerID="1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6" Sep 07 21:04:28.676518 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.676493 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "842a5300-cf0b-4ed5-9297-0bd7bde19b4b" (UID: "842a5300-cf0b-4ed5-9297-0bd7bde19b4b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 21:04:28.676623 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.676556 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "842a5300-cf0b-4ed5-9297-0bd7bde19b4b" (UID: "842a5300-cf0b-4ed5-9297-0bd7bde19b4b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 21:04:28.676716 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.676691 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-kube-api-access-pwqg4" (OuterVolumeSpecName: "kube-api-access-pwqg4") pod "842a5300-cf0b-4ed5-9297-0bd7bde19b4b" (UID: "842a5300-cf0b-4ed5-9297-0bd7bde19b4b"). InnerVolumeSpecName "kube-api-access-pwqg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 21:04:28.695728 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.695703 2578 scope.go:117] "RemoveContainer" containerID="1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6" Sep 07 21:04:28.696092 ip-10-0-140-24 kubenswrapper[2578]: E0907 21:04:28.696070 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6\": container with ID starting with 1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6 not found: ID does not exist" containerID="1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6" Sep 07 21:04:28.696144 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.696106 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6"} err="failed to get container status \"1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6\": rpc error: code = NotFound desc = could not find container \"1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6\": container with ID starting with 1a3636b6b580ebbd93b327f570f2dcea6242a5d15751e750878a6983130db6f6 not found: ID does not exist" Sep 07 21:04:28.774907 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.774864 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwqg4\" (UniqueName: \"kubernetes.io/projected/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-kube-api-access-pwqg4\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:28.774907 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.774901 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-oauth-config\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:28.774907 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.774911 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-config\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:28.775134 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.774920 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-oauth-serving-cert\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:28.775134 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.774931 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-service-ca\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:28.775134 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.774940 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-trusted-ca-bundle\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:28.775134 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:28.774949 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/842a5300-cf0b-4ed5-9297-0bd7bde19b4b-console-serving-cert\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Sep 07 21:04:29.002501 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.002463 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8495b89769-shmbx"] Sep 07 21:04:29.013402 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.013364 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8495b89769-shmbx"] Sep 07 21:04:29.066393 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.066357 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb"] Sep 07 21:04:29.066734 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.066720 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b64ece-77d5-4271-8b9d-7e5473d24f29" containerName="discovery" Sep 07 21:04:29.066774 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.066738 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b64ece-77d5-4271-8b9d-7e5473d24f29" containerName="discovery" Sep 07 21:04:29.066774 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.066760 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842a5300-cf0b-4ed5-9297-0bd7bde19b4b" containerName="console" Sep 07 21:04:29.066774 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.066769 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="842a5300-cf0b-4ed5-9297-0bd7bde19b4b" containerName="console" Sep 07 21:04:29.066915 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.066874 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="87b64ece-77d5-4271-8b9d-7e5473d24f29" containerName="discovery" Sep 07 21:04:29.066915 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.066890 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="842a5300-cf0b-4ed5-9297-0bd7bde19b4b" containerName="console" Sep 07 21:04:29.070093 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.070072 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.073049 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.073015 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 07 21:04:29.073183 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.073059 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 07 21:04:29.073183 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.073059 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4dmck\"" Sep 07 21:04:29.080570 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.080540 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb"] Sep 07 21:04:29.177977 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.177937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knr4f\" (UniqueName: \"kubernetes.io/projected/e24825c0-4f5f-4858-a1fa-9b262b18528c-kube-api-access-knr4f\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.178182 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.177986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e24825c0-4f5f-4858-a1fa-9b262b18528c-openshift-service-ca\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.178182 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.178095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e24825c0-4f5f-4858-a1fa-9b262b18528c-maas-api-tls\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.178288 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.178186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e24825c0-4f5f-4858-a1fa-9b262b18528c-metrics-certs\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.279090 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.278974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knr4f\" (UniqueName: \"kubernetes.io/projected/e24825c0-4f5f-4858-a1fa-9b262b18528c-kube-api-access-knr4f\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.279090 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.279040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e24825c0-4f5f-4858-a1fa-9b262b18528c-openshift-service-ca\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.279090 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.279084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e24825c0-4f5f-4858-a1fa-9b262b18528c-maas-api-tls\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.279401 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.279196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e24825c0-4f5f-4858-a1fa-9b262b18528c-metrics-certs\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.279884 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.279860 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e24825c0-4f5f-4858-a1fa-9b262b18528c-openshift-service-ca\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.281781 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.281760 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e24825c0-4f5f-4858-a1fa-9b262b18528c-metrics-certs\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.281880 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.281824 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e24825c0-4f5f-4858-a1fa-9b262b18528c-maas-api-tls\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.291815 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.291793 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knr4f\" (UniqueName: \"kubernetes.io/projected/e24825c0-4f5f-4858-a1fa-9b262b18528c-kube-api-access-knr4f\") pod \"maas-api-78cb79bdfd-fjcqb\" (UID: \"e24825c0-4f5f-4858-a1fa-9b262b18528c\") " pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.381925 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.381882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:29.655941 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.655701 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb"] Sep 07 21:04:29.658967 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:04:29.658936 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24825c0_4f5f_4858_a1fa_9b262b18528c.slice/crio-7d90a9e5814cbebd6825b95b5ec87786d93b839678163790099fd52d3e552203 WatchSource:0}: Error finding container 7d90a9e5814cbebd6825b95b5ec87786d93b839678163790099fd52d3e552203: Status 404 returned error can't find the container with id 7d90a9e5814cbebd6825b95b5ec87786d93b839678163790099fd52d3e552203 Sep 07 21:04:29.682785 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:29.682750 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" event={"ID":"e24825c0-4f5f-4858-a1fa-9b262b18528c","Type":"ContainerStarted","Data":"7d90a9e5814cbebd6825b95b5ec87786d93b839678163790099fd52d3e552203"} Sep 07 21:04:30.318433 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:30.318398 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="842a5300-cf0b-4ed5-9297-0bd7bde19b4b" path="/var/lib/kubelet/pods/842a5300-cf0b-4ed5-9297-0bd7bde19b4b/volumes" Sep 07 21:04:31.694939 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:31.694889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" event={"ID":"e24825c0-4f5f-4858-a1fa-9b262b18528c","Type":"ContainerStarted","Data":"aa2f39528175f772b38de1520383b791cd83f8afaf88d95358903f60560be081"} Sep 07 21:04:31.695369 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:31.695034 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:04:31.714931 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:31.714865 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" podStartSLOduration=1.299522275 podStartE2EDuration="2.714845754s" totalImagesPullingTime="1.415323479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:04:31.712217326 +0000 UTC m=+438.000586609" watchObservedRunningTime="2026-09-07 21:04:31.714845754 +0000 UTC m=+438.003215034" Sep 07 21:04:34.640465 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:34.640425 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7z2hx" Sep 07 21:04:35.653509 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:35.653477 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-wb8rt" Sep 07 21:04:36.659884 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:36.659804 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-bb7b75cc4-pw92s" Sep 07 21:04:37.705989 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:04:37.705957 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-78cb79bdfd-fjcqb" Sep 07 21:05:41.468233 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.468188 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl"] Sep 07 21:05:41.473888 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.473856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.476893 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.476846 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 07 21:05:41.478188 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.477969 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qsw72\"" Sep 07 21:05:41.478188 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.478033 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 07 21:05:41.478188 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.477979 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 07 21:05:41.484876 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.484019 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl"] Sep 07 21:05:41.550095 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.550048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.550508 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.550138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.550508 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.550209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.550508 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.550237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d406775c-3085-4ab4-a79e-bddabe74f76e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.550508 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.550257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.550508 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.550425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9k5k\" (UniqueName: \"kubernetes.io/projected/d406775c-3085-4ab4-a79e-bddabe74f76e-kube-api-access-h9k5k\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.651647 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.651603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9k5k\" (UniqueName: \"kubernetes.io/projected/d406775c-3085-4ab4-a79e-bddabe74f76e-kube-api-access-h9k5k\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.651812 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.651715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.651812 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.651756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.651913 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.651818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.651913 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.651862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d406775c-3085-4ab4-a79e-bddabe74f76e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.651913 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.651890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.652201 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.652177 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.652256 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.652208 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.652376 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.652358 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.654245 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.654222 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d406775c-3085-4ab4-a79e-bddabe74f76e-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.654418 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.654404 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d406775c-3085-4ab4-a79e-bddabe74f76e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.660242 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.660216 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9k5k\" (UniqueName: \"kubernetes.io/projected/d406775c-3085-4ab4-a79e-bddabe74f76e-kube-api-access-h9k5k\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-8fphl\" (UID: \"d406775c-3085-4ab4-a79e-bddabe74f76e\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:41.788441 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:41.788390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:42.065897 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:42.065871 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl"] Sep 07 21:05:42.068114 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:05:42.068084 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd406775c_3085_4ab4_a79e_bddabe74f76e.slice/crio-3466af975d7e4eb85ff96d8c0ca9a4dd70d4b1b72024b493127f1a2feb7a6d8b WatchSource:0}: Error finding container 3466af975d7e4eb85ff96d8c0ca9a4dd70d4b1b72024b493127f1a2feb7a6d8b: Status 404 returned error can't find the container with id 3466af975d7e4eb85ff96d8c0ca9a4dd70d4b1b72024b493127f1a2feb7a6d8b Sep 07 21:05:43.063393 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:43.063355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" event={"ID":"d406775c-3085-4ab4-a79e-bddabe74f76e","Type":"ContainerStarted","Data":"3466af975d7e4eb85ff96d8c0ca9a4dd70d4b1b72024b493127f1a2feb7a6d8b"} Sep 07 21:05:44.070796 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:44.070750 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" event={"ID":"d406775c-3085-4ab4-a79e-bddabe74f76e","Type":"ContainerStarted","Data":"e02244b78d3ac9cf731d0fe251450aa85a3a9a9fd90534cb0ce48b0a7513979e"} Sep 07 21:05:44.088205 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:44.088146 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" podStartSLOduration=2.122186122 podStartE2EDuration="3.088128205s" totalImagesPullingTime="965.942083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:05:44.086685723 +0000 UTC m=+510.375055004" watchObservedRunningTime="2026-09-07 21:05:44.088128205 +0000 UTC m=+510.376497483" Sep 07 21:05:44.788912 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:44.788871 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:51.788700 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:51.788661 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:51.801872 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:51.801838 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:05:52.121727 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:05:52.121635 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-8fphl" Sep 07 21:07:14.269802 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:07:14.269765 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/2.log" Sep 07 21:07:14.270425 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:07:14.270110 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/2.log" Sep 07 21:07:14.281561 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:07:14.281530 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-acl-logging/0.log" Sep 07 21:07:14.281773 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:07:14.281532 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-acl-logging/0.log" Sep 07 21:08:03.895003 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:03.894965 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-9hdpt_eb1feaac-c016-44cc-a6f8-b85336170fd2/manager/0.log" Sep 07 21:08:04.356719 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:04.356683 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-bb7b75cc4-pw92s_b0f14214-c890-4d50-915b-e03d1a1463e5/manager/0.log" Sep 07 21:08:04.686490 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:04.686408 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-78cb79bdfd-fjcqb_e24825c0-4f5f-4858-a1fa-9b262b18528c/maas-api/0.log" Sep 07 21:08:04.793659 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:04.793631 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-d26pb_abfebae6-f2c5-46d2-a233-d60f35f880b1/postgres/0.log" Sep 07 21:08:06.701642 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:06.701589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xx2jp_93777457-8356-4721-9caa-bb7ab41d1d5d/discovery/0.log" Sep 07 21:08:06.807536 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:06.807495 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd8c6c7d4-wlnbn_08d4b66e-d613-4a37-a458-584a20a92d7c/kube-auth-proxy/0.log" Sep 07 21:08:07.236518 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:07.236482 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7z2hx_5f89942b-7153-4786-9e76-82cf05c2dc50/payload-pre-processing/0.log" Sep 07 21:08:07.351884 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:07.351851 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wb8rt_79a4514f-df2e-420c-8574-f29b4495d7b1/payload-processing/0.log" Sep 07 21:08:07.457897 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:07.457867 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78f5cf9fdb-j7c82_d0541c9c-1195-40f0-a412-76512e40f592/router/0.log" Sep 07 21:08:07.899035 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:07.899005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5d57fc946d-8fphl_d406775c-3085-4ab4-a79e-bddabe74f76e/main/0.log" Sep 07 21:08:16.416627 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:16.416592 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-khvqk_6b417cb6-1545-46c2-86bf-f4b5fbffafa7/global-pull-secret-syncer/0.log" Sep 07 21:08:16.524078 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:16.524043 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hk9kl_8a55519a-9408-423e-a1f7-219e9c9c4d22/konnectivity-agent/0.log" Sep 07 21:08:16.620838 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:16.620809 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-24.ec2.internal_87d2f7628ee920e5b6f01791cc8df082/haproxy/0.log" Sep 07 21:08:22.699678 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:22.699647 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8f86be6e-6786-4d58-8276-85ca7f0c0951/alertmanager/0.log" Sep 07 21:08:22.726639 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:22.726599 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8f86be6e-6786-4d58-8276-85ca7f0c0951/config-reloader/0.log" Sep 07 21:08:22.747831 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:22.747790 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8f86be6e-6786-4d58-8276-85ca7f0c0951/kube-rbac-proxy-web/0.log" Sep 07 21:08:22.769954 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:22.769922 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8f86be6e-6786-4d58-8276-85ca7f0c0951/kube-rbac-proxy/0.log" Sep 07 21:08:22.792066 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:22.792032 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8f86be6e-6786-4d58-8276-85ca7f0c0951/kube-rbac-proxy-metric/0.log" Sep 07 21:08:22.813559 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:22.813526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8f86be6e-6786-4d58-8276-85ca7f0c0951/prom-label-proxy/0.log" Sep 07 21:08:22.838725 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:22.838695 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8f86be6e-6786-4d58-8276-85ca7f0c0951/init-config-reloader/0.log" Sep 07 21:08:22.871154 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:22.871117 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-jl648_69ac1738-084d-40e5-b4c1-0bfb0a28cc20/cluster-monitoring-operator/0.log" Sep 07 21:08:22.976148 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:22.976065 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c7dd5847b-xqp5z_6f3b2b65-6539-4442-8712-72afaa26dbfd/metrics-server/0.log" Sep 07 21:08:23.041131 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:23.041100 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8jgjt_ee996f6f-f088-4e7d-8660-c9b9883c77f7/node-exporter/0.log" Sep 07 21:08:23.063305 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:23.063273 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8jgjt_ee996f6f-f088-4e7d-8660-c9b9883c77f7/kube-rbac-proxy/0.log" Sep 07 21:08:23.084932 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:23.084901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8jgjt_ee996f6f-f088-4e7d-8660-c9b9883c77f7/init-textfile/0.log" Sep 07 21:08:23.649450 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:23.649412 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-867f8f95dc-p44xc_926d68a2-a440-4104-af72-16bc21378a5f/telemeter-client/0.log" Sep 07 21:08:23.677494 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:23.677467 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-867f8f95dc-p44xc_926d68a2-a440-4104-af72-16bc21378a5f/reload/0.log" Sep 07 21:08:23.709249 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:23.709199 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-867f8f95dc-p44xc_926d68a2-a440-4104-af72-16bc21378a5f/kube-rbac-proxy/0.log" Sep 07 21:08:25.936185 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:25.936148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/2.log" Sep 07 21:08:25.940304 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:25.940277 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ltdbr_d3d892ed-a6fc-4809-a773-17bc6344b8ee/console-operator/3.log" Sep 07 21:08:26.530703 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.530656 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg"] Sep 07 21:08:26.534662 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.534632 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.537246 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.537219 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l2452\"/\"openshift-service-ca.crt\"" Sep 07 21:08:26.538233 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.538212 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l2452\"/\"default-dockercfg-j5ftn\"" Sep 07 21:08:26.538353 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.538228 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l2452\"/\"kube-root-ca.crt\"" Sep 07 21:08:26.544503 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.544474 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg"] Sep 07 21:08:26.654294 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.654233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-podres\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.654548 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.654383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-sys\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.654548 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.654459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vngg\" (UniqueName: \"kubernetes.io/projected/1f673e0e-42aa-4da6-a425-be9ae90244c6-kube-api-access-9vngg\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.654548 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.654493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-proc\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.654674 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.654552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-lib-modules\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.755268 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.755205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-lib-modules\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.755528 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.755341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-podres\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.755528 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.755410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-sys\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.755528 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.755441 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-lib-modules\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.755528 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.755468 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-podres\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.755528 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.755448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vngg\" (UniqueName: \"kubernetes.io/projected/1f673e0e-42aa-4da6-a425-be9ae90244c6-kube-api-access-9vngg\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.755528 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.755515 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-sys\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.755835 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.755534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-proc\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.755835 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.755595 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f673e0e-42aa-4da6-a425-be9ae90244c6-proc\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.763443 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.763413 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vngg\" (UniqueName: \"kubernetes.io/projected/1f673e0e-42aa-4da6-a425-be9ae90244c6-kube-api-access-9vngg\") pod \"perf-node-gather-daemonset-7hmbg\" (UID: \"1f673e0e-42aa-4da6-a425-be9ae90244c6\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:26.846822 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:26.846719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:27.121488 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:27.121456 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg"] Sep 07 21:08:27.123440 ip-10-0-140-24 kubenswrapper[2578]: W0907 21:08:27.123400 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1f673e0e_42aa_4da6_a425_be9ae90244c6.slice/crio-dc0cdcbbe8cb8c4c6a9d0e84c0e4eb4d91307ad6b8ec4e6c7e51b7946c5609b0 WatchSource:0}: Error finding container dc0cdcbbe8cb8c4c6a9d0e84c0e4eb4d91307ad6b8ec4e6c7e51b7946c5609b0: Status 404 returned error can't find the container with id dc0cdcbbe8cb8c4c6a9d0e84c0e4eb4d91307ad6b8ec4e6c7e51b7946c5609b0 Sep 07 21:08:27.251470 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:27.251437 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-7d2ph_3bc72d5f-9125-45b4-9273-f9cd44a04d48/volume-data-source-validator/0.log" Sep 07 21:08:27.905357 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:27.905301 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" event={"ID":"1f673e0e-42aa-4da6-a425-be9ae90244c6","Type":"ContainerStarted","Data":"232c3bcf93622b9efcdb8a96e7c096b1518556368e4188b57b7b579947fa2b9e"} Sep 07 21:08:27.905572 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:27.905384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" event={"ID":"1f673e0e-42aa-4da6-a425-be9ae90244c6","Type":"ContainerStarted","Data":"dc0cdcbbe8cb8c4c6a9d0e84c0e4eb4d91307ad6b8ec4e6c7e51b7946c5609b0"} Sep 07 21:08:27.905572 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:27.905504 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:27.920913 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:27.920847 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" podStartSLOduration=1.9208282859999999 podStartE2EDuration="1.920828286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:08:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:27.920070982 +0000 UTC m=+674.208440262" watchObservedRunningTime="2026-09-07 21:08:27.920828286 +0000 UTC m=+674.209197565" Sep 07 21:08:28.394642 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:28.394615 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z69sv_3de72ff3-7df7-43cc-9280-ec499a500b25/dns/0.log" Sep 07 21:08:28.419228 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:28.419196 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z69sv_3de72ff3-7df7-43cc-9280-ec499a500b25/kube-rbac-proxy/0.log" Sep 07 21:08:28.443146 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:28.443118 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4fcrz_6f5cbd85-da5a-4640-81f4-1e0761ae9d52/dns-node-resolver/0.log" Sep 07 21:08:29.013902 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:29.013860 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-886bb9cd9-8g86m_2dc4ed2e-2954-4bcb-bf86-88c4dc8e3411/registry/0.log" Sep 07 21:08:29.089539 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:29.089511 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v64xb_413611dd-75b5-46b7-b195-0365dafba1c3/node-ca/0.log" Sep 07 21:08:30.055728 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:30.055692 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xx2jp_93777457-8356-4721-9caa-bb7ab41d1d5d/discovery/0.log" Sep 07 21:08:30.076236 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:30.076202 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd8c6c7d4-wlnbn_08d4b66e-d613-4a37-a458-584a20a92d7c/kube-auth-proxy/0.log" Sep 07 21:08:30.180336 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:30.180279 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7z2hx_5f89942b-7153-4786-9e76-82cf05c2dc50/payload-pre-processing/0.log" Sep 07 21:08:30.204554 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:30.204522 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wb8rt_79a4514f-df2e-420c-8574-f29b4495d7b1/payload-processing/0.log" Sep 07 21:08:30.233080 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:30.233049 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78f5cf9fdb-j7c82_d0541c9c-1195-40f0-a412-76512e40f592/router/0.log" Sep 07 21:08:30.883461 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:30.883434 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bdgh2_9ddcc02c-42d3-4264-95da-60499be1e3de/serve-healthcheck-canary/0.log" Sep 07 21:08:31.400782 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:31.400748 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-dkmlh_92b58442-c40e-4135-8ac0-7b9cfaa800b0/insights-operator/0.log" Sep 07 21:08:31.401247 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:31.401068 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-dkmlh_92b58442-c40e-4135-8ac0-7b9cfaa800b0/insights-operator/1.log" Sep 07 21:08:31.421287 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:31.421255 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hph6v_00e98e45-7d53-41aa-9550-b1afa6963552/kube-rbac-proxy/0.log" Sep 07 21:08:31.442655 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:31.442626 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hph6v_00e98e45-7d53-41aa-9550-b1afa6963552/exporter/0.log" Sep 07 21:08:31.465032 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:31.465000 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hph6v_00e98e45-7d53-41aa-9550-b1afa6963552/extractor/0.log" Sep 07 21:08:33.812744 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:33.812716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-84dd88468f-b45cm_c938cfa0-db7d-4d53-8966-320364d6d028/manager/0.log" Sep 07 21:08:33.833004 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:33.832966 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-84dd88468f-b45cm_c938cfa0-db7d-4d53-8966-320364d6d028/copy-manifests/0.log" Sep 07 21:08:33.920762 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:33.920733 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-7hmbg" Sep 07 21:08:35.548184 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:35.548149 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xx2jp_93777457-8356-4721-9caa-bb7ab41d1d5d/discovery/0.log" Sep 07 21:08:35.558944 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:35.558911 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd8c6c7d4-wlnbn_08d4b66e-d613-4a37-a458-584a20a92d7c/kube-auth-proxy/0.log" Sep 07 21:08:35.638911 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:35.638880 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7z2hx_5f89942b-7153-4786-9e76-82cf05c2dc50/payload-pre-processing/0.log" Sep 07 21:08:35.658503 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:35.658423 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wb8rt_79a4514f-df2e-420c-8574-f29b4495d7b1/payload-processing/0.log" Sep 07 21:08:35.680701 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:35.680673 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78f5cf9fdb-j7c82_d0541c9c-1195-40f0-a412-76512e40f592/router/0.log" Sep 07 21:08:35.810958 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:35.810930 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-9hdpt_eb1feaac-c016-44cc-a6f8-b85336170fd2/manager/0.log" Sep 07 21:08:35.937178 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:35.937096 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-bb7b75cc4-pw92s_b0f14214-c890-4d50-915b-e03d1a1463e5/manager/0.log" Sep 07 21:08:37.000039 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:37.000001 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xx2jp_93777457-8356-4721-9caa-bb7ab41d1d5d/discovery/0.log" Sep 07 21:08:37.010759 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:37.010729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd8c6c7d4-wlnbn_08d4b66e-d613-4a37-a458-584a20a92d7c/kube-auth-proxy/0.log" Sep 07 21:08:37.075652 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:37.075615 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7z2hx_5f89942b-7153-4786-9e76-82cf05c2dc50/payload-pre-processing/0.log" Sep 07 21:08:37.092959 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:37.092923 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wb8rt_79a4514f-df2e-420c-8574-f29b4495d7b1/payload-processing/0.log" Sep 07 21:08:37.110840 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:37.110804 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78f5cf9fdb-j7c82_d0541c9c-1195-40f0-a412-76512e40f592/router/0.log" Sep 07 21:08:41.276993 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:41.276957 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-f5xkt_02a152af-b7b3-4657-b287-9bce30e6bf8d/kube-storage-version-migrator-operator/1.log" Sep 07 21:08:41.277891 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:41.277873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-f5xkt_02a152af-b7b3-4657-b287-9bce30e6bf8d/kube-storage-version-migrator-operator/0.log" Sep 07 21:08:42.260296 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:42.260264 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9kn7f_a24e9820-cf22-4400-a4a9-574a117eb986/kube-multus/0.log" Sep 07 21:08:42.282143 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:42.282112 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29pbq_1b594e18-f02a-440a-b194-0e353c2177eb/kube-multus-additional-cni-plugins/0.log" Sep 07 21:08:42.303377 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:42.303349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29pbq_1b594e18-f02a-440a-b194-0e353c2177eb/egress-router-binary-copy/0.log" Sep 07 21:08:42.324569 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:42.324538 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29pbq_1b594e18-f02a-440a-b194-0e353c2177eb/cni-plugins/0.log" Sep 07 21:08:42.347222 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:42.347185 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29pbq_1b594e18-f02a-440a-b194-0e353c2177eb/bond-cni-plugin/0.log" Sep 07 21:08:42.368414 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:42.368385 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29pbq_1b594e18-f02a-440a-b194-0e353c2177eb/routeoverride-cni/0.log" Sep 07 21:08:42.389441 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:42.389412 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29pbq_1b594e18-f02a-440a-b194-0e353c2177eb/whereabouts-cni-bincopy/0.log" Sep 07 21:08:42.416460 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:42.416428 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29pbq_1b594e18-f02a-440a-b194-0e353c2177eb/whereabouts-cni/0.log" Sep 07 21:08:42.813103 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:42.813071 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5645v_af830417-6366-47ce-868f-221f859ff24e/network-metrics-daemon/0.log" Sep 07 21:08:42.833252 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:42.833213 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5645v_af830417-6366-47ce-868f-221f859ff24e/kube-rbac-proxy/0.log" Sep 07 21:08:43.753730 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:43.753701 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-controller/0.log" Sep 07 21:08:43.775074 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:43.775041 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-acl-logging/0.log" Sep 07 21:08:43.775074 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:43.775073 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovn-acl-logging/1.log" Sep 07 21:08:43.794342 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:43.794296 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/kube-rbac-proxy-node/0.log" Sep 07 21:08:43.814355 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:43.814325 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 21:08:43.834397 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:43.834365 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/northd/0.log" Sep 07 21:08:43.855167 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:43.855135 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/nbdb/0.log" Sep 07 21:08:43.879116 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:43.879082 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/sbdb/0.log" Sep 07 21:08:43.919233 ip-10-0-140-24 kubenswrapper[2578]: I0907 21:08:43.919202 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qjfq_ea5b378c-0a95-47ad-9771-b8685555c45c/ovnkube-controller/0.log"