Sep 15 12:31:56.039028 ip-10-0-140-90 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 15 12:31:56.039045 ip-10-0-140-90 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 15 12:31:56.039055 ip-10-0-140-90 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 15 12:31:56.039547 ip-10-0-140-90 systemd[1]: Failed to start Kubernetes Kubelet. Sep 15 12:32:06.082957 ip-10-0-140-90 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 15 12:32:06.082976 ip-10-0-140-90 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d767c05319b2446593dd61b03439d5d2 -- Sep 15 12:34:01.838441 ip-10-0-140-90 systemd[1]: Starting Kubernetes Kubelet... Sep 15 12:34:02.269244 ip-10-0-140-90 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 12:34:02.269244 ip-10-0-140-90 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 15 12:34:02.269244 ip-10-0-140-90 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 12:34:02.269244 ip-10-0-140-90 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 15 12:34:02.269244 ip-10-0-140-90 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 12:34:02.269824 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.269302 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274915 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274931 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274934 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274937 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274940 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274943 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274947 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274949 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274952 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274954 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274958 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274961 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274963 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274966 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274968 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274971 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274979 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274981 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274984 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:34:02.275517 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274987 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274989 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274993 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.274997 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275001 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275004 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275007 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275009 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275012 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275014 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275017 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275020 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275023 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275026 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275029 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275032 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275034 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275037 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275040 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:34:02.280781 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275043 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275045 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275048 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275058 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275063 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275065 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275068 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275070 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275073 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275075 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275078 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275080 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275083 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275085 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275087 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275090 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275093 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275095 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275097 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:34:02.281263 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275100 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275103 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275107 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275110 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275115 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275118 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275121 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275124 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275127 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275130 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275133 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275135 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275138 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275141 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275144 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275146 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275149 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275151 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275154 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:34:02.281721 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275169 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275172 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275174 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275177 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275179 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275182 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275184 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275187 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275189 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275191 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275194 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275196 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275199 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275201 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275204 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275207 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275210 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275212 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275214 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275217 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:34:02.282187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275219 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275222 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275225 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275925 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275931 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275934 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275937 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275940 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275943 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275946 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275948 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275951 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275954 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275956 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275960 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275965 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275967 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275970 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275972 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275975 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:34:02.282667 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275977 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275981 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275985 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275988 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275991 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275994 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275996 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.275999 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276002 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276005 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276008 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276011 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276014 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276017 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276019 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276022 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276024 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276027 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276029 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:34:02.283181 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276032 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276034 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276037 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276040 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276042 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276045 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276048 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276050 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276053 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276055 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276058 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276060 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276063 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276065 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276068 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276070 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276072 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276076 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276090 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:34:02.283677 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276094 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276097 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276099 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276102 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276112 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276115 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276117 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276120 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276123 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276125 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276128 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276130 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276133 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276135 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276137 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276140 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276143 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276146 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276148 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276151 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:34:02.284137 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276153 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276156 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276178 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276181 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276184 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276186 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276189 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276191 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276194 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276196 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276199 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276202 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276204 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276207 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276210 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276212 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276215 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276217 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276220 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:34:02.284644 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276223 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276225 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276228 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276230 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276232 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276611 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276615 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276619 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276621 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276624 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276627 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276629 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276632 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276634 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276637 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276639 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276642 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276645 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276647 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276650 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:34:02.285250 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276652 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276655 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276658 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276660 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276663 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276665 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276668 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276681 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276684 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276686 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276689 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276691 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276694 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276696 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276699 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276702 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276704 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276706 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276709 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276712 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:34:02.285733 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276714 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276717 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276719 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276723 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276726 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276729 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276732 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276734 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276737 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276739 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276742 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276744 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276747 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276749 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276752 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276754 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276757 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276759 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276761 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:34:02.286236 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276764 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276766 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276768 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276771 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276775 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276778 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276780 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276783 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276799 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276802 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276806 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276810 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276812 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276815 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276818 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276821 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276825 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276828 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276831 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276833 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:34:02.286738 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276836 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276839 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276841 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276845 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276849 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276853 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276856 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276859 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276861 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276863 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276866 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276868 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276871 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276873 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276876 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276878 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276882 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276884 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276887 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:34:02.287259 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276889 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276891 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276894 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276897 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276899 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.276902 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.276976 2577 flags.go:64] FLAG: --address="0.0.0.0" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277023 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277031 2577 flags.go:64] FLAG: --anonymous-auth="true" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277036 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277040 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277043 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277047 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277063 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277066 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277069 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277072 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277075 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277080 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277083 2577 flags.go:64] FLAG: --cgroup-root="" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277086 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277089 2577 flags.go:64] FLAG: --client-ca-file="" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277091 2577 flags.go:64] FLAG: --cloud-provider="external" Sep 15 12:34:02.287710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277094 2577 flags.go:64] FLAG: --cluster-dns="[]" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277097 2577 flags.go:64] FLAG: --cluster-domain="" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277100 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277104 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277107 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277110 2577 flags.go:64] FLAG: --container-log-max-files="5" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277115 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277118 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277121 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277124 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277127 2577 flags.go:64] FLAG: --contention-profiling="false" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277130 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277132 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277135 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277138 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277142 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277145 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277147 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277150 2577 flags.go:64] FLAG: --enable-load-reader="false" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277153 2577 flags.go:64] FLAG: --enable-server="true" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277169 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277174 2577 flags.go:64] FLAG: --event-burst="100" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277177 2577 flags.go:64] FLAG: --event-qps="50" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277180 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 15 12:34:02.288311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277183 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277185 2577 flags.go:64] FLAG: --eviction-hard="" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277189 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277193 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277196 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277199 2577 flags.go:64] FLAG: --eviction-soft="" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277202 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277205 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277207 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277210 2577 flags.go:64] FLAG: --experimental-mounter-path="" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277213 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277216 2577 flags.go:64] FLAG: --fail-swap-on="true" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277218 2577 flags.go:64] FLAG: --feature-gates="" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277222 2577 flags.go:64] FLAG: --file-check-frequency="20s" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277226 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277229 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277232 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277234 2577 flags.go:64] FLAG: --healthz-port="10248" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277237 2577 flags.go:64] FLAG: --help="false" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277240 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277244 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277247 2577 flags.go:64] FLAG: --http-check-frequency="20s" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277250 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277253 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 15 12:34:02.288890 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277256 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277259 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277262 2577 flags.go:64] FLAG: --image-service-endpoint="" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277264 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277267 2577 flags.go:64] FLAG: --kube-api-burst="100" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277273 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277276 2577 flags.go:64] FLAG: --kube-api-qps="50" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277279 2577 flags.go:64] FLAG: --kube-reserved="" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277281 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277284 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277287 2577 flags.go:64] FLAG: --kubelet-cgroups="" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277290 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277294 2577 flags.go:64] FLAG: --lock-file="" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277296 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277299 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277306 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277311 2577 flags.go:64] FLAG: --log-json-split-stream="false" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277314 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277317 2577 flags.go:64] FLAG: --log-text-split-stream="false" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277320 2577 flags.go:64] FLAG: --logging-format="text" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277323 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277326 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277331 2577 flags.go:64] FLAG: --manifest-url="" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277334 2577 flags.go:64] FLAG: --manifest-url-header="" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277338 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 15 12:34:02.289504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277341 2577 flags.go:64] FLAG: --max-open-files="1000000" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277345 2577 flags.go:64] FLAG: --max-pods="110" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277348 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277351 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277354 2577 flags.go:64] FLAG: --memory-manager-policy="None" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277357 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277360 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277363 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277366 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277373 2577 flags.go:64] FLAG: --node-status-max-images="50" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277376 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277379 2577 flags.go:64] FLAG: --oom-score-adj="-999" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277382 2577 flags.go:64] FLAG: --pod-cidr="" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277387 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277392 2577 flags.go:64] FLAG: --pod-manifest-path="" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277394 2577 flags.go:64] FLAG: --pod-max-pids="-1" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277398 2577 flags.go:64] FLAG: --pods-per-core="0" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277401 2577 flags.go:64] FLAG: --port="10250" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277404 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277408 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02fa6a51089a75478" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277412 2577 flags.go:64] FLAG: --qos-reserved="" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277414 2577 flags.go:64] FLAG: --read-only-port="10255" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277418 2577 flags.go:64] FLAG: --register-node="true" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277421 2577 flags.go:64] FLAG: --register-with-taints="" Sep 15 12:34:02.290136 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277424 2577 flags.go:64] FLAG: --registry-burst="10" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277427 2577 flags.go:64] FLAG: --registry-qps="5" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277430 2577 flags.go:64] FLAG: --reserved-cpus="" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277433 2577 flags.go:64] FLAG: --reserved-memory="" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277436 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277441 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277444 2577 flags.go:64] FLAG: --rotate-certificates="false" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277447 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277450 2577 flags.go:64] FLAG: --runonce="false" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277453 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277456 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277459 2577 flags.go:64] FLAG: --seccomp-default="false" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277462 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277465 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277468 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277471 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277474 2577 flags.go:64] FLAG: --storage-driver-password="root" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277477 2577 flags.go:64] FLAG: --storage-driver-secure="false" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277479 2577 flags.go:64] FLAG: --storage-driver-table="stats" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277482 2577 flags.go:64] FLAG: --storage-driver-user="root" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277485 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277488 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277491 2577 flags.go:64] FLAG: --system-cgroups="" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277494 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277499 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 15 12:34:02.290751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277502 2577 flags.go:64] FLAG: --tls-cert-file="" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277505 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277509 2577 flags.go:64] FLAG: --tls-min-version="" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277512 2577 flags.go:64] FLAG: --tls-private-key-file="" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277515 2577 flags.go:64] FLAG: --topology-manager-policy="none" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277518 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277521 2577 flags.go:64] FLAG: --topology-manager-scope="container" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277524 2577 flags.go:64] FLAG: --v="2" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277528 2577 flags.go:64] FLAG: --version="false" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277532 2577 flags.go:64] FLAG: --vmodule="" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277535 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277539 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277662 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277666 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277669 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277672 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277675 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277678 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277681 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277684 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277687 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277689 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:34:02.291399 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277692 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277695 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277698 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277700 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277703 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277705 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277708 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277710 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277714 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277716 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277719 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277721 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277726 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277728 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277732 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277735 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277738 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277742 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277745 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:34:02.291929 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277749 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277751 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277754 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277758 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277760 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277763 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277766 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277768 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277771 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277773 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277776 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277779 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277781 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277784 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277786 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277789 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277792 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277794 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277798 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:34:02.292418 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277801 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277804 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277806 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277809 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277812 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277814 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277818 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277821 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277823 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277826 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277828 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277831 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277833 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277836 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277838 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277841 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277844 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277847 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277849 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277852 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:34:02.292878 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277854 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277857 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277859 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277862 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277864 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277866 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277869 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277871 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277874 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277876 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277879 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277881 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277883 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277886 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277888 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277891 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277894 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277896 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277900 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277903 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:34:02.293384 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277905 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277908 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277910 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277913 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277915 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277918 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277920 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277923 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277927 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277929 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.277932 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.277937 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.285407 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.285519 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.286397 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 15 12:34:02.293879 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.286405 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286476 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286481 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286484 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286487 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286490 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286493 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286496 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286498 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286501 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286504 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286506 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286509 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286517 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286520 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286526 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286529 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286532 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286535 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286537 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:34:02.294280 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286540 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286542 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286545 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286547 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286550 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286553 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286555 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286558 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286560 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286563 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286565 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286568 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286570 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286572 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286575 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286577 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286581 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286585 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286588 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:34:02.294786 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286591 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286594 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286596 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286599 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286601 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286604 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286607 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286617 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286620 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286623 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286627 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286630 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286633 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286636 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286644 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286646 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286649 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286652 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286655 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:34:02.295270 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286658 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286660 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286663 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286665 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286668 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286670 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286673 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286675 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286678 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286680 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286683 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286685 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286688 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286691 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286693 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286696 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286698 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286700 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286703 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286705 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:34:02.295896 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286708 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286718 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286721 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286723 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286726 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286728 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286731 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286733 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286736 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286738 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286741 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286744 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286747 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286751 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286754 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286757 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286760 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286762 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286764 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286767 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:34:02.296709 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286769 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286772 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.286777 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286929 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286934 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286936 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286939 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286941 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286944 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286946 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286949 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286951 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286954 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286956 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286964 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 12:34:02.297341 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286967 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286969 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286972 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286974 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286977 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286979 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286982 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286984 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286987 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286989 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286992 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286994 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286997 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.286999 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287001 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287004 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287006 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287009 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287011 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 12:34:02.297744 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287014 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287016 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287018 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287021 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287023 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287025 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287028 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287031 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287033 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287035 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287038 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287040 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287043 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287058 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287062 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287064 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287067 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287069 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287072 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287074 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 12:34:02.298425 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287076 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287079 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287082 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287084 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287087 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287089 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287091 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287094 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287096 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287098 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287101 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287103 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287105 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287108 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287110 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287113 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287115 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287117 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287120 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287122 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 12:34:02.299027 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287125 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287127 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287129 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287132 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287134 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287137 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287146 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287149 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287151 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287154 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287170 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287174 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287177 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287180 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287183 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287186 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287188 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287191 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287193 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 12:34:02.299656 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287195 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287199 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287201 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287205 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287208 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287210 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287213 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287215 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:02.287218 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.287222 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.287323 2577 server.go:962] "Client rotation is on, will bootstrap in background" Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.289719 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.290707 2577 server.go:1019] "Starting client certificate rotation" Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.290811 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 12:34:02.300213 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.290850 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 12:34:02.300570 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.295642 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 12:34:02.300570 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.298901 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 12:34:02.308775 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.308753 2577 log.go:25] "Validated CRI v1 runtime API" Sep 15 12:34:02.314458 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.314444 2577 log.go:25] "Validated CRI v1 image API" Sep 15 12:34:02.315327 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.315312 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 15 12:34:02.318919 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.318901 2577 fs.go:135] Filesystem UUIDs: map[01600cba-0251-46d7-9cdd-276f410ada36:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a6a6ab7e-86f9-41d9-b80e-f61441b0db70:/dev/nvme0n1p4] Sep 15 12:34:02.318982 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.318917 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 15 12:34:02.324070 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.323972 2577 manager.go:216] Machine: {Timestamp:2026-09-15 12:34:02.32244975 +0000 UTC m=+0.365697349 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105496 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e1dff81a9a8f1b17256be222f0a0 SystemUUID:ec25e1df-f81a-9a8f-1b17-256be222f0a0 BootID:d767c053-19b2-4465-93dd-61b03439d5d2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e1:eb:c1:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e1:eb:c1:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:3a:55:18:c7:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 15 12:34:02.324070 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.324067 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 15 12:34:02.324195 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.324181 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 15 12:34:02.327399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.327377 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 15 12:34:02.327531 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.327403 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 15 12:34:02.328283 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.328273 2577 topology_manager.go:138] "Creating topology manager with none policy" Sep 15 12:34:02.328314 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.328286 2577 container_manager_linux.go:309] "Creating device plugin manager" Sep 15 12:34:02.328314 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.328294 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 12:34:02.328369 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.328322 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 12:34:02.329732 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.329721 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 15 12:34:02.333075 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.333063 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 15 12:34:02.333196 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.333187 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 15 12:34:02.333236 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.333215 2577 kubelet.go:486] "Attempting to sync node with API server" Sep 15 12:34:02.333236 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.333225 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 15 12:34:02.333296 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.333239 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 15 12:34:02.333296 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.333248 2577 kubelet.go:398] "Adding apiserver pod source" Sep 15 12:34:02.333296 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.333260 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 15 12:34:02.333697 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.333683 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 12:34:02.333773 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.333717 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 12:34:02.334342 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.334323 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 12:34:02.336061 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.336046 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 15 12:34:02.337920 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.337906 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 15 12:34:02.337968 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.337937 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 15 12:34:02.340642 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340630 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 15 12:34:02.340685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340648 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 15 12:34:02.340685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340654 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 15 12:34:02.340685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340659 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 15 12:34:02.340685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340668 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 15 12:34:02.340685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340675 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 15 12:34:02.340685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340688 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 15 12:34:02.340827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340693 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 15 12:34:02.340827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340699 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 15 12:34:02.340827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340705 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 15 12:34:02.340827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340719 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 15 12:34:02.340827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.340724 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 15 12:34:02.342882 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.342873 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 15 12:34:02.342882 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.342882 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 15 12:34:02.348060 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.347940 2577 server.go:1268] "Started kubelet" Sep 15 12:34:02.348182 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.348112 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 15 12:34:02.348233 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.348197 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 15 12:34:02.348401 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.348044 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 15 12:34:02.349003 ip-10-0-140-90 systemd[1]: Started Kubernetes Kubelet. Sep 15 12:34:02.349879 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.349575 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 15 12:34:02.349879 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.349626 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 15 12:34:02.349879 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.349677 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 15 12:34:02.351114 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.351099 2577 server.go:310] "Adding debug handlers to kubelet server" Sep 15 12:34:02.352775 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.352757 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 15 12:34:02.353285 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.353268 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 15 12:34:02.356835 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.356818 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 15 12:34:02.356982 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.355907 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-90.ec2.internal.18d57e9d9c5c74c1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-90.ec2.internal,UID:ip-10-0-140-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-90.ec2.internal,},FirstTimestamp:2026-09-15 12:34:02.347910337 +0000 UTC m=+0.391157937,LastTimestamp:2026-09-15 12:34:02.347910337 +0000 UTC m=+0.391157937,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-90.ec2.internal,}" Sep 15 12:34:02.357504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.357487 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 15 12:34:02.357611 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.357594 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:02.358220 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358206 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 15 12:34:02.358286 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358227 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 15 12:34:02.358318 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358291 2577 factory.go:55] Registering systemd factory Sep 15 12:34:02.358318 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358306 2577 factory.go:223] Registration of the systemd container factory successfully Sep 15 12:34:02.358391 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358351 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 15 12:34:02.358455 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358440 2577 reconstruct.go:97] "Volume reconstruction finished" Sep 15 12:34:02.358455 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358454 2577 reconciler.go:29] "Reconciler: start to sync state" Sep 15 12:34:02.358545 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358515 2577 factory.go:153] Registering CRI-O factory Sep 15 12:34:02.358545 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358529 2577 factory.go:223] Registration of the crio container factory successfully Sep 15 12:34:02.358644 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358588 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 15 12:34:02.358644 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358607 2577 factory.go:103] Registering Raw factory Sep 15 12:34:02.358644 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358621 2577 manager.go:1196] Started watching for new ooms in manager Sep 15 12:34:02.358964 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.358951 2577 manager.go:349] Starting recovery of all containers Sep 15 12:34:02.360596 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.360449 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-844c5" Sep 15 12:34:02.366109 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.366087 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 15 12:34:02.366235 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.366190 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 15 12:34:02.366884 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.366867 2577 manager.go:354] Recovery completed Sep 15 12:34:02.367297 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.367272 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-844c5" Sep 15 12:34:02.371633 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.371621 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:34:02.373692 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.373677 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:34:02.373771 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.373710 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:34:02.373771 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.373724 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:34:02.374338 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.374326 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 15 12:34:02.374338 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.374337 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 15 12:34:02.374433 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.374352 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 15 12:34:02.374477 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.374329 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:34:02.375221 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.375207 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:34:02.375276 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.375231 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:34:02.375276 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.375240 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:34:02.375659 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.375600 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-90.ec2.internal.18d57e9d9de5dacf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-90.ec2.internal,UID:ip-10-0-140-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-90.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-90.ec2.internal,},FirstTimestamp:2026-09-15 12:34:02.373692111 +0000 UTC m=+0.416939728,LastTimestamp:2026-09-15 12:34:02.373692111 +0000 UTC m=+0.416939728,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-90.ec2.internal,}" Sep 15 12:34:02.375775 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.375678 2577 policy_none.go:49] "None policy: Start" Sep 15 12:34:02.375775 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.375690 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 15 12:34:02.375775 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.375700 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 15 12:34:02.377077 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.377050 2577 policy_none.go:47] "Start" Sep 15 12:34:02.428582 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.408327 2577 manager.go:337] "Starting Device Plugin manager" Sep 15 12:34:02.428582 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.408357 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 15 12:34:02.428582 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.408366 2577 server.go:87] "Starting device plugin registration server" Sep 15 12:34:02.428582 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.408545 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 15 12:34:02.428582 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.408555 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 15 12:34:02.428582 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.408644 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 15 12:34:02.428582 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.408723 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 15 12:34:02.428582 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.408731 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 15 12:34:02.428582 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.409282 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 15 12:34:02.428582 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.409329 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:02.446870 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.446851 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 15 12:34:02.448178 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.448141 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 15 12:34:02.448254 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.448202 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 15 12:34:02.448254 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.448221 2577 kubelet.go:2448] "Starting kubelet main sync loop" Sep 15 12:34:02.448359 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.448256 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 15 12:34:02.450266 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.450246 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:34:02.509486 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.509462 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:34:02.510268 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.510255 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:34:02.510325 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.510282 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:34:02.510325 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.510294 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:34:02.510325 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.510321 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.520431 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.520380 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.520431 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.520407 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-90.ec2.internal\": node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:02.541203 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.541186 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:02.549228 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.549207 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal"] Sep 15 12:34:02.549285 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.549265 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:34:02.550044 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.550031 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:34:02.550112 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.550054 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:34:02.550112 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.550064 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:34:02.551365 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.551352 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:34:02.551483 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.551468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.551528 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.551501 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:34:02.552133 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.552118 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:34:02.552221 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.552142 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:34:02.552221 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.552152 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:34:02.552288 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.552234 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:34:02.552288 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.552257 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:34:02.552288 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.552266 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:34:02.553543 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.553528 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.553651 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.553553 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 12:34:02.554380 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.554355 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientMemory" Sep 15 12:34:02.554380 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.554383 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 12:34:02.554507 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.554393 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeHasSufficientPID" Sep 15 12:34:02.559740 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.559723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f05b1603fcff14d679e1b26fe871dd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal\" (UID: \"9f05b1603fcff14d679e1b26fe871dd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.559827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.559748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f05b1603fcff14d679e1b26fe871dd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal\" (UID: \"9f05b1603fcff14d679e1b26fe871dd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.559827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.559766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2f52dba7b06215d463d19570335e32a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-90.ec2.internal\" (UID: \"b2f52dba7b06215d463d19570335e32a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.574716 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.574699 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-90.ec2.internal\" not found" node="ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.579129 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.579114 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-90.ec2.internal\" not found" node="ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.641453 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.641429 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:02.660574 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.660551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f05b1603fcff14d679e1b26fe871dd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal\" (UID: \"9f05b1603fcff14d679e1b26fe871dd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.660668 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.660571 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f05b1603fcff14d679e1b26fe871dd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal\" (UID: \"9f05b1603fcff14d679e1b26fe871dd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.660668 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.660589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f05b1603fcff14d679e1b26fe871dd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal\" (UID: \"9f05b1603fcff14d679e1b26fe871dd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.660668 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.660626 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f05b1603fcff14d679e1b26fe871dd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal\" (UID: \"9f05b1603fcff14d679e1b26fe871dd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.660668 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.660634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2f52dba7b06215d463d19570335e32a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-90.ec2.internal\" (UID: \"b2f52dba7b06215d463d19570335e32a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.660668 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.660666 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2f52dba7b06215d463d19570335e32a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-90.ec2.internal\" (UID: \"b2f52dba7b06215d463d19570335e32a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.741786 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.741756 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:02.842614 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.842573 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:02.877050 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.877027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.883079 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:02.883060 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal" Sep 15 12:34:02.942988 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:02.942968 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:03.043525 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:03.043502 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:03.144050 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:03.143992 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:03.244551 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:03.244530 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:03.290997 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.290975 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 15 12:34:03.291388 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.291127 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 12:34:03.345415 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:03.345389 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:03.372354 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.372325 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 12:29:03 +0000 UTC" deadline="2028-04-14 17:01:10.331509441 +0000 UTC" Sep 15 12:34:03.372354 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.372349 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13852h27m6.959163554s" Sep 15 12:34:03.445855 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:03.445833 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:03.518970 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.518951 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:34:03.546081 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:03.546054 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:03.617722 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:03.617594 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f52dba7b06215d463d19570335e32a.slice/crio-f3f7fd29935b86878bc425cbb6a94b78739e07a42ee1ccb701db7e4f2af60d87 WatchSource:0}: Error finding container f3f7fd29935b86878bc425cbb6a94b78739e07a42ee1ccb701db7e4f2af60d87: Status 404 returned error can't find the container with id f3f7fd29935b86878bc425cbb6a94b78739e07a42ee1ccb701db7e4f2af60d87 Sep 15 12:34:03.617945 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:03.617927 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f05b1603fcff14d679e1b26fe871dd9.slice/crio-66defc77be6f4ebd40c69481a92e11cb8428ab0c3a3de94b47a784bcaaefe43f WatchSource:0}: Error finding container 66defc77be6f4ebd40c69481a92e11cb8428ab0c3a3de94b47a784bcaaefe43f: Status 404 returned error can't find the container with id 66defc77be6f4ebd40c69481a92e11cb8428ab0c3a3de94b47a784bcaaefe43f Sep 15 12:34:03.623543 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.623523 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 12:34:03.647098 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:03.647077 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:03.747682 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:03.747641 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-90.ec2.internal\" not found" Sep 15 12:34:03.749757 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.749739 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:34:03.758442 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.758422 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal" Sep 15 12:34:03.768310 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.768288 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 12:34:03.769482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.769469 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" Sep 15 12:34:03.785077 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.785059 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 12:34:03.872676 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:03.872655 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:34:04.334505 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.334475 2577 apiserver.go:52] "Watching apiserver" Sep 15 12:34:04.343685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.343658 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 15 12:34:04.344154 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.344129 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal","openshift-multus/multus-v27dm","openshift-network-operator/iptables-alerter-zr8w8","openshift-ovn-kubernetes/ovnkube-node-6zghl","kube-system/global-pull-secret-syncer-62k6l","kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal","openshift-cluster-node-tuning-operator/tuned-tcx97","openshift-dns/node-resolver-z2x4p","openshift-image-registry/node-ca-phcb7","openshift-multus/multus-additional-cni-plugins-xtvb6","openshift-multus/network-metrics-daemon-wj7jq","openshift-network-diagnostics/network-check-target-cptf6","kube-system/konnectivity-agent-hf76k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7"] Sep 15 12:34:04.345874 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.345845 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.347123 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.347098 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:04.349499 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.349477 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.350134 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.350112 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 15 12:34:04.350281 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.350136 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x2mgb\"" Sep 15 12:34:04.350409 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.350387 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 15 12:34:04.350520 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.350432 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 15 12:34:04.350681 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.350661 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 15 12:34:04.350748 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.350693 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qmc7m\"" Sep 15 12:34:04.351844 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.351823 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.352625 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.352606 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 15 12:34:04.352780 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.352756 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6pqx8\"" Sep 15 12:34:04.352910 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.352895 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 15 12:34:04.353141 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.353117 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 15 12:34:04.354221 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.353447 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:04.354221 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.353540 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:04.354474 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.354453 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 15 12:34:04.355393 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.354920 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 15 12:34:04.355393 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.355102 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 15 12:34:04.355393 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.355346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.356533 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.356515 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 15 12:34:04.356640 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.356576 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 15 12:34:04.357801 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.356767 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qn98t\"" Sep 15 12:34:04.357801 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.356953 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 15 12:34:04.357801 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.357792 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 15 12:34:04.357977 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.357816 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 15 12:34:04.358561 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.358059 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 15 12:34:04.358561 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.358286 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 15 12:34:04.358561 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.358429 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vbpvj\"" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.365546 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368310 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64tjv\" (UniqueName: \"kubernetes.io/projected/79346abd-b9d2-43ae-826c-15595d93fb31-kube-api-access-64tjv\") pod \"node-ca-phcb7\" (UID: \"79346abd-b9d2-43ae-826c-15595d93fb31\") " pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-sysconfig\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-var-lib-kubelet\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368417 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368450 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62de769f-9b0d-40f1-81bf-985f1d81da81-ovnkube-script-lib\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10d627cd-9fbd-4577-bbe7-6673f64d1128-tmp-dir\") pod \"node-resolver-z2x4p\" (UID: \"10d627cd-9fbd-4577-bbe7-6673f64d1128\") " pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a879af0-932e-4723-8e63-4741e13aca35-dbus\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-etc-selinux\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zl7d\" (UniqueName: \"kubernetes.io/projected/10d627cd-9fbd-4577-bbe7-6673f64d1128-kube-api-access-8zl7d\") pod \"node-resolver-z2x4p\" (UID: \"10d627cd-9fbd-4577-bbe7-6673f64d1128\") " pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62de769f-9b0d-40f1-81bf-985f1d81da81-ovn-node-metrics-cert\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368647 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmfkm\" (UniqueName: \"kubernetes.io/projected/62de769f-9b0d-40f1-81bf-985f1d81da81-kube-api-access-qmfkm\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-kubernetes\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-socket-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79346abd-b9d2-43ae-826c-15595d93fb31-serviceca\") pod \"node-ca-phcb7\" (UID: \"79346abd-b9d2-43ae-826c-15595d93fb31\") " pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-run-ovn\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.369311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-run\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-sys\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88dx2\" (UniqueName: \"kubernetes.io/projected/523809b4-42bc-4780-9955-952204e85b4d-kube-api-access-88dx2\") pod \"iptables-alerter-zr8w8\" (UID: \"523809b4-42bc-4780-9955-952204e85b4d\") " pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-kubelet\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-run-netns\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-log-socket\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.368984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79346abd-b9d2-43ae-826c-15595d93fb31-host\") pod \"node-ca-phcb7\" (UID: \"79346abd-b9d2-43ae-826c-15595d93fb31\") " pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.369015 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-var-lib-openvswitch\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.369045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11bbfa0d-be73-43f9-892e-54c24632af38-tmp\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.369075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4782aaed-5fcf-4ec2-bd25-e0c7bcea509c-konnectivity-ca\") pod \"konnectivity-agent-hf76k\" (UID: \"4782aaed-5fcf-4ec2-bd25-e0c7bcea509c\") " pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.369101 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-cni-netd\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.369135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.369168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4782aaed-5fcf-4ec2-bd25-e0c7bcea509c-agent-certs\") pod \"konnectivity-agent-hf76k\" (UID: \"4782aaed-5fcf-4ec2-bd25-e0c7bcea509c\") " pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:04.370104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.369199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx54k\" (UniqueName: \"kubernetes.io/projected/b9865c01-7625-45c3-b057-a938d8303c98-kube-api-access-tx54k\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.371188 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.371478 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.371740 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.371954 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mkzps\"" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.373107 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.374566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.375387 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.375919 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.375976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.376064 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.376392 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-257pd\"" Sep 15 12:34:04.376827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.376447 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 15 12:34:04.378075 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.377456 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:04.378075 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.377533 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:04.378213 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.369228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/523809b4-42bc-4780-9955-952204e85b4d-host-slash\") pod \"iptables-alerter-zr8w8\" (UID: \"523809b4-42bc-4780-9955-952204e85b4d\") " pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.378300 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-slash\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.378364 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-etc-openvswitch\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.378424 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a879af0-932e-4723-8e63-4741e13aca35-kubelet-config\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:04.378424 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-systemd-units\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.378522 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-sysctl-d\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.378522 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-sysctl-conf\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.378522 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378497 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:04.378681 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-node-log\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.378681 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10d627cd-9fbd-4577-bbe7-6673f64d1128-hosts-file\") pod \"node-resolver-z2x4p\" (UID: \"10d627cd-9fbd-4577-bbe7-6673f64d1128\") " pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.378681 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-device-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.378681 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-cni-bin\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.378681 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-host\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.378932 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-registration-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.378932 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-sys-fs\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.378932 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-run-openvswitch\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.378932 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-lib-modules\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.378932 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11bbfa0d-be73-43f9-892e-54c24632af38-etc-tuned\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.378932 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd8bw\" (UniqueName: \"kubernetes.io/projected/11bbfa0d-be73-43f9-892e-54c24632af38-kube-api-access-sd8bw\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.378932 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/523809b4-42bc-4780-9955-952204e85b4d-iptables-alerter-script\") pod \"iptables-alerter-zr8w8\" (UID: \"523809b4-42bc-4780-9955-952204e85b4d\") " pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.378932 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-run-systemd\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.378932 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-run-ovn-kubernetes\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.379462 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62de769f-9b0d-40f1-81bf-985f1d81da81-ovnkube-config\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.379462 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-systemd\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.379462 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.378987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62de769f-9b0d-40f1-81bf-985f1d81da81-env-overrides\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.379462 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.379019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-modprobe-d\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.379462 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.379096 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rk6g9\"" Sep 15 12:34:04.379462 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.379404 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 15 12:34:04.379829 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.379579 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 15 12:34:04.379829 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.379635 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 15 12:34:04.379829 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.379579 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 15 12:34:04.379965 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.379874 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 15 12:34:04.382492 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.382269 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6n5bn\"" Sep 15 12:34:04.384531 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.384509 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 15 12:34:04.387066 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.387039 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 12:34:04.398323 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.398301 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4x9l" Sep 15 12:34:04.406899 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.406867 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4x9l" Sep 15 12:34:04.453081 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.453043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal" event={"ID":"b2f52dba7b06215d463d19570335e32a","Type":"ContainerStarted","Data":"f3f7fd29935b86878bc425cbb6a94b78739e07a42ee1ccb701db7e4f2af60d87"} Sep 15 12:34:04.456172 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.456150 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" event={"ID":"9f05b1603fcff14d679e1b26fe871dd9","Type":"ContainerStarted","Data":"66defc77be6f4ebd40c69481a92e11cb8428ab0c3a3de94b47a784bcaaefe43f"} Sep 15 12:34:04.459504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.459484 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 15 12:34:04.479709 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479687 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9vj4\" (UniqueName: \"kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4\") pod \"network-check-target-cptf6\" (UID: \"c531254c-20b6-4fd1-a34c-bf6ae5c17288\") " pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:04.479836 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-sysctl-d\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.479836 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-sysctl-conf\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.479836 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:04.479836 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-node-log\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.480007 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10d627cd-9fbd-4577-bbe7-6673f64d1128-hosts-file\") pod \"node-resolver-z2x4p\" (UID: \"10d627cd-9fbd-4577-bbe7-6673f64d1128\") " pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.480007 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479880 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a523ad61-1003-4072-a5fc-34ce5c564562-cni-binary-copy\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.480007 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-device-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.480007 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479913 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-sysctl-d\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.480007 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-cni-bin\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.480007 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-host\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.480007 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.479999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-registration-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.480357 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-sys-fs\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.480357 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-run-openvswitch\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.480357 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480083 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-sysctl-conf\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.480357 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-lib-modules\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.480357 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11bbfa0d-be73-43f9-892e-54c24632af38-etc-tuned\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.480357 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd8bw\" (UniqueName: \"kubernetes.io/projected/11bbfa0d-be73-43f9-892e-54c24632af38-kube-api-access-sd8bw\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.480357 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.480198 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:04.480357 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.480294 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret podName:1a879af0-932e-4723-8e63-4741e13aca35 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:04.98026077 +0000 UTC m=+3.023508378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret") pod "global-pull-secret-syncer-62k6l" (UID: "1a879af0-932e-4723-8e63-4741e13aca35") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:04.480795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480488 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-node-log\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.480795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480581 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10d627cd-9fbd-4577-bbe7-6673f64d1128-hosts-file\") pod \"node-resolver-z2x4p\" (UID: \"10d627cd-9fbd-4577-bbe7-6673f64d1128\") " pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.480795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480659 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-device-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.480795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/523809b4-42bc-4780-9955-952204e85b4d-iptables-alerter-script\") pod \"iptables-alerter-zr8w8\" (UID: \"523809b4-42bc-4780-9955-952204e85b4d\") " pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.480795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480697 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-run-systemd\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.480795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-run-ovn-kubernetes\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.480795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62de769f-9b0d-40f1-81bf-985f1d81da81-ovnkube-config\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-systemd\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480844 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/523809b4-42bc-4780-9955-952204e85b4d-iptables-alerter-script\") pod \"iptables-alerter-zr8w8\" (UID: \"523809b4-42bc-4780-9955-952204e85b4d\") " pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-var-lib-kubelet\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-daemon-config\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480913 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-cni-bin\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62de769f-9b0d-40f1-81bf-985f1d81da81-env-overrides\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-run-multus-certs\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480965 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-host\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.480979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-etc-kubernetes\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-modprobe-d\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481013 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-registration-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-run-netns\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64tjv\" (UniqueName: \"kubernetes.io/projected/79346abd-b9d2-43ae-826c-15595d93fb31-kube-api-access-64tjv\") pod \"node-ca-phcb7\" (UID: \"79346abd-b9d2-43ae-826c-15595d93fb31\") " pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481076 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-sys-fs\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-cnibin\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.481108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481114 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-run-openvswitch\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-run-k8s-cni-cncf-io\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-sysconfig\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-var-lib-kubelet\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62de769f-9b0d-40f1-81bf-985f1d81da81-ovnkube-script-lib\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481274 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10d627cd-9fbd-4577-bbe7-6673f64d1128-tmp-dir\") pod \"node-resolver-z2x4p\" (UID: \"10d627cd-9fbd-4577-bbe7-6673f64d1128\") " pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a523ad61-1003-4072-a5fc-34ce5c564562-system-cni-dir\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481317 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-lib-modules\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481381 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-run-systemd\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481406 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-run-ovn-kubernetes\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481443 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a879af0-932e-4723-8e63-4741e13aca35-dbus\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:04.481929 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481890 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62de769f-9b0d-40f1-81bf-985f1d81da81-ovnkube-config\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.482667 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481954 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-systemd\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.482667 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482095 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 15 12:34:04.482667 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482455 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62de769f-9b0d-40f1-81bf-985f1d81da81-env-overrides\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.482667 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482609 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-modprobe-d\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.482667 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.481326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a879af0-932e-4723-8e63-4741e13aca35-dbus\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:04.482927 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482690 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-var-lib-kubelet\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.482927 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482703 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.482927 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-etc-selinux\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.482927 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zl7d\" (UniqueName: \"kubernetes.io/projected/10d627cd-9fbd-4577-bbe7-6673f64d1128-kube-api-access-8zl7d\") pod \"node-resolver-z2x4p\" (UID: \"10d627cd-9fbd-4577-bbe7-6673f64d1128\") " pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.482927 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-system-cni-dir\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.482927 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a523ad61-1003-4072-a5fc-34ce5c564562-cnibin\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.482927 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:04.482927 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482891 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62de769f-9b0d-40f1-81bf-985f1d81da81-ovn-node-metrics-cert\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfkm\" (UniqueName: \"kubernetes.io/projected/62de769f-9b0d-40f1-81bf-985f1d81da81-kube-api-access-qmfkm\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-kubernetes\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.482986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-socket-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79346abd-b9d2-43ae-826c-15595d93fb31-serviceca\") pod \"node-ca-phcb7\" (UID: \"79346abd-b9d2-43ae-826c-15595d93fb31\") " pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-run-ovn\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-conf-dir\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a523ad61-1003-4072-a5fc-34ce5c564562-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-run\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-sys\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88dx2\" (UniqueName: \"kubernetes.io/projected/523809b4-42bc-4780-9955-952204e85b4d-kube-api-access-88dx2\") pod \"iptables-alerter-zr8w8\" (UID: \"523809b4-42bc-4780-9955-952204e85b4d\") " pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-kubelet\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483217 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62de769f-9b0d-40f1-81bf-985f1d81da81-ovnkube-script-lib\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-run-netns\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-log-socket\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.483353 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fbb7e09-a658-4fbb-a203-fd9ef176a246-cni-binary-copy\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-socket-dir-parent\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79346abd-b9d2-43ae-826c-15595d93fb31-host\") pod \"node-ca-phcb7\" (UID: \"79346abd-b9d2-43ae-826c-15595d93fb31\") " pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-var-lib-openvswitch\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-hostroot\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a523ad61-1003-4072-a5fc-34ce5c564562-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11bbfa0d-be73-43f9-892e-54c24632af38-tmp\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4782aaed-5fcf-4ec2-bd25-e0c7bcea509c-konnectivity-ca\") pod \"konnectivity-agent-hf76k\" (UID: \"4782aaed-5fcf-4ec2-bd25-e0c7bcea509c\") " pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-cni-netd\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483658 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-run-ovn\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483713 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-cni-netd\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a523ad61-1003-4072-a5fc-34ce5c564562-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483773 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddqhn\" (UniqueName: \"kubernetes.io/projected/a523ad61-1003-4072-a5fc-34ce5c564562-kube-api-access-ddqhn\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4782aaed-5fcf-4ec2-bd25-e0c7bcea509c-agent-certs\") pod \"konnectivity-agent-hf76k\" (UID: \"4782aaed-5fcf-4ec2-bd25-e0c7bcea509c\") " pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483874 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-sysconfig\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx54k\" (UniqueName: \"kubernetes.io/projected/b9865c01-7625-45c3-b057-a938d8303c98-kube-api-access-tx54k\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.484074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/523809b4-42bc-4780-9955-952204e85b4d-host-slash\") pod \"iptables-alerter-zr8w8\" (UID: \"523809b4-42bc-4780-9955-952204e85b4d\") " pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.484994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-slash\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.484994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.484012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-etc-openvswitch\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.484994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.484047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8559d\" (UniqueName: \"kubernetes.io/projected/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-kube-api-access-8559d\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:04.484994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.484073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a879af0-932e-4723-8e63-4741e13aca35-kubelet-config\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:04.484994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.484149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-systemd-units\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.484994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.484186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-cni-dir\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.484994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.484219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-var-lib-cni-bin\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.484994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.484277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-var-lib-cni-multus\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.484994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.484303 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgcg8\" (UniqueName: \"kubernetes.io/projected/2fbb7e09-a658-4fbb-a203-fd9ef176a246-kube-api-access-qgcg8\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.484994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.484435 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-etc-selinux\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.485679 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-slash\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.485766 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-etc-kubernetes\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.485781 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9865c01-7625-45c3-b057-a938d8303c98-socket-dir\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.485814 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-etc-openvswitch\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.485869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a879af0-932e-4723-8e63-4741e13aca35-kubelet-config\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.485908 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-systemd-units\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.486159 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.486249 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-run\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.486276 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79346abd-b9d2-43ae-826c-15595d93fb31-serviceca\") pod \"node-ca-phcb7\" (UID: \"79346abd-b9d2-43ae-826c-15595d93fb31\") " pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.486310 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11bbfa0d-be73-43f9-892e-54c24632af38-sys\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.486626 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-log-socket\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.486681 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/523809b4-42bc-4780-9955-952204e85b4d-host-slash\") pod \"iptables-alerter-zr8w8\" (UID: \"523809b4-42bc-4780-9955-952204e85b4d\") " pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.486686 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-kubelet\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.483531 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10d627cd-9fbd-4577-bbe7-6673f64d1128-tmp-dir\") pod \"node-resolver-z2x4p\" (UID: \"10d627cd-9fbd-4577-bbe7-6673f64d1128\") " pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.486737 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-host-run-netns\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.486878 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62de769f-9b0d-40f1-81bf-985f1d81da81-var-lib-openvswitch\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.486933 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79346abd-b9d2-43ae-826c-15595d93fb31-host\") pod \"node-ca-phcb7\" (UID: \"79346abd-b9d2-43ae-826c-15595d93fb31\") " pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.487444 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.487398 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4782aaed-5fcf-4ec2-bd25-e0c7bcea509c-konnectivity-ca\") pod \"konnectivity-agent-hf76k\" (UID: \"4782aaed-5fcf-4ec2-bd25-e0c7bcea509c\") " pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:04.488985 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.488960 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11bbfa0d-be73-43f9-892e-54c24632af38-etc-tuned\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.489075 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.489012 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62de769f-9b0d-40f1-81bf-985f1d81da81-ovn-node-metrics-cert\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.489562 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.489542 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4782aaed-5fcf-4ec2-bd25-e0c7bcea509c-agent-certs\") pod \"konnectivity-agent-hf76k\" (UID: \"4782aaed-5fcf-4ec2-bd25-e0c7bcea509c\") " pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:04.492269 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.492239 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11bbfa0d-be73-43f9-892e-54c24632af38-tmp\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.504869 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.504836 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmfkm\" (UniqueName: \"kubernetes.io/projected/62de769f-9b0d-40f1-81bf-985f1d81da81-kube-api-access-qmfkm\") pod \"ovnkube-node-6zghl\" (UID: \"62de769f-9b0d-40f1-81bf-985f1d81da81\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.505834 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.505792 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zl7d\" (UniqueName: \"kubernetes.io/projected/10d627cd-9fbd-4577-bbe7-6673f64d1128-kube-api-access-8zl7d\") pod \"node-resolver-z2x4p\" (UID: \"10d627cd-9fbd-4577-bbe7-6673f64d1128\") " pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.506637 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.506088 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd8bw\" (UniqueName: \"kubernetes.io/projected/11bbfa0d-be73-43f9-892e-54c24632af38-kube-api-access-sd8bw\") pod \"tuned-tcx97\" (UID: \"11bbfa0d-be73-43f9-892e-54c24632af38\") " pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.508850 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.508796 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88dx2\" (UniqueName: \"kubernetes.io/projected/523809b4-42bc-4780-9955-952204e85b4d-kube-api-access-88dx2\") pod \"iptables-alerter-zr8w8\" (UID: \"523809b4-42bc-4780-9955-952204e85b4d\") " pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.509498 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.509474 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64tjv\" (UniqueName: \"kubernetes.io/projected/79346abd-b9d2-43ae-826c-15595d93fb31-kube-api-access-64tjv\") pod \"node-ca-phcb7\" (UID: \"79346abd-b9d2-43ae-826c-15595d93fb31\") " pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.510608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.510586 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx54k\" (UniqueName: \"kubernetes.io/projected/b9865c01-7625-45c3-b057-a938d8303c98-kube-api-access-tx54k\") pod \"aws-ebs-csi-driver-node-zjww7\" (UID: \"b9865c01-7625-45c3-b057-a938d8303c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.585201 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a523ad61-1003-4072-a5fc-34ce5c564562-cnibin\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.585201 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:04.585369 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585229 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a523ad61-1003-4072-a5fc-34ce5c564562-cnibin\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.585369 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.585256 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:04.585369 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-conf-dir\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585369 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.585313 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs podName:1f7d1a45-ddaa-468f-b8ca-427b0c66fb04 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:05.085293831 +0000 UTC m=+3.128541442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs") pod "network-metrics-daemon-wj7jq" (UID: "1f7d1a45-ddaa-468f-b8ca-427b0c66fb04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:04.585369 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585329 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-conf-dir\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585369 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a523ad61-1003-4072-a5fc-34ce5c564562-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fbb7e09-a658-4fbb-a203-fd9ef176a246-cni-binary-copy\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-socket-dir-parent\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-hostroot\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a523ad61-1003-4072-a5fc-34ce5c564562-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a523ad61-1003-4072-a5fc-34ce5c564562-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585465 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a523ad61-1003-4072-a5fc-34ce5c564562-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585489 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-socket-dir-parent\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddqhn\" (UniqueName: \"kubernetes.io/projected/a523ad61-1003-4072-a5fc-34ce5c564562-kube-api-access-ddqhn\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8559d\" (UniqueName: \"kubernetes.io/projected/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-kube-api-access-8559d\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-cni-dir\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-var-lib-cni-bin\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585624 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-var-lib-cni-multus\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgcg8\" (UniqueName: \"kubernetes.io/projected/2fbb7e09-a658-4fbb-a203-fd9ef176a246-kube-api-access-qgcg8\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vj4\" (UniqueName: \"kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4\") pod \"network-check-target-cptf6\" (UID: \"c531254c-20b6-4fd1-a34c-bf6ae5c17288\") " pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a523ad61-1003-4072-a5fc-34ce5c564562-cni-binary-copy\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-var-lib-kubelet\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-daemon-config\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-run-multus-certs\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585749 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-etc-kubernetes\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-run-netns\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-cnibin\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-run-k8s-cni-cncf-io\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a523ad61-1003-4072-a5fc-34ce5c564562-system-cni-dir\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-system-cni-dir\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585837 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a523ad61-1003-4072-a5fc-34ce5c564562-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585872 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fbb7e09-a658-4fbb-a203-fd9ef176a246-cni-binary-copy\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585878 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-hostroot\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585908 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-system-cni-dir\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.585969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.585920 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-var-lib-kubelet\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586098 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-cni-dir\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-var-lib-cni-bin\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586147 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-var-lib-cni-multus\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586189 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a523ad61-1003-4072-a5fc-34ce5c564562-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586351 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fbb7e09-a658-4fbb-a203-fd9ef176a246-multus-daemon-config\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586397 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-run-multus-certs\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586404 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-run-netns\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-etc-kubernetes\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586438 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-cnibin\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586453 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fbb7e09-a658-4fbb-a203-fd9ef176a246-host-run-k8s-cni-cncf-io\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586464 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a523ad61-1003-4072-a5fc-34ce5c564562-system-cni-dir\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.586685 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.586671 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a523ad61-1003-4072-a5fc-34ce5c564562-cni-binary-copy\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.609610 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.609585 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddqhn\" (UniqueName: \"kubernetes.io/projected/a523ad61-1003-4072-a5fc-34ce5c564562-kube-api-access-ddqhn\") pod \"multus-additional-cni-plugins-xtvb6\" (UID: \"a523ad61-1003-4072-a5fc-34ce5c564562\") " pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.609825 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.609795 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:34:04.609825 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.609825 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:34:04.609938 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.609839 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b9vj4 for pod openshift-network-diagnostics/network-check-target-cptf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:04.609938 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.609906 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4 podName:c531254c-20b6-4fd1-a34c-bf6ae5c17288 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:05.109877377 +0000 UTC m=+3.153125001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b9vj4" (UniqueName: "kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4") pod "network-check-target-cptf6" (UID: "c531254c-20b6-4fd1-a34c-bf6ae5c17288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:04.612718 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.612693 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgcg8\" (UniqueName: \"kubernetes.io/projected/2fbb7e09-a658-4fbb-a203-fd9ef176a246-kube-api-access-qgcg8\") pod \"multus-v27dm\" (UID: \"2fbb7e09-a658-4fbb-a203-fd9ef176a246\") " pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.613216 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.613196 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8559d\" (UniqueName: \"kubernetes.io/projected/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-kube-api-access-8559d\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:04.682466 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.682443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tcx97" Sep 15 12:34:04.684876 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.684861 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 12:34:04.692269 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.692248 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:04.706754 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.706732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zr8w8" Sep 15 12:34:04.710253 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.710221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:04.719148 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.719121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" Sep 15 12:34:04.727974 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.727956 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-phcb7" Sep 15 12:34:04.737867 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.737844 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z2x4p" Sep 15 12:34:04.745105 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.745082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v27dm" Sep 15 12:34:04.752124 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.752106 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" Sep 15 12:34:04.988371 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:04.988339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:04.988556 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.988465 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:04.988556 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:04.988521 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret podName:1a879af0-932e-4723-8e63-4741e13aca35 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:05.988504581 +0000 UTC m=+4.031752169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret") pod "global-pull-secret-syncer-62k6l" (UID: "1a879af0-932e-4723-8e63-4741e13aca35") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:05.089092 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:05.089060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:05.089260 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:05.089242 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:05.089315 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:05.089307 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs podName:1f7d1a45-ddaa-468f-b8ca-427b0c66fb04 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:06.089287813 +0000 UTC m=+4.132535405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs") pod "network-metrics-daemon-wj7jq" (UID: "1f7d1a45-ddaa-468f-b8ca-427b0c66fb04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:05.189831 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:05.189800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vj4\" (UniqueName: \"kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4\") pod \"network-check-target-cptf6\" (UID: \"c531254c-20b6-4fd1-a34c-bf6ae5c17288\") " pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:05.190000 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:05.189975 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:34:05.190051 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:05.190006 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:34:05.190051 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:05.190018 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b9vj4 for pod openshift-network-diagnostics/network-check-target-cptf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:05.190127 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:05.190081 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4 podName:c531254c-20b6-4fd1-a34c-bf6ae5c17288 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:06.190061022 +0000 UTC m=+4.233308637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9vj4" (UniqueName: "kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4") pod "network-check-target-cptf6" (UID: "c531254c-20b6-4fd1-a34c-bf6ae5c17288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:05.409767 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:05.409687 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 12:29:05 +0000 UTC" deadline="2028-02-12 11:56:53.005110526 +0000 UTC" Sep 15 12:34:05.409767 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:05.409714 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12359h22m47.595400162s" Sep 15 12:34:05.754187 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:05.754143 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda523ad61_1003_4072_a5fc_34ce5c564562.slice/crio-e96c6a8505bf2cf28271637ff36472752bf6121fbef17530c1d1d37fc3ec7274 WatchSource:0}: Error finding container e96c6a8505bf2cf28271637ff36472752bf6121fbef17530c1d1d37fc3ec7274: Status 404 returned error can't find the container with id e96c6a8505bf2cf28271637ff36472752bf6121fbef17530c1d1d37fc3ec7274 Sep 15 12:34:05.762706 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:05.762682 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d627cd_9fbd_4577_bbe7_6673f64d1128.slice/crio-6da2310321bef2e495a4430364742af179932cf37b6deaf6e5e1ddbc62080888 WatchSource:0}: Error finding container 6da2310321bef2e495a4430364742af179932cf37b6deaf6e5e1ddbc62080888: Status 404 returned error can't find the container with id 6da2310321bef2e495a4430364742af179932cf37b6deaf6e5e1ddbc62080888 Sep 15 12:34:05.764769 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:05.764733 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fbb7e09_a658_4fbb_a203_fd9ef176a246.slice/crio-d12e2890436d03671f8f27309776fb8a77cb41e21553ae9e9aeb433e62af3d78 WatchSource:0}: Error finding container d12e2890436d03671f8f27309776fb8a77cb41e21553ae9e9aeb433e62af3d78: Status 404 returned error can't find the container with id d12e2890436d03671f8f27309776fb8a77cb41e21553ae9e9aeb433e62af3d78 Sep 15 12:34:05.766006 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:05.765983 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11bbfa0d_be73_43f9_892e_54c24632af38.slice/crio-846c63d00daccee11467b48f7398f4a8bd3bdea2067846c7aa1dba7d65c756bc WatchSource:0}: Error finding container 846c63d00daccee11467b48f7398f4a8bd3bdea2067846c7aa1dba7d65c756bc: Status 404 returned error can't find the container with id 846c63d00daccee11467b48f7398f4a8bd3bdea2067846c7aa1dba7d65c756bc Sep 15 12:34:05.770713 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:05.770674 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62de769f_9b0d_40f1_81bf_985f1d81da81.slice/crio-1b582a09afea5bb761785abf1a5298cd80dcbdc6772b867df89f7a0f89d2ee41 WatchSource:0}: Error finding container 1b582a09afea5bb761785abf1a5298cd80dcbdc6772b867df89f7a0f89d2ee41: Status 404 returned error can't find the container with id 1b582a09afea5bb761785abf1a5298cd80dcbdc6772b867df89f7a0f89d2ee41 Sep 15 12:34:05.994003 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:05.993977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:05.994116 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:05.994079 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:05.994159 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:05.994130 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret podName:1a879af0-932e-4723-8e63-4741e13aca35 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:07.994115239 +0000 UTC m=+6.037362841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret") pod "global-pull-secret-syncer-62k6l" (UID: "1a879af0-932e-4723-8e63-4741e13aca35") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:06.095347 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.095320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:06.095478 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:06.095459 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:06.095533 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:06.095510 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs podName:1f7d1a45-ddaa-468f-b8ca-427b0c66fb04 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:08.095496758 +0000 UTC m=+6.138744350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs") pod "network-metrics-daemon-wj7jq" (UID: "1f7d1a45-ddaa-468f-b8ca-427b0c66fb04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:06.196157 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.196126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vj4\" (UniqueName: \"kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4\") pod \"network-check-target-cptf6\" (UID: \"c531254c-20b6-4fd1-a34c-bf6ae5c17288\") " pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:06.196333 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:06.196313 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:34:06.196400 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:06.196342 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:34:06.196400 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:06.196356 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b9vj4 for pod openshift-network-diagnostics/network-check-target-cptf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:06.196513 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:06.196420 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4 podName:c531254c-20b6-4fd1-a34c-bf6ae5c17288 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:08.196399857 +0000 UTC m=+6.239647460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9vj4" (UniqueName: "kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4") pod "network-check-target-cptf6" (UID: "c531254c-20b6-4fd1-a34c-bf6ae5c17288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:06.410233 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.410103 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 12:29:05 +0000 UTC" deadline="2028-04-04 17:21:11.052862242 +0000 UTC" Sep 15 12:34:06.410233 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.410161 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13612h47m4.642705184s" Sep 15 12:34:06.451405 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.451373 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:06.452031 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.451589 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:06.452031 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:06.451675 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:06.452031 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.451803 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:06.452031 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:06.451913 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:06.452440 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:06.452397 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:06.464959 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.464932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" event={"ID":"a523ad61-1003-4072-a5fc-34ce5c564562","Type":"ContainerStarted","Data":"e96c6a8505bf2cf28271637ff36472752bf6121fbef17530c1d1d37fc3ec7274"} Sep 15 12:34:06.467949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.467925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal" event={"ID":"b2f52dba7b06215d463d19570335e32a","Type":"ContainerStarted","Data":"93c00bddcfe64d3931dd286699d898126fd2bfff7160505a2b27ed423ee0f405"} Sep 15 12:34:06.475754 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.475726 2577 generic.go:356] "Generic (PLEG): container finished" podID="9f05b1603fcff14d679e1b26fe871dd9" containerID="8516341ecff2e6a12912dd7b47bfe615d383538c1f279a78602fc6083289bef8" exitCode=0 Sep 15 12:34:06.475873 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.475813 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" event={"ID":"9f05b1603fcff14d679e1b26fe871dd9","Type":"ContainerDied","Data":"8516341ecff2e6a12912dd7b47bfe615d383538c1f279a78602fc6083289bef8"} Sep 15 12:34:06.479327 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.479299 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v27dm" event={"ID":"2fbb7e09-a658-4fbb-a203-fd9ef176a246","Type":"ContainerStarted","Data":"d12e2890436d03671f8f27309776fb8a77cb41e21553ae9e9aeb433e62af3d78"} Sep 15 12:34:06.481913 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.481887 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zr8w8" event={"ID":"523809b4-42bc-4780-9955-952204e85b4d","Type":"ContainerStarted","Data":"134fee5632e0e2e7c34c1d2f5902a731ed11f40d5c68edfbe26576dc38e3f2eb"} Sep 15 12:34:06.485526 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.485465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z2x4p" event={"ID":"10d627cd-9fbd-4577-bbe7-6673f64d1128","Type":"ContainerStarted","Data":"6da2310321bef2e495a4430364742af179932cf37b6deaf6e5e1ddbc62080888"} Sep 15 12:34:06.487871 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.487844 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-phcb7" event={"ID":"79346abd-b9d2-43ae-826c-15595d93fb31","Type":"ContainerStarted","Data":"1c3dfaa0ac0cd32ccdf7bdaf1948ec885289d2afbdc09090d3606bb2bfcbc30c"} Sep 15 12:34:06.490674 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.490604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hf76k" event={"ID":"4782aaed-5fcf-4ec2-bd25-e0c7bcea509c","Type":"ContainerStarted","Data":"1963f47b542d82ee3913ecb17004fd58600fa2fd8b3032cb872c5894a72a53de"} Sep 15 12:34:06.493328 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.493296 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" event={"ID":"62de769f-9b0d-40f1-81bf-985f1d81da81","Type":"ContainerStarted","Data":"1b582a09afea5bb761785abf1a5298cd80dcbdc6772b867df89f7a0f89d2ee41"} Sep 15 12:34:06.496640 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.496571 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tcx97" event={"ID":"11bbfa0d-be73-43f9-892e-54c24632af38","Type":"ContainerStarted","Data":"846c63d00daccee11467b48f7398f4a8bd3bdea2067846c7aa1dba7d65c756bc"} Sep 15 12:34:06.498190 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.498126 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" event={"ID":"b9865c01-7625-45c3-b057-a938d8303c98","Type":"ContainerStarted","Data":"7070b2de8b15cb045156dd7c44200a40f594a5c000f6d0280f1b326c9560cff8"} Sep 15 12:34:06.502416 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:06.502066 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-90.ec2.internal" podStartSLOduration=2.502049358 podStartE2EDuration="2.502049358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:06.484767786 +0000 UTC m=+4.528015400" watchObservedRunningTime="2026-09-15 12:34:06.502049358 +0000 UTC m=+4.545296972" Sep 15 12:34:07.504393 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:07.504322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" event={"ID":"9f05b1603fcff14d679e1b26fe871dd9","Type":"ContainerStarted","Data":"00b67331dc45f2a8c3575cc804f3aa1dc8da3aed50f3a7b99be2bd1a9d2609f0"} Sep 15 12:34:08.013376 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:08.012940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:08.013376 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.013103 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:08.013376 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.013178 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret podName:1a879af0-932e-4723-8e63-4741e13aca35 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:12.013153977 +0000 UTC m=+10.056401590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret") pod "global-pull-secret-syncer-62k6l" (UID: "1a879af0-932e-4723-8e63-4741e13aca35") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:08.113614 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:08.113580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:08.113804 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.113742 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:08.113890 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.113819 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs podName:1f7d1a45-ddaa-468f-b8ca-427b0c66fb04 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:12.113796147 +0000 UTC m=+10.157043755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs") pod "network-metrics-daemon-wj7jq" (UID: "1f7d1a45-ddaa-468f-b8ca-427b0c66fb04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:08.214691 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:08.214657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vj4\" (UniqueName: \"kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4\") pod \"network-check-target-cptf6\" (UID: \"c531254c-20b6-4fd1-a34c-bf6ae5c17288\") " pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:08.214856 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.214836 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:34:08.214856 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.214857 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:34:08.214999 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.214868 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b9vj4 for pod openshift-network-diagnostics/network-check-target-cptf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:08.214999 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.214919 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4 podName:c531254c-20b6-4fd1-a34c-bf6ae5c17288 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:12.214899374 +0000 UTC m=+10.258146982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9vj4" (UniqueName: "kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4") pod "network-check-target-cptf6" (UID: "c531254c-20b6-4fd1-a34c-bf6ae5c17288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:08.450402 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:08.450369 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:08.450573 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:08.450419 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:08.450573 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:08.450419 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:08.450573 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.450523 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:08.450745 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.450644 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:08.450745 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:08.450718 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:10.450385 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:10.450357 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:10.450905 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:10.450500 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:10.450905 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:10.450897 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:10.451027 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:10.450990 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:10.451380 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:10.451197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:10.451380 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:10.451290 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:12.048409 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:12.048358 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:12.048810 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.048519 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:12.048810 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.048575 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret podName:1a879af0-932e-4723-8e63-4741e13aca35 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:20.048556466 +0000 UTC m=+18.091804074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret") pod "global-pull-secret-syncer-62k6l" (UID: "1a879af0-932e-4723-8e63-4741e13aca35") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:12.149523 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:12.149487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:12.149712 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.149663 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:12.149756 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.149730 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs podName:1f7d1a45-ddaa-468f-b8ca-427b0c66fb04 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:20.149710798 +0000 UTC m=+18.192958390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs") pod "network-metrics-daemon-wj7jq" (UID: "1f7d1a45-ddaa-468f-b8ca-427b0c66fb04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:12.250579 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:12.250545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vj4\" (UniqueName: \"kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4\") pod \"network-check-target-cptf6\" (UID: \"c531254c-20b6-4fd1-a34c-bf6ae5c17288\") " pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:12.250798 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.250780 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:34:12.250882 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.250802 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:34:12.250882 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.250815 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b9vj4 for pod openshift-network-diagnostics/network-check-target-cptf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:12.250882 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.250882 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4 podName:c531254c-20b6-4fd1-a34c-bf6ae5c17288 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:20.250851512 +0000 UTC m=+18.294099106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9vj4" (UniqueName: "kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4") pod "network-check-target-cptf6" (UID: "c531254c-20b6-4fd1-a34c-bf6ae5c17288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:12.450398 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:12.450372 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:12.450690 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.450667 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:12.451201 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:12.451179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:12.451363 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:12.451319 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:12.452527 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.452499 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:12.452820 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:12.452742 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:14.449995 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:14.448414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:14.449995 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:14.448414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:14.449995 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:14.448414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:14.449995 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:14.448579 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:14.449995 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:14.448705 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:14.449995 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:14.448780 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:16.449227 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:16.449197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:16.449677 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:16.449197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:16.449677 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:16.449320 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:16.449677 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:16.449197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:16.449677 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:16.449385 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:16.449677 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:16.449445 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:18.449009 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:18.448979 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:18.449517 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:18.448990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:18.449517 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:18.449099 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:18.449517 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:18.449099 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:18.449517 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:18.449214 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:18.449517 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:18.449278 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:20.110014 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:20.109970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:20.110477 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.110134 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:20.110477 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.110208 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret podName:1a879af0-932e-4723-8e63-4741e13aca35 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:36.110193918 +0000 UTC m=+34.153441506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret") pod "global-pull-secret-syncer-62k6l" (UID: "1a879af0-932e-4723-8e63-4741e13aca35") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:20.210502 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:20.210465 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:20.210669 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.210628 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:20.210715 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.210697 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs podName:1f7d1a45-ddaa-468f-b8ca-427b0c66fb04 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:36.210681349 +0000 UTC m=+34.253928940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs") pod "network-metrics-daemon-wj7jq" (UID: "1f7d1a45-ddaa-468f-b8ca-427b0c66fb04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:20.311892 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:20.311849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vj4\" (UniqueName: \"kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4\") pod \"network-check-target-cptf6\" (UID: \"c531254c-20b6-4fd1-a34c-bf6ae5c17288\") " pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:20.312067 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.312045 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:34:20.312119 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.312076 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:34:20.312119 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.312090 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b9vj4 for pod openshift-network-diagnostics/network-check-target-cptf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:20.312225 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.312155 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4 podName:c531254c-20b6-4fd1-a34c-bf6ae5c17288 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:36.312137371 +0000 UTC m=+34.355384976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9vj4" (UniqueName: "kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4") pod "network-check-target-cptf6" (UID: "c531254c-20b6-4fd1-a34c-bf6ae5c17288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:20.449532 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:20.449501 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:20.449532 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:20.449528 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:20.449761 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:20.449633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:20.449761 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.449646 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:20.449761 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.449725 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:20.449889 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:20.449818 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:22.449671 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:22.449216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:22.449671 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:22.449239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:22.449671 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:22.449342 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:22.449671 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:22.449434 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:22.449671 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:22.449449 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:22.449671 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:22.449539 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:24.448910 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.448722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:24.449767 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.448722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:24.449767 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.448801 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:24.449767 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:24.449025 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:24.449767 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:24.449117 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:24.449767 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:24.449236 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:24.544050 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.544003 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v27dm" event={"ID":"2fbb7e09-a658-4fbb-a203-fd9ef176a246","Type":"ContainerStarted","Data":"f36331d085c7ffc9b644463fc3188346aff4a651f00c3ee256521c0f88c9258d"} Sep 15 12:34:24.545446 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.545422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z2x4p" event={"ID":"10d627cd-9fbd-4577-bbe7-6673f64d1128","Type":"ContainerStarted","Data":"e7d1d03e11da681253206f18920202c1f006fad14eb955ea98418ead97324453"} Sep 15 12:34:24.546841 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.546820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-phcb7" event={"ID":"79346abd-b9d2-43ae-826c-15595d93fb31","Type":"ContainerStarted","Data":"aec479e6bd68bc0bd71473fd20fb14893dfed944c22390e0d60ee35d18f425c5"} Sep 15 12:34:24.548259 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.548238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hf76k" event={"ID":"4782aaed-5fcf-4ec2-bd25-e0c7bcea509c","Type":"ContainerStarted","Data":"a2948ed5dc8b29e6663ff12470d8e992a39444f998cb5da36fe3aade3f7c6840"} Sep 15 12:34:24.551584 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.551556 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" event={"ID":"62de769f-9b0d-40f1-81bf-985f1d81da81","Type":"ContainerStarted","Data":"ae116cdd401adee4a698b4f0ba4da00b626cd44a3bf065ac92dcac79240ecce1"} Sep 15 12:34:24.551687 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.551640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" event={"ID":"62de769f-9b0d-40f1-81bf-985f1d81da81","Type":"ContainerStarted","Data":"4e97992a65a3ff8fafff5e6536d02cd8b13b5f8e03efac9d1f4bf18df5fd91b9"} Sep 15 12:34:24.551734 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.551692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" event={"ID":"62de769f-9b0d-40f1-81bf-985f1d81da81","Type":"ContainerStarted","Data":"0b1e72d2111a4a43a2d60b2a944edd3c516e6f7b178ff5eda49bc2bb4ecb0793"} Sep 15 12:34:24.551779 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.551740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" event={"ID":"62de769f-9b0d-40f1-81bf-985f1d81da81","Type":"ContainerStarted","Data":"6ac5da09b61a1077a7426b62561345fb54921be95b45aaf9dbbad1b5f129d41c"} Sep 15 12:34:24.551826 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.551791 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" event={"ID":"62de769f-9b0d-40f1-81bf-985f1d81da81","Type":"ContainerStarted","Data":"bb5d0664c7dd1f229e8a902098bac3400a5de1a9ed25ac171ca9caa5cc242ff4"} Sep 15 12:34:24.551930 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.551839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" event={"ID":"62de769f-9b0d-40f1-81bf-985f1d81da81","Type":"ContainerStarted","Data":"615ae1c2a6e63d40e59abd3a2fe995d5a88a7fc0b7463c7f1c6224eb7c7d7859"} Sep 15 12:34:24.553241 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.553216 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tcx97" event={"ID":"11bbfa0d-be73-43f9-892e-54c24632af38","Type":"ContainerStarted","Data":"d25dac0ffeb4b69afab9e4ec7a6f88adf0925c71492a4b4a2557988040b9fbb0"} Sep 15 12:34:24.554837 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.554812 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" event={"ID":"b9865c01-7625-45c3-b057-a938d8303c98","Type":"ContainerStarted","Data":"b82261ddbfcfeb0d4e81be0414da889bab136a71253fc3b674d667b8f4afc06d"} Sep 15 12:34:24.556456 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.556428 2577 generic.go:356] "Generic (PLEG): container finished" podID="a523ad61-1003-4072-a5fc-34ce5c564562" containerID="74472e1e2d933b72aba8924da74e97935e394dae123d21b2b650c8222b8847be" exitCode=0 Sep 15 12:34:24.556536 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.556470 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" event={"ID":"a523ad61-1003-4072-a5fc-34ce5c564562","Type":"ContainerDied","Data":"74472e1e2d933b72aba8924da74e97935e394dae123d21b2b650c8222b8847be"} Sep 15 12:34:24.561757 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.561720 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-90.ec2.internal" podStartSLOduration=20.561708658 podStartE2EDuration="20.561708658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:07.528468301 +0000 UTC m=+5.571715915" watchObservedRunningTime="2026-09-15 12:34:24.561708658 +0000 UTC m=+22.604956263" Sep 15 12:34:24.561854 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.561786 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v27dm" podStartSLOduration=3.563653775 podStartE2EDuration="21.561780268s" totalImagesPullingTime="17.998126493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:24.561257351 +0000 UTC m=+22.604504960" watchObservedRunningTime="2026-09-15 12:34:24.561780268 +0000 UTC m=+22.605027877" Sep 15 12:34:24.579406 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.579311 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-phcb7" podStartSLOduration=3.632387086 podStartE2EDuration="21.579297724s" totalImagesPullingTime="17.946910638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:24.57901603 +0000 UTC m=+22.622263639" watchObservedRunningTime="2026-09-15 12:34:24.579297724 +0000 UTC m=+22.622545329" Sep 15 12:34:24.619437 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.619387 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z2x4p" podStartSLOduration=11.215674986 podStartE2EDuration="21.619369633s" totalImagesPullingTime="10.403694647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:24.618898359 +0000 UTC m=+22.662145971" watchObservedRunningTime="2026-09-15 12:34:24.619369633 +0000 UTC m=+22.662617242" Sep 15 12:34:24.657808 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.657759 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tcx97" podStartSLOduration=3.723303377 podStartE2EDuration="21.657741463s" totalImagesPullingTime="17.934438086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:24.638774703 +0000 UTC m=+22.682022319" watchObservedRunningTime="2026-09-15 12:34:24.657741463 +0000 UTC m=+22.700989073" Sep 15 12:34:24.658154 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.658118 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hf76k" podStartSLOduration=13.214465438 podStartE2EDuration="21.65810384s" totalImagesPullingTime="8.443638402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:24.657571105 +0000 UTC m=+22.700818713" watchObservedRunningTime="2026-09-15 12:34:24.65810384 +0000 UTC m=+22.701351453" Sep 15 12:34:24.848473 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.848323 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 15 12:34:24.863552 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.863529 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:24.863999 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:24.863982 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:25.423489 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:25.423335 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T12:34:24.848468904Z","UUID":"d3a0c0cc-5625-4ab0-b6c5-ce90546c387c","Handler":null,"Name":"","Endpoint":""} Sep 15 12:34:25.425357 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:25.425318 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 15 12:34:25.425357 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:25.425355 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 15 12:34:25.561639 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:25.561602 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" event={"ID":"b9865c01-7625-45c3-b057-a938d8303c98","Type":"ContainerStarted","Data":"affbf3f7e18ea48967c9f1121f08cfdae393780c7bccf28b49d5d003b77c1342"} Sep 15 12:34:25.563282 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:25.563255 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zr8w8" event={"ID":"523809b4-42bc-4780-9955-952204e85b4d","Type":"ContainerStarted","Data":"49e02c0529f692c21117fd4bbec3e0b798093c40ab24fcd24c299bcb4255d790"} Sep 15 12:34:25.563791 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:25.563769 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:25.564371 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:25.564352 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hf76k" Sep 15 12:34:25.579904 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:25.579854 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zr8w8" podStartSLOduration=4.704433202 podStartE2EDuration="22.579841454s" totalImagesPullingTime="17.875408252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:25.579398997 +0000 UTC m=+23.622646606" watchObservedRunningTime="2026-09-15 12:34:25.579841454 +0000 UTC m=+23.623089173" Sep 15 12:34:26.449450 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:26.449428 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:26.449571 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:26.449430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:26.449571 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:26.449547 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:26.449672 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:26.449441 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:26.449672 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:26.449628 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:26.449767 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:26.449670 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:26.569470 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:26.569393 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" event={"ID":"62de769f-9b0d-40f1-81bf-985f1d81da81","Type":"ContainerStarted","Data":"b9cfd5f14849d2bd15c103267c1522f55834bd31e550a64ccebc216e18ac18dc"} Sep 15 12:34:26.572120 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:26.571720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" event={"ID":"b9865c01-7625-45c3-b057-a938d8303c98","Type":"ContainerStarted","Data":"2a5bd649f4a9b8606f3ddfea4d7352e1b4650e01fc08ccb296b7925c36b188fa"} Sep 15 12:34:26.614477 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:26.614406 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjww7" podStartSLOduration=3.332155321 podStartE2EDuration="23.614391084s" totalImagesPullingTime="20.282235763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:26.614309135 +0000 UTC m=+24.657556744" watchObservedRunningTime="2026-09-15 12:34:26.614391084 +0000 UTC m=+24.657638693" Sep 15 12:34:28.448887 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:28.448813 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:28.448887 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:28.448819 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:28.449320 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:28.448950 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:28.449320 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:28.448993 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:28.449320 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:28.449097 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:28.449320 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:28.449231 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:29.583547 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:29.583098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" event={"ID":"62de769f-9b0d-40f1-81bf-985f1d81da81","Type":"ContainerStarted","Data":"86278d7687664651e139976322f051c3a61359d634dba9013bfc3db07ad8d87c"} Sep 15 12:34:29.583547 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:29.583463 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:29.583547 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:29.583521 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:29.585465 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:29.585438 2577 generic.go:356] "Generic (PLEG): container finished" podID="a523ad61-1003-4072-a5fc-34ce5c564562" containerID="ed445c37952b38ea9cd45fff557b369c0d56680781c0b54e1cf481fbc87b888a" exitCode=0 Sep 15 12:34:29.585583 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:29.585485 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" event={"ID":"a523ad61-1003-4072-a5fc-34ce5c564562","Type":"ContainerDied","Data":"ed445c37952b38ea9cd45fff557b369c0d56680781c0b54e1cf481fbc87b888a"} Sep 15 12:34:29.600710 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:29.600690 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:29.613466 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:29.613425 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" podStartSLOduration=8.65808013 podStartE2EDuration="26.613410576s" totalImagesPullingTime="17.955330446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:29.613243588 +0000 UTC m=+27.656491196" watchObservedRunningTime="2026-09-15 12:34:29.613410576 +0000 UTC m=+27.656658186" Sep 15 12:34:30.449277 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.449247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:30.449411 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.449251 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:30.449411 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:30.449353 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:30.449411 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.449393 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:30.449570 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:30.449483 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:30.449570 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:30.449550 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:30.503023 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.502955 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cptf6"] Sep 15 12:34:30.505960 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.505899 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-62k6l"] Sep 15 12:34:30.506478 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.506461 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wj7jq"] Sep 15 12:34:30.588065 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.588042 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:30.588065 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.588063 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:30.588809 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.588051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:30.588809 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:30.588142 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:30.588809 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:30.588257 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:30.588809 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.588265 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:30.588809 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:30.588773 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:30.603545 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:30.603527 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:34:31.592923 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:31.592891 2577 generic.go:356] "Generic (PLEG): container finished" podID="a523ad61-1003-4072-a5fc-34ce5c564562" containerID="7fcf79a2bb2a087bbdbee0208453615d3228b02da0492441b7d4a30284f0cfdf" exitCode=0 Sep 15 12:34:31.593390 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:31.593245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" event={"ID":"a523ad61-1003-4072-a5fc-34ce5c564562","Type":"ContainerDied","Data":"7fcf79a2bb2a087bbdbee0208453615d3228b02da0492441b7d4a30284f0cfdf"} Sep 15 12:34:32.450005 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:32.449976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:32.450005 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:32.450003 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:32.450252 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:32.450075 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:32.450252 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:32.450188 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:32.450394 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:32.450265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:32.450394 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:32.450347 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:33.600208 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:33.600169 2577 generic.go:356] "Generic (PLEG): container finished" podID="a523ad61-1003-4072-a5fc-34ce5c564562" containerID="7c3c3080af60d796e299ff88bf18d3baacade1954e5a52bc269e08683698ddcc" exitCode=0 Sep 15 12:34:33.600208 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:33.600200 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" event={"ID":"a523ad61-1003-4072-a5fc-34ce5c564562","Type":"ContainerDied","Data":"7c3c3080af60d796e299ff88bf18d3baacade1954e5a52bc269e08683698ddcc"} Sep 15 12:34:34.449397 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:34.448927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:34.449397 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:34.448967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:34.449397 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:34.448927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:34.449397 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:34.449058 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:34.449397 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:34.449110 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:34.449397 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:34.449220 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:34.812326 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:34.812247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:34.909650 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:34.909616 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:36.127675 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:36.127644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:36.128174 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.127762 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:36.128174 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.127810 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret podName:1a879af0-932e-4723-8e63-4741e13aca35 nodeName:}" failed. No retries permitted until 2026-09-15 12:35:08.127797036 +0000 UTC m=+66.171044623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret") pod "global-pull-secret-syncer-62k6l" (UID: "1a879af0-932e-4723-8e63-4741e13aca35") : object "kube-system"/"original-pull-secret" not registered Sep 15 12:34:36.228711 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:36.228679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:36.228867 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.228846 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:36.228929 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.228916 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs podName:1f7d1a45-ddaa-468f-b8ca-427b0c66fb04 nodeName:}" failed. No retries permitted until 2026-09-15 12:35:08.228896847 +0000 UTC m=+66.272144434 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs") pod "network-metrics-daemon-wj7jq" (UID: "1f7d1a45-ddaa-468f-b8ca-427b0c66fb04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 12:34:36.329851 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:36.329819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vj4\" (UniqueName: \"kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4\") pod \"network-check-target-cptf6\" (UID: \"c531254c-20b6-4fd1-a34c-bf6ae5c17288\") " pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:36.330019 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.329983 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 12:34:36.330019 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.330009 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 12:34:36.330127 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.330023 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b9vj4 for pod openshift-network-diagnostics/network-check-target-cptf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:36.330127 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.330080 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4 podName:c531254c-20b6-4fd1-a34c-bf6ae5c17288 nodeName:}" failed. No retries permitted until 2026-09-15 12:35:08.330068051 +0000 UTC m=+66.373315638 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9vj4" (UniqueName: "kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4") pod "network-check-target-cptf6" (UID: "c531254c-20b6-4fd1-a34c-bf6ae5c17288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 12:34:36.449490 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:36.449462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:36.449659 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:36.449462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:36.449659 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.449570 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cptf6" podUID="c531254c-20b6-4fd1-a34c-bf6ae5c17288" Sep 15 12:34:36.449779 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.449678 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62k6l" podUID="1a879af0-932e-4723-8e63-4741e13aca35" Sep 15 12:34:36.449779 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:36.449462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:36.449875 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:36.449784 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj7jq" podUID="1f7d1a45-ddaa-468f-b8ca-427b0c66fb04" Sep 15 12:34:37.736482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.736454 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-90.ec2.internal" event="NodeReady" Sep 15 12:34:37.736821 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.736584 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 15 12:34:37.791813 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.791779 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9fbpr"] Sep 15 12:34:37.808902 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.808876 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-plcqs"] Sep 15 12:34:37.809060 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.809013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9fbpr" Sep 15 12:34:37.811860 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.811571 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gsjjk\"" Sep 15 12:34:37.811860 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.811644 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 15 12:34:37.812095 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.812079 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 15 12:34:37.812150 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.812143 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 15 12:34:37.824360 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.824341 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9fbpr"] Sep 15 12:34:37.824454 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.824374 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-plcqs"] Sep 15 12:34:37.824454 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.824426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:37.827370 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.827351 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xblvz\"" Sep 15 12:34:37.827504 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.827460 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 15 12:34:37.827559 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.827549 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 15 12:34:37.941738 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.941708 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9642da35-2137-4967-9686-8a7600afa9a8-config-volume\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:37.941878 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.941755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9642da35-2137-4967-9686-8a7600afa9a8-tmp-dir\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:37.941878 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.941820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86ttt\" (UniqueName: \"kubernetes.io/projected/9642da35-2137-4967-9686-8a7600afa9a8-kube-api-access-86ttt\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:37.941878 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.941844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/929b6173-f547-4414-983a-480eadbcb7d3-cert\") pod \"ingress-canary-9fbpr\" (UID: \"929b6173-f547-4414-983a-480eadbcb7d3\") " pod="openshift-ingress-canary/ingress-canary-9fbpr" Sep 15 12:34:37.941878 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.941864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:37.942033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:37.941883 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k85l\" (UniqueName: \"kubernetes.io/projected/929b6173-f547-4414-983a-480eadbcb7d3-kube-api-access-8k85l\") pod \"ingress-canary-9fbpr\" (UID: \"929b6173-f547-4414-983a-480eadbcb7d3\") " pod="openshift-ingress-canary/ingress-canary-9fbpr" Sep 15 12:34:38.043102 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.043043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9642da35-2137-4967-9686-8a7600afa9a8-tmp-dir\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:38.043102 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.043081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86ttt\" (UniqueName: \"kubernetes.io/projected/9642da35-2137-4967-9686-8a7600afa9a8-kube-api-access-86ttt\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:38.043102 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.043098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/929b6173-f547-4414-983a-480eadbcb7d3-cert\") pod \"ingress-canary-9fbpr\" (UID: \"929b6173-f547-4414-983a-480eadbcb7d3\") " pod="openshift-ingress-canary/ingress-canary-9fbpr" Sep 15 12:34:38.043312 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.043232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:38.043312 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.043266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k85l\" (UniqueName: \"kubernetes.io/projected/929b6173-f547-4414-983a-480eadbcb7d3-kube-api-access-8k85l\") pod \"ingress-canary-9fbpr\" (UID: \"929b6173-f547-4414-983a-480eadbcb7d3\") " pod="openshift-ingress-canary/ingress-canary-9fbpr" Sep 15 12:34:38.043394 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.043326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9642da35-2137-4967-9686-8a7600afa9a8-config-volume\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:38.043394 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:38.043371 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 12:34:38.043394 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.043378 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9642da35-2137-4967-9686-8a7600afa9a8-tmp-dir\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:38.043524 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:38.043439 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls podName:9642da35-2137-4967-9686-8a7600afa9a8 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:38.543418202 +0000 UTC m=+36.586665809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls") pod "dns-default-plcqs" (UID: "9642da35-2137-4967-9686-8a7600afa9a8") : secret "dns-default-metrics-tls" not found Sep 15 12:34:38.043800 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.043784 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9642da35-2137-4967-9686-8a7600afa9a8-config-volume\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:38.047676 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.047657 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/929b6173-f547-4414-983a-480eadbcb7d3-cert\") pod \"ingress-canary-9fbpr\" (UID: \"929b6173-f547-4414-983a-480eadbcb7d3\") " pod="openshift-ingress-canary/ingress-canary-9fbpr" Sep 15 12:34:38.056856 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.056835 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86ttt\" (UniqueName: \"kubernetes.io/projected/9642da35-2137-4967-9686-8a7600afa9a8-kube-api-access-86ttt\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:38.056987 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.056908 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k85l\" (UniqueName: \"kubernetes.io/projected/929b6173-f547-4414-983a-480eadbcb7d3-kube-api-access-8k85l\") pod \"ingress-canary-9fbpr\" (UID: \"929b6173-f547-4414-983a-480eadbcb7d3\") " pod="openshift-ingress-canary/ingress-canary-9fbpr" Sep 15 12:34:38.118667 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.118468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9fbpr" Sep 15 12:34:38.448658 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.448629 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:34:38.448837 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.448683 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:34:38.448837 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.448694 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:34:38.452410 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.452389 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9fbpr"] Sep 15 12:34:38.453473 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.453235 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g4tvt\"" Sep 15 12:34:38.453473 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.453284 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zqjh7\"" Sep 15 12:34:38.453473 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.453243 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 12:34:38.453473 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.453352 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 12:34:38.453473 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.453355 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 12:34:38.453473 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.453298 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 12:34:38.453879 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:38.453858 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929b6173_f547_4414_983a_480eadbcb7d3.slice/crio-72d4b224856eae69d3498bc2e6a1900f4b3b8c524f3aca76883720fc20ca5c78 WatchSource:0}: Error finding container 72d4b224856eae69d3498bc2e6a1900f4b3b8c524f3aca76883720fc20ca5c78: Status 404 returned error can't find the container with id 72d4b224856eae69d3498bc2e6a1900f4b3b8c524f3aca76883720fc20ca5c78 Sep 15 12:34:38.546450 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.546423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:38.546592 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:38.546573 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 12:34:38.546662 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:38.546652 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls podName:9642da35-2137-4967-9686-8a7600afa9a8 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:39.546635752 +0000 UTC m=+37.589883339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls") pod "dns-default-plcqs" (UID: "9642da35-2137-4967-9686-8a7600afa9a8") : secret "dns-default-metrics-tls" not found Sep 15 12:34:38.612559 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.612477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9fbpr" event={"ID":"929b6173-f547-4414-983a-480eadbcb7d3","Type":"ContainerStarted","Data":"72d4b224856eae69d3498bc2e6a1900f4b3b8c524f3aca76883720fc20ca5c78"} Sep 15 12:34:38.617179 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.617121 2577 generic.go:356] "Generic (PLEG): container finished" podID="a523ad61-1003-4072-a5fc-34ce5c564562" containerID="03289a42fd0e9d4d928b1b2928d0601df9ce86506d72629257f66edb12cdf533" exitCode=0 Sep 15 12:34:38.617179 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:38.617181 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" event={"ID":"a523ad61-1003-4072-a5fc-34ce5c564562","Type":"ContainerDied","Data":"03289a42fd0e9d4d928b1b2928d0601df9ce86506d72629257f66edb12cdf533"} Sep 15 12:34:39.552967 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:39.552926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:39.553719 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:39.553096 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 12:34:39.553719 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:39.553194 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls podName:9642da35-2137-4967-9686-8a7600afa9a8 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:41.553154472 +0000 UTC m=+39.596402078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls") pod "dns-default-plcqs" (UID: "9642da35-2137-4967-9686-8a7600afa9a8") : secret "dns-default-metrics-tls" not found Sep 15 12:34:39.623913 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:39.623716 2577 generic.go:356] "Generic (PLEG): container finished" podID="a523ad61-1003-4072-a5fc-34ce5c564562" containerID="ad6017ef573e4d82f2cf7b3ab9d237b227544d1f728e906bf2d77947f0bf4dae" exitCode=0 Sep 15 12:34:39.623913 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:39.623794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" event={"ID":"a523ad61-1003-4072-a5fc-34ce5c564562","Type":"ContainerDied","Data":"ad6017ef573e4d82f2cf7b3ab9d237b227544d1f728e906bf2d77947f0bf4dae"} Sep 15 12:34:39.718369 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:39.718319 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:39.819404 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:39.819149 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:40.631256 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:40.631209 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" event={"ID":"a523ad61-1003-4072-a5fc-34ce5c564562","Type":"ContainerStarted","Data":"481d478fb4a41b0e2e5261847497ad5d967a3e2675982ea46e1fb9b6ea1af46e"} Sep 15 12:34:40.659516 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:40.659470 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xtvb6" podStartSLOduration=18.274632832 podStartE2EDuration="37.659450306s" totalImagesPullingTime="19.384817474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:40.657711799 +0000 UTC m=+38.700959433" watchObservedRunningTime="2026-09-15 12:34:40.659450306 +0000 UTC m=+38.702697915" Sep 15 12:34:40.792279 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:40.792133 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:40.886002 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:40.885970 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:41.150694 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.150633 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gwp8t"] Sep 15 12:34:41.165462 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.165433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:41.172808 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.172786 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gwp8t"] Sep 15 12:34:41.172909 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.172881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.175432 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.175404 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 15 12:34:41.175432 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.175424 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6mlwz\"" Sep 15 12:34:41.175625 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.175455 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 15 12:34:41.175625 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.175528 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 15 12:34:41.175625 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.175562 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 15 12:34:41.254733 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.254713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:41.343707 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.343684 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:41.367869 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.367851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3fb5e08-d821-42e2-aaac-86eff39f0c37-data-volume\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.367941 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.367912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3fb5e08-d821-42e2-aaac-86eff39f0c37-crio-socket\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.367989 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.367947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.367989 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.367980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhcjq\" (UniqueName: \"kubernetes.io/projected/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-api-access-jhcjq\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.368105 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.368083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.449049 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.449023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:41.469312 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.469288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3fb5e08-d821-42e2-aaac-86eff39f0c37-crio-socket\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.469437 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.469326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.469437 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.469345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhcjq\" (UniqueName: \"kubernetes.io/projected/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-api-access-jhcjq\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.469437 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.469386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.469437 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.469417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3fb5e08-d821-42e2-aaac-86eff39f0c37-data-volume\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.469646 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:41.469448 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 12:34:41.469646 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:41.469473 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 12:34:41.469646 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.469508 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3fb5e08-d821-42e2-aaac-86eff39f0c37-crio-socket\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.469646 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:41.469518 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm podName:d3fb5e08-d821-42e2-aaac-86eff39f0c37 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:41.969499766 +0000 UTC m=+40.012747373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwp8t" (UID: "d3fb5e08-d821-42e2-aaac-86eff39f0c37") : configmap "kube-rbac-proxy" not found Sep 15 12:34:41.469646 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:41.469540 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls podName:d3fb5e08-d821-42e2-aaac-86eff39f0c37 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:41.969529945 +0000 UTC m=+40.012777536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwp8t" (UID: "d3fb5e08-d821-42e2-aaac-86eff39f0c37") : secret "insights-runtime-extractor-tls" not found Sep 15 12:34:41.469925 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.469764 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3fb5e08-d821-42e2-aaac-86eff39f0c37-data-volume\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.491654 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.491626 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b"] Sep 15 12:34:41.495707 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.495687 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhcjq\" (UniqueName: \"kubernetes.io/projected/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-api-access-jhcjq\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.512643 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.512618 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b"] Sep 15 12:34:41.512754 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.512711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b" Sep 15 12:34:41.515228 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.515208 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 15 12:34:41.515334 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.515315 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-g6fxv\"" Sep 15 12:34:41.515334 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.515319 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 15 12:34:41.552355 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.552302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:41.570755 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.570724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:41.570881 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:41.570852 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 12:34:41.570941 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:41.570915 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls podName:9642da35-2137-4967-9686-8a7600afa9a8 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:45.570896907 +0000 UTC m=+43.614144495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls") pod "dns-default-plcqs" (UID: "9642da35-2137-4967-9686-8a7600afa9a8") : secret "dns-default-metrics-tls" not found Sep 15 12:34:41.635426 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.635392 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9fbpr" event={"ID":"929b6173-f547-4414-983a-480eadbcb7d3","Type":"ContainerStarted","Data":"08bc2df833e97859c8ddbab39fe684434835833cdbc04665bf6a7fee30c37922"} Sep 15 12:34:41.644877 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.644845 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:41.664600 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.664558 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9fbpr" podStartSLOduration=1.8223713940000001 podStartE2EDuration="4.664543489s" totalImagesPullingTime="2.842172095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:41.663597299 +0000 UTC m=+39.706844910" watchObservedRunningTime="2026-09-15 12:34:41.664543489 +0000 UTC m=+39.707791098" Sep 15 12:34:41.671282 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.671231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghx94\" (UniqueName: \"kubernetes.io/projected/082d00b8-fe7e-4da8-b11b-3657c951115f-kube-api-access-ghx94\") pod \"migrator-8b4d697c5-5zp9b\" (UID: \"082d00b8-fe7e-4da8-b11b-3657c951115f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b" Sep 15 12:34:41.741241 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.741210 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:41.772475 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.772450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghx94\" (UniqueName: \"kubernetes.io/projected/082d00b8-fe7e-4da8-b11b-3657c951115f-kube-api-access-ghx94\") pod \"migrator-8b4d697c5-5zp9b\" (UID: \"082d00b8-fe7e-4da8-b11b-3657c951115f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b" Sep 15 12:34:41.784600 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.784577 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghx94\" (UniqueName: \"kubernetes.io/projected/082d00b8-fe7e-4da8-b11b-3657c951115f-kube-api-access-ghx94\") pod \"migrator-8b4d697c5-5zp9b\" (UID: \"082d00b8-fe7e-4da8-b11b-3657c951115f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b" Sep 15 12:34:41.823900 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.823878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b" Sep 15 12:34:41.974042 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.974009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.974194 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.974062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:41.974194 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:41.974140 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 12:34:41.974294 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:41.974199 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 12:34:41.974294 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:41.974236 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm podName:d3fb5e08-d821-42e2-aaac-86eff39f0c37 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:42.974213609 +0000 UTC m=+41.017461196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwp8t" (UID: "d3fb5e08-d821-42e2-aaac-86eff39f0c37") : configmap "kube-rbac-proxy" not found Sep 15 12:34:41.974294 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:41.974262 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls podName:d3fb5e08-d821-42e2-aaac-86eff39f0c37 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:42.974246085 +0000 UTC m=+41.017493693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwp8t" (UID: "d3fb5e08-d821-42e2-aaac-86eff39f0c37") : secret "insights-runtime-extractor-tls" not found Sep 15 12:34:41.985656 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:41.985632 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:42.085181 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:42.085128 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:42.113245 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:42.113222 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b"] Sep 15 12:34:42.115990 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:42.115967 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082d00b8_fe7e_4da8_b11b_3657c951115f.slice/crio-b9db3bc973eaba0641dd6617f657ffdb7f5ad775fb5d6c8f5e89d058179b0312 WatchSource:0}: Error finding container b9db3bc973eaba0641dd6617f657ffdb7f5ad775fb5d6c8f5e89d058179b0312: Status 404 returned error can't find the container with id b9db3bc973eaba0641dd6617f657ffdb7f5ad775fb5d6c8f5e89d058179b0312 Sep 15 12:34:42.579099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:42.579050 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:42.638405 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:42.638380 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b" event={"ID":"082d00b8-fe7e-4da8-b11b-3657c951115f","Type":"ContainerStarted","Data":"b9db3bc973eaba0641dd6617f657ffdb7f5ad775fb5d6c8f5e89d058179b0312"} Sep 15 12:34:42.648804 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:42.648774 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:42.812716 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:42.812677 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:42.913154 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:42.913065 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:42.980682 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:42.980645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:42.980849 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:42.980770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:42.980849 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:42.980810 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 12:34:42.980957 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:42.980883 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 12:34:42.980957 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:42.980890 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls podName:d3fb5e08-d821-42e2-aaac-86eff39f0c37 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:44.980869151 +0000 UTC m=+43.024116757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwp8t" (UID: "d3fb5e08-d821-42e2-aaac-86eff39f0c37") : secret "insights-runtime-extractor-tls" not found Sep 15 12:34:42.980957 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:42.980950 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm podName:d3fb5e08-d821-42e2-aaac-86eff39f0c37 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:44.980933436 +0000 UTC m=+43.024181030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwp8t" (UID: "d3fb5e08-d821-42e2-aaac-86eff39f0c37") : configmap "kube-rbac-proxy" not found Sep 15 12:34:43.325722 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:43.325703 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2x4p_10d627cd-9fbd-4577-bbe7-6673f64d1128/dns-node-resolver/0.log" Sep 15 12:34:43.642531 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:43.642475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b" event={"ID":"082d00b8-fe7e-4da8-b11b-3657c951115f","Type":"ContainerStarted","Data":"49f2743dd887382bc1a583a89259b80587d22d6adfc9181cfac3a86040582a76"} Sep 15 12:34:43.642531 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:43.642521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b" event={"ID":"082d00b8-fe7e-4da8-b11b-3657c951115f","Type":"ContainerStarted","Data":"e8bcc98e18194d10732c5c37d1d826d60c32412ddb7b414b074f003acfb3d558"} Sep 15 12:34:43.662240 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:43.662154 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-5zp9b" podStartSLOduration=1.54378424 podStartE2EDuration="2.662138232s" totalImagesPullingTime="1.118353992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:43.661909075 +0000 UTC m=+41.705156671" watchObservedRunningTime="2026-09-15 12:34:43.662138232 +0000 UTC m=+41.705385838" Sep 15 12:34:43.679543 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:43.679522 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:43.787017 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:43.786985 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:44.105312 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:44.105277 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:44.125561 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:44.125536 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-phcb7_79346abd-b9d2-43ae-826c-15595d93fb31/node-ca/0.log" Sep 15 12:34:44.712109 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:44.712073 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:44.926202 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:44.926148 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9fbpr_929b6173-f547-4414-983a-480eadbcb7d3/serve-healthcheck-canary/0.log" Sep 15 12:34:44.994364 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:44.994297 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:44.994364 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:44.994346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:44.994542 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:44.994415 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 12:34:44.994542 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:44.994480 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm podName:d3fb5e08-d821-42e2-aaac-86eff39f0c37 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:48.994465628 +0000 UTC m=+47.037713215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwp8t" (UID: "d3fb5e08-d821-42e2-aaac-86eff39f0c37") : configmap "kube-rbac-proxy" not found Sep 15 12:34:44.994542 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:44.994490 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 12:34:44.994651 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:44.994545 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls podName:d3fb5e08-d821-42e2-aaac-86eff39f0c37 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:48.99452888 +0000 UTC m=+47.037776484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwp8t" (UID: "d3fb5e08-d821-42e2-aaac-86eff39f0c37") : secret "insights-runtime-extractor-tls" not found Sep 15 12:34:45.453821 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:45.453789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:45.554116 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:45.554075 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:45.599094 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:45.599068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:45.599264 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:45.599247 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 12:34:45.599343 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:45.599320 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls podName:9642da35-2137-4967-9686-8a7600afa9a8 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:53.599301238 +0000 UTC m=+51.642548859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls") pod "dns-default-plcqs" (UID: "9642da35-2137-4967-9686-8a7600afa9a8") : secret "dns-default-metrics-tls" not found Sep 15 12:34:46.125887 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:46.125855 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:48.429557 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:48.429516 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:48.563245 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:48.563204 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:48.686355 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:48.686325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:48.792983 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:48.792918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:48.895268 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:48.895236 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:48.988846 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:48.988771 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:49.020695 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:49.020669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:49.020817 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:49.020722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:49.020916 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:49.020896 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 12:34:49.020973 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:34:49.020962 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls podName:d3fb5e08-d821-42e2-aaac-86eff39f0c37 nodeName:}" failed. No retries permitted until 2026-09-15 12:34:57.020947942 +0000 UTC m=+55.064195530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwp8t" (UID: "d3fb5e08-d821-42e2-aaac-86eff39f0c37") : secret "insights-runtime-extractor-tls" not found Sep 15 12:34:49.021257 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:49.021238 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3fb5e08-d821-42e2-aaac-86eff39f0c37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:49.143973 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:49.143942 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:49.379357 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:49.379287 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:49.827974 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:49.827937 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:49.930551 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:49.930514 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:50.324301 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:50.324267 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:50.521220 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:50.521190 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:50.722800 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:50.722743 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:50.919415 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:50.919382 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:51.117095 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:51.116995 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:51.616417 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:51.616378 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:51.920670 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:51.920574 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:52.310043 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:52.310014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:52.367751 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:52.367689 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:52.762288 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:52.762241 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:52.920836 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:52.920809 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:53.329276 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:53.329244 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:53.654885 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:53.654825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:53.657623 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:53.657600 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9642da35-2137-4967-9686-8a7600afa9a8-metrics-tls\") pod \"dns-default-plcqs\" (UID: \"9642da35-2137-4967-9686-8a7600afa9a8\") " pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:53.732248 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:53.732217 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:54.030622 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:54.030597 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-plcqs"] Sep 15 12:34:54.033988 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:54.033954 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9642da35_2137_4967_9686_8a7600afa9a8.slice/crio-4249d3321a8bbcf33c749aeeed3e3f2c1e9a9efeeff779f4bd45686d07d3734b WatchSource:0}: Error finding container 4249d3321a8bbcf33c749aeeed3e3f2c1e9a9efeeff779f4bd45686d07d3734b: Status 404 returned error can't find the container with id 4249d3321a8bbcf33c749aeeed3e3f2c1e9a9efeeff779f4bd45686d07d3734b Sep 15 12:34:54.150654 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:54.150626 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:54.325086 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:54.325030 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:54.522054 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:54.522019 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:54.673088 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:54.673016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-plcqs" event={"ID":"9642da35-2137-4967-9686-8a7600afa9a8","Type":"ContainerStarted","Data":"4249d3321a8bbcf33c749aeeed3e3f2c1e9a9efeeff779f4bd45686d07d3734b"} Sep 15 12:34:54.918959 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:54.918918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:54.986245 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:54.986215 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:55.319080 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:55.318968 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:55.915707 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:55.915675 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:56.304797 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:56.304765 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:56.367225 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:56.367135 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:56.516493 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:56.516469 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:56.680597 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:56.680561 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-plcqs" event={"ID":"9642da35-2137-4967-9686-8a7600afa9a8","Type":"ContainerStarted","Data":"bd330171b0dc6d87f2c8405ac71ae52a9b12fa23229d8076c8eb0ff482937ac9"} Sep 15 12:34:56.680700 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:56.680622 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-plcqs" event={"ID":"9642da35-2137-4967-9686-8a7600afa9a8","Type":"ContainerStarted","Data":"39a92df7f3708f7b0fc38f2d1aeacf7c6f258ee433bf67b909281b361e48a357"} Sep 15 12:34:56.680743 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:56.680717 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-plcqs" Sep 15 12:34:56.698349 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:56.698304 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-plcqs" podStartSLOduration=17.589594499 podStartE2EDuration="19.698289929s" totalImagesPullingTime="2.10869543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:34:56.698117815 +0000 UTC m=+54.741365426" watchObservedRunningTime="2026-09-15 12:34:56.698289929 +0000 UTC m=+54.741537537" Sep 15 12:34:56.721699 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:56.721670 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:57.078842 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:57.078813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:57.081568 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:57.081543 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3fb5e08-d821-42e2-aaac-86eff39f0c37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwp8t\" (UID: \"d3fb5e08-d821-42e2-aaac-86eff39f0c37\") " pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:57.381249 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:57.381182 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gwp8t" Sep 15 12:34:57.675883 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:57.675817 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gwp8t"] Sep 15 12:34:57.679149 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:34:57.679123 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fb5e08_d821_42e2_aaac_86eff39f0c37.slice/crio-386483db1c57ae60b2dd5a8c5e5a05216fb61f61ef2c6d640cf397ce246ba31c WatchSource:0}: Error finding container 386483db1c57ae60b2dd5a8c5e5a05216fb61f61ef2c6d640cf397ce246ba31c: Status 404 returned error can't find the container with id 386483db1c57ae60b2dd5a8c5e5a05216fb61f61ef2c6d640cf397ce246ba31c Sep 15 12:34:57.684231 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:57.684203 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwp8t" event={"ID":"d3fb5e08-d821-42e2-aaac-86eff39f0c37","Type":"ContainerStarted","Data":"386483db1c57ae60b2dd5a8c5e5a05216fb61f61ef2c6d640cf397ce246ba31c"} Sep 15 12:34:57.719317 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:57.719284 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:58.115221 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:58.115184 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:58.338715 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:58.338676 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:58.515884 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:58.515854 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:58.688663 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:58.688639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwp8t" event={"ID":"d3fb5e08-d821-42e2-aaac-86eff39f0c37","Type":"ContainerStarted","Data":"3aadc10523031ccc85e66ff381f9e6c4083223e110388e7ccd13d667075e0848"} Sep 15 12:34:58.923339 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:58.923316 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:59.138694 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:59.138614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:34:59.695350 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:34:59.695314 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwp8t" event={"ID":"d3fb5e08-d821-42e2-aaac-86eff39f0c37","Type":"ContainerStarted","Data":"1edb63ec00c8ad18e16d7ee2f39ef951dd8ad1772d5e6796e46454008b802d08"} Sep 15 12:35:00.456519 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:00.456482 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:00.523141 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:00.523102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:01.703478 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:01.703442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwp8t" event={"ID":"d3fb5e08-d821-42e2-aaac-86eff39f0c37","Type":"ContainerStarted","Data":"26d7b8daa258941cf731421aff200421b83c0b1f05ca1806ee79084225d26cce"} Sep 15 12:35:01.722703 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:01.722658 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gwp8t" podStartSLOduration=17.979835969 podStartE2EDuration="20.722643759s" totalImagesPullingTime="2.74280779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:01.720957675 +0000 UTC m=+59.764205484" watchObservedRunningTime="2026-09-15 12:35:01.722643759 +0000 UTC m=+59.765891368" Sep 15 12:35:02.606409 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:02.606383 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zghl" Sep 15 12:35:03.646956 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:03.646899 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:03.743472 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:03.743433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:03.808940 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:03.808904 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:03.964757 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:03.964728 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:04.322030 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.321924 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:04.555619 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.555580 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:04.602143 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.602069 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-799f5fdcfb-t2nx9"] Sep 15 12:35:04.604992 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.604973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.607485 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.607463 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 15 12:35:04.607591 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.607510 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 15 12:35:04.607826 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.607807 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4f5vk\"" Sep 15 12:35:04.607913 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.607847 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 15 12:35:04.614369 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.614346 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 15 12:35:04.620973 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.620951 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-799f5fdcfb-t2nx9"] Sep 15 12:35:04.649459 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.649432 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:04.723605 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.723582 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:04.732419 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.732399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77472cbf-34ca-426f-818c-f39a3554c182-ca-trust-extracted\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.732485 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.732444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77472cbf-34ca-426f-818c-f39a3554c182-bound-sa-token\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.732532 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.732517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77472cbf-34ca-426f-818c-f39a3554c182-image-registry-private-configuration\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.732566 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.732540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77472cbf-34ca-426f-818c-f39a3554c182-registry-tls\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.732566 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.732557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77472cbf-34ca-426f-818c-f39a3554c182-installation-pull-secrets\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.732633 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.732576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77472cbf-34ca-426f-818c-f39a3554c182-trusted-ca\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.732633 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.732597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77472cbf-34ca-426f-818c-f39a3554c182-registry-certificates\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.732633 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.732613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2j8d\" (UniqueName: \"kubernetes.io/projected/77472cbf-34ca-426f-818c-f39a3554c182-kube-api-access-d2j8d\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.813864 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.813839 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:04.833277 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.833253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77472cbf-34ca-426f-818c-f39a3554c182-image-registry-private-configuration\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.833360 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.833279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77472cbf-34ca-426f-818c-f39a3554c182-registry-tls\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.833360 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.833296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77472cbf-34ca-426f-818c-f39a3554c182-installation-pull-secrets\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.833360 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.833314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77472cbf-34ca-426f-818c-f39a3554c182-trusted-ca\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.833360 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.833336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77472cbf-34ca-426f-818c-f39a3554c182-registry-certificates\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.833542 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.833361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2j8d\" (UniqueName: \"kubernetes.io/projected/77472cbf-34ca-426f-818c-f39a3554c182-kube-api-access-d2j8d\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.833542 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.833390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77472cbf-34ca-426f-818c-f39a3554c182-ca-trust-extracted\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.833542 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.833462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77472cbf-34ca-426f-818c-f39a3554c182-bound-sa-token\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.833992 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.833970 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77472cbf-34ca-426f-818c-f39a3554c182-ca-trust-extracted\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.834354 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.834332 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77472cbf-34ca-426f-818c-f39a3554c182-trusted-ca\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.834655 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.834633 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77472cbf-34ca-426f-818c-f39a3554c182-registry-certificates\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.836196 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.836143 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77472cbf-34ca-426f-818c-f39a3554c182-image-registry-private-configuration\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.836401 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.836387 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77472cbf-34ca-426f-818c-f39a3554c182-registry-tls\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.836442 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.836419 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77472cbf-34ca-426f-818c-f39a3554c182-installation-pull-secrets\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.856179 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.856108 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2j8d\" (UniqueName: \"kubernetes.io/projected/77472cbf-34ca-426f-818c-f39a3554c182-kube-api-access-d2j8d\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.857101 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.857085 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77472cbf-34ca-426f-818c-f39a3554c182-bound-sa-token\") pod \"image-registry-799f5fdcfb-t2nx9\" (UID: \"77472cbf-34ca-426f-818c-f39a3554c182\") " pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:04.915619 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:04.915588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:05.005614 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:05.005589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:05.095649 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:05.095601 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:05.173639 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:05.173583 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:05.187853 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:05.187831 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-799f5fdcfb-t2nx9"] Sep 15 12:35:05.190501 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:05.190482 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77472cbf_34ca_426f_818c_f39a3554c182.slice/crio-9cd404879c4072b09cf5558078cbd841e50f90780e65dcaf3350fc7c6d816684 WatchSource:0}: Error finding container 9cd404879c4072b09cf5558078cbd841e50f90780e65dcaf3350fc7c6d816684: Status 404 returned error can't find the container with id 9cd404879c4072b09cf5558078cbd841e50f90780e65dcaf3350fc7c6d816684 Sep 15 12:35:05.340559 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:05.340523 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:05.717053 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:05.717002 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" event={"ID":"77472cbf-34ca-426f-818c-f39a3554c182","Type":"ContainerStarted","Data":"51d262c58c7639eebbdf598df11ca9615fca0b5548d0177a9655925e380a3840"} Sep 15 12:35:05.717561 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:05.717107 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" event={"ID":"77472cbf-34ca-426f-818c-f39a3554c182","Type":"ContainerStarted","Data":"9cd404879c4072b09cf5558078cbd841e50f90780e65dcaf3350fc7c6d816684"} Sep 15 12:35:05.717561 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:05.717179 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:05.740027 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:05.739978 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" podStartSLOduration=1.7399657880000001 podStartE2EDuration="1.739965788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:35:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:05.738878032 +0000 UTC m=+63.782125641" watchObservedRunningTime="2026-09-15 12:35:05.739965788 +0000 UTC m=+63.783213405" Sep 15 12:35:05.917268 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:05.917235 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:06.149247 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:06.149174 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:06.323822 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:06.323789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:06.383532 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:06.383504 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:06.552786 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:06.552750 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:06.609503 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:06.609474 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:06.715932 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:06.715901 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-plcqs" Sep 15 12:35:07.544613 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:07.544543 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:07.644245 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:07.644215 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:07.720175 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:07.720122 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:08.092149 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.092102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:08.157172 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.157126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:35:08.159804 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.159786 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 12:35:08.170653 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.170624 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a879af0-932e-4723-8e63-4741e13aca35-original-pull-secret\") pod \"global-pull-secret-syncer-62k6l\" (UID: \"1a879af0-932e-4723-8e63-4741e13aca35\") " pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:35:08.170778 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.170707 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62k6l" Sep 15 12:35:08.257585 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.257553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:35:08.260234 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.260215 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 12:35:08.270457 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.270439 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f7d1a45-ddaa-468f-b8ca-427b0c66fb04-metrics-certs\") pod \"network-metrics-daemon-wj7jq\" (UID: \"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04\") " pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:35:08.358148 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.358092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vj4\" (UniqueName: \"kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4\") pod \"network-check-target-cptf6\" (UID: \"c531254c-20b6-4fd1-a34c-bf6ae5c17288\") " pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:35:08.360648 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.360629 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 12:35:08.371319 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.371296 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 12:35:08.381452 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.381427 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9vj4\" (UniqueName: \"kubernetes.io/projected/c531254c-20b6-4fd1-a34c-bf6ae5c17288-kube-api-access-b9vj4\") pod \"network-check-target-cptf6\" (UID: \"c531254c-20b6-4fd1-a34c-bf6ae5c17288\") " pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:35:08.446387 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.446363 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-62k6l"] Sep 15 12:35:08.449542 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:08.449520 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a879af0_932e_4723_8e63_4741e13aca35.slice/crio-30a0a9d69a5a6d126aad881ad3aaa422899c3e0652b07a86ae03bb7dee248bb8 WatchSource:0}: Error finding container 30a0a9d69a5a6d126aad881ad3aaa422899c3e0652b07a86ae03bb7dee248bb8: Status 404 returned error can't find the container with id 30a0a9d69a5a6d126aad881ad3aaa422899c3e0652b07a86ae03bb7dee248bb8 Sep 15 12:35:08.464758 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.464737 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g4tvt\"" Sep 15 12:35:08.468348 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.468331 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zqjh7\"" Sep 15 12:35:08.470410 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.470390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj7jq" Sep 15 12:35:08.476821 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.476806 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:35:08.729872 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.729830 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-62k6l" event={"ID":"1a879af0-932e-4723-8e63-4741e13aca35","Type":"ContainerStarted","Data":"30a0a9d69a5a6d126aad881ad3aaa422899c3e0652b07a86ae03bb7dee248bb8"} Sep 15 12:35:08.738498 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.738472 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wj7jq"] Sep 15 12:35:08.741562 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:08.741538 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7d1a45_ddaa_468f_b8ca_427b0c66fb04.slice/crio-ef695ab82a439f43f80c330d4b3a52998acfc0326ac96f20204a1956ecba076e WatchSource:0}: Error finding container ef695ab82a439f43f80c330d4b3a52998acfc0326ac96f20204a1956ecba076e: Status 404 returned error can't find the container with id ef695ab82a439f43f80c330d4b3a52998acfc0326ac96f20204a1956ecba076e Sep 15 12:35:08.748261 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:08.748235 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cptf6"] Sep 15 12:35:08.750616 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:08.750592 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc531254c_20b6_4fd1_a34c_bf6ae5c17288.slice/crio-0fbc58f83569792d9db78f08735f01429b3df175ddb93425f5adca37bd7941ae WatchSource:0}: Error finding container 0fbc58f83569792d9db78f08735f01429b3df175ddb93425f5adca37bd7941ae: Status 404 returned error can't find the container with id 0fbc58f83569792d9db78f08735f01429b3df175ddb93425f5adca37bd7941ae Sep 15 12:35:09.533506 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:09.533465 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:09.594317 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:09.594285 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:09.736681 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:09.736644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cptf6" event={"ID":"c531254c-20b6-4fd1-a34c-bf6ae5c17288","Type":"ContainerStarted","Data":"0fbc58f83569792d9db78f08735f01429b3df175ddb93425f5adca37bd7941ae"} Sep 15 12:35:09.740760 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:09.740692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj7jq" event={"ID":"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04","Type":"ContainerStarted","Data":"ef695ab82a439f43f80c330d4b3a52998acfc0326ac96f20204a1956ecba076e"} Sep 15 12:35:10.748107 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:10.748073 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj7jq" event={"ID":"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04","Type":"ContainerStarted","Data":"f6520fca9cc38a9052ea2a43f2ebf8af3a75a3c6cad6c36ea8790b8bb8a11a9a"} Sep 15 12:35:10.748579 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:10.748135 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj7jq" event={"ID":"1f7d1a45-ddaa-468f-b8ca-427b0c66fb04","Type":"ContainerStarted","Data":"ea4cf372217727a4e5cca618bc08e76844625ae6555a81bbc6786a42179dbf7b"} Sep 15 12:35:10.765110 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:10.765045 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wj7jq" podStartSLOduration=66.731980666 podStartE2EDuration="1m7.76502581s" totalImagesPullingTime="1.033045144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:10.764746289 +0000 UTC m=+68.807993900" watchObservedRunningTime="2026-09-15 12:35:10.76502581 +0000 UTC m=+68.808273421" Sep 15 12:35:10.854246 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:10.854213 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:10.953032 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:10.952997 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:11.025630 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:11.025542 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:13.216762 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.216741 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-788b889f47-cdqwp"] Sep 15 12:35:13.218976 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.218958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.221619 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.221595 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 15 12:35:13.221800 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.221601 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 15 12:35:13.221873 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.221810 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 15 12:35:13.223145 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.222948 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 15 12:35:13.223145 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.222989 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 15 12:35:13.223145 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.223034 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nm4hj\"" Sep 15 12:35:13.223145 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.223082 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 15 12:35:13.223402 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.223222 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 15 12:35:13.231949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.231931 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788b889f47-cdqwp"] Sep 15 12:35:13.289426 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.289397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-serving-cert\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.289566 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.289444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-service-ca\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.289566 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.289471 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-oauth-config\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.289566 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.289494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-oauth-serving-cert\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.289681 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.289568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-config\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.289681 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.289614 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nnxc\" (UniqueName: \"kubernetes.io/projected/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-kube-api-access-5nnxc\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.389923 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.389889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-config\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.390051 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.389935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nnxc\" (UniqueName: \"kubernetes.io/projected/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-kube-api-access-5nnxc\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.390051 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.389953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-serving-cert\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.390051 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.389973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-service-ca\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.390051 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.389989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-oauth-config\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.390266 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.390106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-oauth-serving-cert\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.390707 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.390686 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-service-ca\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.390807 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.390755 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-oauth-serving-cert\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.390912 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.390888 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-config\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.392390 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.392370 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-oauth-config\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.392501 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.392442 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-serving-cert\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.402632 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.402612 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nnxc\" (UniqueName: \"kubernetes.io/projected/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-kube-api-access-5nnxc\") pod \"console-788b889f47-cdqwp\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.531918 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.531892 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:13.761356 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.761318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-62k6l" event={"ID":"1a879af0-932e-4723-8e63-4741e13aca35","Type":"ContainerStarted","Data":"d49772b674d4a0da365d35b24966791480accd181ad62f39b80c8187ae5835ad"} Sep 15 12:35:13.762876 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.762846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cptf6" event={"ID":"c531254c-20b6-4fd1-a34c-bf6ae5c17288","Type":"ContainerStarted","Data":"5877c4c1aaa800e7c5ac957c1edc0455b3cbc5d9971067b270d842b20f437d16"} Sep 15 12:35:13.762999 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.762983 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:35:13.776797 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.776756 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-62k6l" podStartSLOduration=66.068172956 podStartE2EDuration="1m10.776742916s" totalImagesPullingTime="4.70856996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:13.776310296 +0000 UTC m=+71.819557906" watchObservedRunningTime="2026-09-15 12:35:13.776742916 +0000 UTC m=+71.819990526" Sep 15 12:35:13.792708 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.792632 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cptf6" podStartSLOduration=66.388910693 podStartE2EDuration="1m10.792616799s" totalImagesPullingTime="4.403706106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:13.791871419 +0000 UTC m=+71.835119028" watchObservedRunningTime="2026-09-15 12:35:13.792616799 +0000 UTC m=+71.835864407" Sep 15 12:35:13.806179 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:13.806137 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788b889f47-cdqwp"] Sep 15 12:35:13.808586 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:13.808564 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6ead01_a0df_4dc8_97c2_e978e06c9b58.slice/crio-dfe57d5994b6cb9def7d892cdfdd6aa33c86c6eaeaa50c3f7e73804c83af2811 WatchSource:0}: Error finding container dfe57d5994b6cb9def7d892cdfdd6aa33c86c6eaeaa50c3f7e73804c83af2811: Status 404 returned error can't find the container with id dfe57d5994b6cb9def7d892cdfdd6aa33c86c6eaeaa50c3f7e73804c83af2811 Sep 15 12:35:14.767860 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:14.767825 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788b889f47-cdqwp" event={"ID":"2e6ead01-a0df-4dc8-97c2-e978e06c9b58","Type":"ContainerStarted","Data":"dfe57d5994b6cb9def7d892cdfdd6aa33c86c6eaeaa50c3f7e73804c83af2811"} Sep 15 12:35:16.775256 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:16.775221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788b889f47-cdqwp" event={"ID":"2e6ead01-a0df-4dc8-97c2-e978e06c9b58","Type":"ContainerStarted","Data":"85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f"} Sep 15 12:35:16.793923 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:16.793778 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-788b889f47-cdqwp" podStartSLOduration=1.066542063 podStartE2EDuration="3.793758174s" totalImagesPullingTime="2.727216111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:16.793054675 +0000 UTC m=+74.836302286" watchObservedRunningTime="2026-09-15 12:35:16.793758174 +0000 UTC m=+74.837005787" Sep 15 12:35:17.782469 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:17.782424 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:17.882940 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:17.882905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:19.358352 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:19.358314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:19.416192 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:19.416136 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:22.348967 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.348931 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-668df678f5-bwtcl"] Sep 15 12:35:22.351003 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.350985 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.359815 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.359793 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 15 12:35:22.362376 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.362350 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668df678f5-bwtcl"] Sep 15 12:35:22.450638 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.450607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-serving-cert\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.450785 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.450663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-config\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.450785 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.450694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-service-ca\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.450785 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.450736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-trusted-ca-bundle\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.450785 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.450769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxt9n\" (UniqueName: \"kubernetes.io/projected/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-kube-api-access-qxt9n\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.450975 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.450801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-oauth-config\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.450975 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.450844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-oauth-serving-cert\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.551356 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.551328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-serving-cert\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.551466 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.551363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-config\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.551466 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.551378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-service-ca\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.551466 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.551412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-trusted-ca-bundle\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.551622 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.551543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxt9n\" (UniqueName: \"kubernetes.io/projected/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-kube-api-access-qxt9n\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.551622 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.551589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-oauth-config\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.551718 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.551625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-oauth-serving-cert\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.552135 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.552104 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-config\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.552135 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.552115 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-service-ca\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.552346 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.552326 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-trusted-ca-bundle\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.552623 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.552601 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-oauth-serving-cert\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.554109 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.554085 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-oauth-config\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.554214 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.554191 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-serving-cert\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.559675 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.559654 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxt9n\" (UniqueName: \"kubernetes.io/projected/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-kube-api-access-qxt9n\") pod \"console-668df678f5-bwtcl\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.659989 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.659935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:22.932230 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.932201 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668df678f5-bwtcl"] Sep 15 12:35:22.934713 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:22.934686 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b89a1b_5dcd_43e5_a095_3c0a88823c1d.slice/crio-5f4c33ad618c1a2ad6c51775bd070c5ef58a4756b3f35cb5d1f252aa530d7247 WatchSource:0}: Error finding container 5f4c33ad618c1a2ad6c51775bd070c5ef58a4756b3f35cb5d1f252aa530d7247: Status 404 returned error can't find the container with id 5f4c33ad618c1a2ad6c51775bd070c5ef58a4756b3f35cb5d1f252aa530d7247 Sep 15 12:35:22.957544 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:22.957519 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:23.058283 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:23.058252 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:23.532416 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:23.532260 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:23.532416 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:23.532374 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:23.537249 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:23.537225 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:23.800937 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:23.800849 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668df678f5-bwtcl" event={"ID":"97b89a1b-5dcd-43e5-a095-3c0a88823c1d","Type":"ContainerStarted","Data":"48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8"} Sep 15 12:35:23.800937 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:23.800904 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668df678f5-bwtcl" event={"ID":"97b89a1b-5dcd-43e5-a095-3c0a88823c1d","Type":"ContainerStarted","Data":"5f4c33ad618c1a2ad6c51775bd070c5ef58a4756b3f35cb5d1f252aa530d7247"} Sep 15 12:35:23.804819 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:23.804791 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:23.820042 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:23.819995 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-668df678f5-bwtcl" podStartSLOduration=1.8199813169999999 podStartE2EDuration="1.819981317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:23.819522274 +0000 UTC m=+81.862769882" watchObservedRunningTime="2026-09-15 12:35:23.819981317 +0000 UTC m=+81.863228923" Sep 15 12:35:24.606174 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:24.606111 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:26.725377 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:26.725343 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-799f5fdcfb-t2nx9" Sep 15 12:35:26.875866 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:26.875828 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:26.977449 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:26.977369 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:27.087124 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.087093 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:27.156471 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.156446 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz"] Sep 15 12:35:27.159530 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.159514 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.163434 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.163414 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 15 12:35:27.163554 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.163534 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 15 12:35:27.163666 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.163416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 15 12:35:27.163666 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.163416 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 15 12:35:27.163666 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.163416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 15 12:35:27.163820 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.163469 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tx24n\"" Sep 15 12:35:27.163820 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.163416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 15 12:35:27.171374 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.171346 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz"] Sep 15 12:35:27.174589 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.174565 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:27.182045 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.182025 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dwbc6"] Sep 15 12:35:27.184045 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.184029 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.186590 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.186572 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 15 12:35:27.186590 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.186582 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 15 12:35:27.186740 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.186664 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9wxcx\"" Sep 15 12:35:27.186903 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.186888 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 15 12:35:27.247774 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.247720 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:27.281837 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.281813 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-textfile\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.281909 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.281842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-accelerators-collector-config\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.281909 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.281861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk59v\" (UniqueName: \"kubernetes.io/projected/ee1d019e-f862-474d-83ce-6539200b001f-kube-api-access-kk59v\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.281909 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.281879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9822c43-f3e7-4191-bd30-71f46aa63294-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.282013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.281921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.282013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.281947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-wtmp\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.282013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.281964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee1d019e-f862-474d-83ce-6539200b001f-sys\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.282013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.281983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txh7w\" (UniqueName: \"kubernetes.io/projected/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-api-access-txh7w\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.282147 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.282031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.282147 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.282055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-tls\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.282147 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.282071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.282147 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.282095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9822c43-f3e7-4191-bd30-71f46aa63294-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.282147 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.282129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee1d019e-f862-474d-83ce-6539200b001f-root\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.282339 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.282150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee1d019e-f862-474d-83ce-6539200b001f-metrics-client-ca\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.282339 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.282198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.347420 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.347395 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:27.383350 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.383441 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-tls\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.383441 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.383441 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9822c43-f3e7-4191-bd30-71f46aa63294-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.383608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee1d019e-f862-474d-83ce-6539200b001f-root\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.383608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee1d019e-f862-474d-83ce-6539200b001f-metrics-client-ca\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.383608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.383608 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:35:27.383530 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 15 12:35:27.383608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-textfile\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.383608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-accelerators-collector-config\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.383608 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:35:27.383605 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-tls podName:ee1d019e-f862-474d-83ce-6539200b001f nodeName:}" failed. No retries permitted until 2026-09-15 12:35:27.883586275 +0000 UTC m=+85.926833863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-tls") pod "node-exporter-dwbc6" (UID: "ee1d019e-f862-474d-83ce-6539200b001f") : secret "node-exporter-tls" not found Sep 15 12:35:27.383949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk59v\" (UniqueName: \"kubernetes.io/projected/ee1d019e-f862-474d-83ce-6539200b001f-kube-api-access-kk59v\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.383949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9822c43-f3e7-4191-bd30-71f46aa63294-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.383949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.383949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-wtmp\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.383949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee1d019e-f862-474d-83ce-6539200b001f-sys\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.383949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txh7w\" (UniqueName: \"kubernetes.io/projected/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-api-access-txh7w\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.383949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.383839 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9822c43-f3e7-4191-bd30-71f46aa63294-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.384316 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.384127 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.384316 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.384144 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-accelerators-collector-config\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.384316 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.384195 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-wtmp\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.384316 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.384133 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee1d019e-f862-474d-83ce-6539200b001f-sys\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.384508 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.384432 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee1d019e-f862-474d-83ce-6539200b001f-root\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.384508 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.384453 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-textfile\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.384614 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.384523 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9822c43-f3e7-4191-bd30-71f46aa63294-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.384776 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.384755 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee1d019e-f862-474d-83ce-6539200b001f-metrics-client-ca\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.386706 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.386682 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.386848 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.386831 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.386908 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.386863 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.393009 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.392982 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txh7w\" (UniqueName: \"kubernetes.io/projected/a9822c43-f3e7-4191-bd30-71f46aa63294-kube-api-access-txh7w\") pod \"kube-state-metrics-59fbdd77d-lj9gz\" (UID: \"a9822c43-f3e7-4191-bd30-71f46aa63294\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.394143 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.394122 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk59v\" (UniqueName: \"kubernetes.io/projected/ee1d019e-f862-474d-83ce-6539200b001f-kube-api-access-kk59v\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.448126 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.448089 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:27.469281 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.469246 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" Sep 15 12:35:27.546487 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.546457 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:27.647669 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.647625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:27.744994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.744949 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz"] Sep 15 12:35:27.747950 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:27.747919 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9822c43_f3e7_4191_bd30_71f46aa63294.slice/crio-a8eaa6f97a3190de945ce5da509d71baef2d5214d1e7162ff04bba022d19979e WatchSource:0}: Error finding container a8eaa6f97a3190de945ce5da509d71baef2d5214d1e7162ff04bba022d19979e: Status 404 returned error can't find the container with id a8eaa6f97a3190de945ce5da509d71baef2d5214d1e7162ff04bba022d19979e Sep 15 12:35:27.751497 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.751463 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:27.815785 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.815729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" event={"ID":"a9822c43-f3e7-4191-bd30-71f46aa63294","Type":"ContainerStarted","Data":"a8eaa6f97a3190de945ce5da509d71baef2d5214d1e7162ff04bba022d19979e"} Sep 15 12:35:27.888309 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.888284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-tls\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:27.888445 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:35:27.888428 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 15 12:35:27.888496 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:35:27.888487 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-tls podName:ee1d019e-f862-474d-83ce-6539200b001f nodeName:}" failed. No retries permitted until 2026-09-15 12:35:28.888471211 +0000 UTC m=+86.931718817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-tls") pod "node-exporter-dwbc6" (UID: "ee1d019e-f862-474d-83ce-6539200b001f") : secret "node-exporter-tls" not found Sep 15 12:35:27.965108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:27.965085 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:28.128023 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.127949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:28.224266 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.224239 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:35:28.229852 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.229835 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.232256 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.232233 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 15 12:35:28.232348 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.232284 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 15 12:35:28.232610 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.232590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 15 12:35:28.232610 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.232599 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 15 12:35:28.232771 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.232637 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 15 12:35:28.232771 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.232713 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 15 12:35:28.232771 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.232710 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 15 12:35:28.232944 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.232925 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 15 12:35:28.232995 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.232942 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 15 12:35:28.232995 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.232975 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bmt7t\"" Sep 15 12:35:28.246506 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.246477 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:35:28.251908 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.251882 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:28.291665 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.291642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.291756 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.291686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.291825 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.291785 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.291878 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.291830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-tls-assets\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.291878 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.291858 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvztc\" (UniqueName: \"kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-kube-api-access-zvztc\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.291975 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.291913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.291975 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.291940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.291975 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.291965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-volume\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.292099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.291992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.292099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.292018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-web-config\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.292099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.292056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-out\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.292099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.292088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.292277 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.292182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.357722 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.357669 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:28.392513 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.392513 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.392662 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-volume\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.392662 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.392782 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-web-config\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.392855 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-out\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.392855 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.392955 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.392955 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.393043 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.393043 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.392972 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.393043 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.393017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.393232 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.393055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-tls-assets\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.393232 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.393081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvztc\" (UniqueName: \"kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-kube-api-access-zvztc\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.393703 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.393572 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.393778 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.393712 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.396730 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.396435 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-web-config\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.396730 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.396622 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.396730 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.396693 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-out\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.396918 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.396870 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-volume\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.397053 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.397026 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.397475 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.397453 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.397871 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.397833 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.398003 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.397979 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.398417 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.398397 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-tls-assets\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.402372 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.402354 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvztc\" (UniqueName: \"kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-kube-api-access-zvztc\") pod \"alertmanager-main-0\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.436538 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.436512 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:28.539264 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.539229 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:35:28.539514 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.539346 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:28.825675 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.825653 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:35:28.882776 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:28.882745 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454860b7_40e5_4c4c_ac68_f6fefbffc171.slice/crio-bc10dff3de2293922df026bfa322f0853a905eb709482d497ececfc55072484f WatchSource:0}: Error finding container bc10dff3de2293922df026bfa322f0853a905eb709482d497ececfc55072484f: Status 404 returned error can't find the container with id bc10dff3de2293922df026bfa322f0853a905eb709482d497ececfc55072484f Sep 15 12:35:28.898570 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.898548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-tls\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:28.900795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.900771 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee1d019e-f862-474d-83ce-6539200b001f-node-exporter-tls\") pod \"node-exporter-dwbc6\" (UID: \"ee1d019e-f862-474d-83ce-6539200b001f\") " pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:28.992367 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:28.992348 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dwbc6" Sep 15 12:35:29.002051 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:29.002028 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1d019e_f862_474d_83ce_6539200b001f.slice/crio-51cc6cd5d205ed3eb605435a96b8f0f781b59fd7b8aaca40aec952980c53a811 WatchSource:0}: Error finding container 51cc6cd5d205ed3eb605435a96b8f0f781b59fd7b8aaca40aec952980c53a811: Status 404 returned error can't find the container with id 51cc6cd5d205ed3eb605435a96b8f0f781b59fd7b8aaca40aec952980c53a811 Sep 15 12:35:29.823819 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:29.823784 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dwbc6" event={"ID":"ee1d019e-f862-474d-83ce-6539200b001f","Type":"ContainerStarted","Data":"51cc6cd5d205ed3eb605435a96b8f0f781b59fd7b8aaca40aec952980c53a811"} Sep 15 12:35:29.825013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:29.824985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerStarted","Data":"bc10dff3de2293922df026bfa322f0853a905eb709482d497ececfc55072484f"} Sep 15 12:35:29.827193 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:29.827171 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" event={"ID":"a9822c43-f3e7-4191-bd30-71f46aa63294","Type":"ContainerStarted","Data":"a65e367a5b9a76445ea0e33ec6f0abb62fde72b7f30557300ce19ab314fd45b8"} Sep 15 12:35:29.827479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:29.827216 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" event={"ID":"a9822c43-f3e7-4191-bd30-71f46aa63294","Type":"ContainerStarted","Data":"ce25fd9bb861b753b15aa50a554256a9695e3de996c0d420488eb0817f0bded9"} Sep 15 12:35:29.827479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:29.827236 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" event={"ID":"a9822c43-f3e7-4191-bd30-71f46aa63294","Type":"ContainerStarted","Data":"e6e3f062c9ff8817756464bfecd54dedc8c7d061890d43fc72f7cd5b5245dd2d"} Sep 15 12:35:29.848044 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:29.847994 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-lj9gz" podStartSLOduration=1.67059029 podStartE2EDuration="2.847979735s" totalImagesPullingTime="1.177389445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:29.846289954 +0000 UTC m=+87.889537564" watchObservedRunningTime="2026-09-15 12:35:29.847979735 +0000 UTC m=+87.891227344" Sep 15 12:35:30.832608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:30.832576 2577 generic.go:356] "Generic (PLEG): container finished" podID="ee1d019e-f862-474d-83ce-6539200b001f" containerID="37e19e8abfdb4efa4429be7d4db55c086cbc57afca20c6e77b5c3b82c96883e5" exitCode=0 Sep 15 12:35:30.832956 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:30.832653 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dwbc6" event={"ID":"ee1d019e-f862-474d-83ce-6539200b001f","Type":"ContainerDied","Data":"37e19e8abfdb4efa4429be7d4db55c086cbc57afca20c6e77b5c3b82c96883e5"} Sep 15 12:35:31.568119 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:31.568058 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:31.670089 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:31.670047 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:31.839649 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:31.839562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dwbc6" event={"ID":"ee1d019e-f862-474d-83ce-6539200b001f","Type":"ContainerStarted","Data":"71beff5fb1903452cb16bd0ee18ef3fb12459c618c4479c724d4269c380a99ae"} Sep 15 12:35:31.840096 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:31.839672 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dwbc6" event={"ID":"ee1d019e-f862-474d-83ce-6539200b001f","Type":"ContainerStarted","Data":"93fbc3c79f36fc97a36cbaeaf07ab20dcb705b7d1dc87deb8a09c846d49d551c"} Sep 15 12:35:31.861721 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:31.861678 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dwbc6" podStartSLOduration=3.926538311 podStartE2EDuration="4.861663748s" totalImagesPullingTime="867.711963ms" totalInitContainerRuntime="67.413474ms" isStatefulPod=true podCreationTimestamp="2026-09-15 12:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:31.860315441 +0000 UTC m=+89.903563069" watchObservedRunningTime="2026-09-15 12:35:31.861663748 +0000 UTC m=+89.904911356" Sep 15 12:35:31.925097 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:31.925053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:32.013288 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:32.013256 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:32.269006 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:32.268964 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:32.660946 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:32.660871 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:32.660946 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:32.660923 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:32.667348 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:32.667328 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:32.846843 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:32.846816 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:35:32.928713 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:32.928689 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-788b889f47-cdqwp"] Sep 15 12:35:33.203581 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.203548 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:33.297982 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.297926 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:33.415515 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.415426 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:33.417461 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.417440 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:35:33.420994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.420978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.423806 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.423625 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 15 12:35:33.423806 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.423705 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 15 12:35:33.423806 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.423714 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a5rkonnp980uv\"" Sep 15 12:35:33.423806 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.423713 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5wfz7\"" Sep 15 12:35:33.423806 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.423714 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 15 12:35:33.423806 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.423705 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 15 12:35:33.423806 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.423746 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 15 12:35:33.424266 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.423857 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 15 12:35:33.424266 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.423938 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 15 12:35:33.424266 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.423940 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 15 12:35:33.425365 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.425338 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 15 12:35:33.425469 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.425368 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 15 12:35:33.425469 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.425345 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 15 12:35:33.426401 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.426376 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 15 12:35:33.426893 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.426860 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 15 12:35:33.428672 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.428640 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 15 12:35:33.429827 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.429807 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 15 12:35:33.436013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.435994 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:35:33.533921 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.533858 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.533921 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.533890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.533921 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.533917 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534142 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.533961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534142 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534142 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534142 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534142 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534380 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534380 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534380 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534380 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534380 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534297 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534380 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534380 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534390 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.534608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.534493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25l9x\" (UniqueName: \"kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-kube-api-access-25l9x\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635266 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635371 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635371 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635371 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635371 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635371 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635596 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635596 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635596 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635596 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635596 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635596 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635596 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635596 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25l9x\" (UniqueName: \"kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-kube-api-access-25l9x\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635976 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635976 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635976 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635672 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635976 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635976 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.635976 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.635788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.636451 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.636198 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.636712 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.636686 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.636945 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.636923 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.638998 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.639412 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.639630 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.639745 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.639895 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.640000 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.640079 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.640340 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.640504 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640947 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.640660 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.640947 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.640883 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.641047 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.641001 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.641155 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.641134 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.641336 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.641320 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.641736 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.641723 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.642825 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.642805 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.645738 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.645721 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25l9x\" (UniqueName: \"kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-kube-api-access-25l9x\") pod \"prometheus-k8s-0\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.731129 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.731110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:33.848251 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.848189 2577 generic.go:356] "Generic (PLEG): container finished" podID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerID="cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b" exitCode=0 Sep 15 12:35:33.848616 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:33.848271 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerDied","Data":"cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b"} Sep 15 12:35:34.010922 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:34.010894 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:35:34.013693 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:34.013667 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7904286_6eed_4f1f_b314_e15f8cc2ecc1.slice/crio-cc4255802a0a8fb4aad43d29d5b39ceef2a391e5a7d9a8e4e7d02c74bc68b91b WatchSource:0}: Error finding container cc4255802a0a8fb4aad43d29d5b39ceef2a391e5a7d9a8e4e7d02c74bc68b91b: Status 404 returned error can't find the container with id cc4255802a0a8fb4aad43d29d5b39ceef2a391e5a7d9a8e4e7d02c74bc68b91b Sep 15 12:35:34.855724 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:34.855684 2577 generic.go:356] "Generic (PLEG): container finished" podID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerID="48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5" exitCode=0 Sep 15 12:35:34.856306 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:34.855740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerDied","Data":"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5"} Sep 15 12:35:34.856306 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:34.855797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerStarted","Data":"cc4255802a0a8fb4aad43d29d5b39ceef2a391e5a7d9a8e4e7d02c74bc68b91b"} Sep 15 12:35:35.864588 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:35.864505 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerStarted","Data":"84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2"} Sep 15 12:35:35.864966 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:35.864589 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerStarted","Data":"0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c"} Sep 15 12:35:35.864966 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:35.864630 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerStarted","Data":"82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507"} Sep 15 12:35:35.864966 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:35.864669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerStarted","Data":"85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d"} Sep 15 12:35:35.864966 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:35.864707 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerStarted","Data":"b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2"} Sep 15 12:35:36.451669 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:36.451612 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:36.552592 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:36.552555 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:37.875178 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:37.875124 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerStarted","Data":"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b"} Sep 15 12:35:37.875475 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:37.875237 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerStarted","Data":"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4"} Sep 15 12:35:39.811786 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.811759 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cbdf8b9fd-8hbj6"] Sep 15 12:35:39.816379 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.815939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:39.825899 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.825875 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cbdf8b9fd-8hbj6"] Sep 15 12:35:39.891949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.891919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerStarted","Data":"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4"} Sep 15 12:35:39.892062 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.891993 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerStarted","Data":"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a"} Sep 15 12:35:39.895467 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.895442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerStarted","Data":"b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8"} Sep 15 12:35:39.927014 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.926968 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.328687479 podStartE2EDuration="11.926954564s" totalImagesPullingTime="9.57822891s" totalInitContainerRuntime="20.038175ms" isStatefulPod=false podCreationTimestamp="2026-09-15 12:35:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:39.925389073 +0000 UTC m=+97.968636681" watchObservedRunningTime="2026-09-15 12:35:39.926954564 +0000 UTC m=+97.970202199" Sep 15 12:35:39.991310 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.991285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-oauth-config\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:39.991433 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.991316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-oauth-serving-cert\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:39.991433 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.991358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-config\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:39.991539 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.991514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-serving-cert\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:39.991594 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.991562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-service-ca\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:39.991733 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.991707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-trusted-ca-bundle\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:39.991825 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:39.991748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clqkf\" (UniqueName: \"kubernetes.io/projected/bc0c77dc-8344-4023-9bd7-f1de36d8724d-kube-api-access-clqkf\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.092533 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.092502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-config\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.092637 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.092556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-serving-cert\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.092637 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.092587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-service-ca\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.092748 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.092639 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-trusted-ca-bundle\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.092748 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.092665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clqkf\" (UniqueName: \"kubernetes.io/projected/bc0c77dc-8344-4023-9bd7-f1de36d8724d-kube-api-access-clqkf\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.092748 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.092710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-oauth-config\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.092748 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.092734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-oauth-serving-cert\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.093330 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.093306 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-config\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.093448 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.093395 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-service-ca\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.093595 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.093576 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-trusted-ca-bundle\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.093686 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.093663 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-oauth-serving-cert\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.095109 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.095084 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-oauth-config\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.095236 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.095218 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-serving-cert\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.108036 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.108014 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clqkf\" (UniqueName: \"kubernetes.io/projected/bc0c77dc-8344-4023-9bd7-f1de36d8724d-kube-api-access-clqkf\") pod \"console-6cbdf8b9fd-8hbj6\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.141040 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.141016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:40.422263 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.422234 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cbdf8b9fd-8hbj6"] Sep 15 12:35:40.424108 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:35:40.424078 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0c77dc_8344_4023_9bd7_f1de36d8724d.slice/crio-0f283485372d44d42f6cd370eebdb012c1b527d8c6ceaa72f5338bfa245bf05d WatchSource:0}: Error finding container 0f283485372d44d42f6cd370eebdb012c1b527d8c6ceaa72f5338bfa245bf05d: Status 404 returned error can't find the container with id 0f283485372d44d42f6cd370eebdb012c1b527d8c6ceaa72f5338bfa245bf05d Sep 15 12:35:40.900697 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.900655 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbdf8b9fd-8hbj6" event={"ID":"bc0c77dc-8344-4023-9bd7-f1de36d8724d","Type":"ContainerStarted","Data":"1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b"} Sep 15 12:35:40.901104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.900723 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbdf8b9fd-8hbj6" event={"ID":"bc0c77dc-8344-4023-9bd7-f1de36d8724d","Type":"ContainerStarted","Data":"0f283485372d44d42f6cd370eebdb012c1b527d8c6ceaa72f5338bfa245bf05d"} Sep 15 12:35:40.904331 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.904294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerStarted","Data":"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b"} Sep 15 12:35:40.904412 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.904360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerStarted","Data":"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d"} Sep 15 12:35:40.920945 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.920903 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cbdf8b9fd-8hbj6" podStartSLOduration=1.920887872 podStartE2EDuration="1.920887872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:40.919675727 +0000 UTC m=+98.962923349" watchObservedRunningTime="2026-09-15 12:35:40.920887872 +0000 UTC m=+98.964135481" Sep 15 12:35:40.954508 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:40.954469 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.1775855379999998 podStartE2EDuration="7.954455657s" totalImagesPullingTime="4.757492732s" totalInitContainerRuntime="19.377387ms" isStatefulPod=false podCreationTimestamp="2026-09-15 12:35:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:35:40.952587889 +0000 UTC m=+98.995835525" watchObservedRunningTime="2026-09-15 12:35:40.954455657 +0000 UTC m=+98.997703266" Sep 15 12:35:43.732054 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:43.732021 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:35:44.770361 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:44.770331 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cptf6" Sep 15 12:35:45.429177 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:45.429135 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:45.498396 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:45.498362 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:50.141389 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:50.141356 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:50.141807 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:50.141434 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:50.145940 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:50.145918 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:50.948974 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:50.948948 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:35:51.003713 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:51.003678 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668df678f5-bwtcl"] Sep 15 12:35:51.183922 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:51.183890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:51.284142 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:51.284051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:35:57.951520 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:57.951467 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-788b889f47-cdqwp" podUID="2e6ead01-a0df-4dc8-97c2-e978e06c9b58" containerName="console" containerID="cri-o://85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f" gracePeriod=15 Sep 15 12:35:58.190842 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.190822 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:58.223420 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.223366 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-serving-cert\") pod \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " Sep 15 12:35:58.223420 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.223408 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-config\") pod \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " Sep 15 12:35:58.223581 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.223447 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-oauth-serving-cert\") pod \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " Sep 15 12:35:58.223581 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.223495 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-service-ca\") pod \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " Sep 15 12:35:58.223581 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.223543 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-oauth-config\") pod \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " Sep 15 12:35:58.223581 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.223577 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nnxc\" (UniqueName: \"kubernetes.io/projected/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-kube-api-access-5nnxc\") pod \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\" (UID: \"2e6ead01-a0df-4dc8-97c2-e978e06c9b58\") " Sep 15 12:35:58.223936 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.223909 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-service-ca" (OuterVolumeSpecName: "service-ca") pod "2e6ead01-a0df-4dc8-97c2-e978e06c9b58" (UID: "2e6ead01-a0df-4dc8-97c2-e978e06c9b58"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:35:58.224086 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.223911 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2e6ead01-a0df-4dc8-97c2-e978e06c9b58" (UID: "2e6ead01-a0df-4dc8-97c2-e978e06c9b58"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:35:58.224230 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.224132 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-config" (OuterVolumeSpecName: "console-config") pod "2e6ead01-a0df-4dc8-97c2-e978e06c9b58" (UID: "2e6ead01-a0df-4dc8-97c2-e978e06c9b58"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:35:58.225696 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.225674 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2e6ead01-a0df-4dc8-97c2-e978e06c9b58" (UID: "2e6ead01-a0df-4dc8-97c2-e978e06c9b58"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:35:58.226311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.226290 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2e6ead01-a0df-4dc8-97c2-e978e06c9b58" (UID: "2e6ead01-a0df-4dc8-97c2-e978e06c9b58"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:35:58.226311 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.226291 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-kube-api-access-5nnxc" (OuterVolumeSpecName: "kube-api-access-5nnxc") pod "2e6ead01-a0df-4dc8-97c2-e978e06c9b58" (UID: "2e6ead01-a0df-4dc8-97c2-e978e06c9b58"). InnerVolumeSpecName "kube-api-access-5nnxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:35:58.324655 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.324633 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-oauth-serving-cert\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:35:58.324655 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.324653 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-service-ca\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:35:58.324768 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.324663 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-oauth-config\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:35:58.324768 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.324671 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nnxc\" (UniqueName: \"kubernetes.io/projected/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-kube-api-access-5nnxc\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:35:58.324768 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.324679 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-serving-cert\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:35:58.324768 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.324687 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e6ead01-a0df-4dc8-97c2-e978e06c9b58-console-config\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:35:58.974735 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.974708 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e6ead01-a0df-4dc8-97c2-e978e06c9b58" containerID="85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f" exitCode=0 Sep 15 12:35:58.975147 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.974749 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788b889f47-cdqwp" event={"ID":"2e6ead01-a0df-4dc8-97c2-e978e06c9b58","Type":"ContainerDied","Data":"85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f"} Sep 15 12:35:58.975147 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.974758 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788b889f47-cdqwp" Sep 15 12:35:58.975147 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.974783 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788b889f47-cdqwp" event={"ID":"2e6ead01-a0df-4dc8-97c2-e978e06c9b58","Type":"ContainerDied","Data":"dfe57d5994b6cb9def7d892cdfdd6aa33c86c6eaeaa50c3f7e73804c83af2811"} Sep 15 12:35:58.975147 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.974811 2577 scope.go:117] "RemoveContainer" containerID="85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f" Sep 15 12:35:58.982881 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.982864 2577 scope.go:117] "RemoveContainer" containerID="85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f" Sep 15 12:35:58.983142 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:35:58.983122 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f\": container with ID starting with 85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f not found: ID does not exist" containerID="85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f" Sep 15 12:35:58.983215 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.983152 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f"} err="failed to get container status \"85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f\": rpc error: code = NotFound desc = could not find container \"85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f\": container with ID starting with 85f1823919636728960101ae522c80fd0d6aa8546a596bb10ba648777a2fe94f not found: ID does not exist" Sep 15 12:35:58.993074 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.993054 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-788b889f47-cdqwp"] Sep 15 12:35:58.997644 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:35:58.997622 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-788b889f47-cdqwp"] Sep 15 12:36:00.431947 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:00.431914 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:36:00.453323 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:00.453295 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e6ead01-a0df-4dc8-97c2-e978e06c9b58" path="/var/lib/kubelet/pods/2e6ead01-a0df-4dc8-97c2-e978e06c9b58/volumes" Sep 15 12:36:00.494190 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:00.494147 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:36:16.024092 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.024031 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-668df678f5-bwtcl" podUID="97b89a1b-5dcd-43e5-a095-3c0a88823c1d" containerName="console" containerID="cri-o://48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8" gracePeriod=15 Sep 15 12:36:16.259912 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.259891 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:36:16.364539 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.364475 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-oauth-config\") pod \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " Sep 15 12:36:16.364539 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.364520 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-service-ca\") pod \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " Sep 15 12:36:16.364688 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.364547 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-trusted-ca-bundle\") pod \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " Sep 15 12:36:16.364746 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.364726 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-oauth-serving-cert\") pod \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " Sep 15 12:36:16.364790 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.364775 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-serving-cert\") pod \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " Sep 15 12:36:16.364843 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.364828 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-config\") pod \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " Sep 15 12:36:16.364889 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.364867 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxt9n\" (UniqueName: \"kubernetes.io/projected/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-kube-api-access-qxt9n\") pod \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\" (UID: \"97b89a1b-5dcd-43e5-a095-3c0a88823c1d\") " Sep 15 12:36:16.365143 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.364863 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-service-ca" (OuterVolumeSpecName: "service-ca") pod "97b89a1b-5dcd-43e5-a095-3c0a88823c1d" (UID: "97b89a1b-5dcd-43e5-a095-3c0a88823c1d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:16.365143 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.365021 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "97b89a1b-5dcd-43e5-a095-3c0a88823c1d" (UID: "97b89a1b-5dcd-43e5-a095-3c0a88823c1d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:16.365143 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.365088 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "97b89a1b-5dcd-43e5-a095-3c0a88823c1d" (UID: "97b89a1b-5dcd-43e5-a095-3c0a88823c1d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:16.365371 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.365292 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-config" (OuterVolumeSpecName: "console-config") pod "97b89a1b-5dcd-43e5-a095-3c0a88823c1d" (UID: "97b89a1b-5dcd-43e5-a095-3c0a88823c1d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:16.366805 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.366783 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "97b89a1b-5dcd-43e5-a095-3c0a88823c1d" (UID: "97b89a1b-5dcd-43e5-a095-3c0a88823c1d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:16.367070 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.367055 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "97b89a1b-5dcd-43e5-a095-3c0a88823c1d" (UID: "97b89a1b-5dcd-43e5-a095-3c0a88823c1d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:16.367070 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.367047 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-kube-api-access-qxt9n" (OuterVolumeSpecName: "kube-api-access-qxt9n") pod "97b89a1b-5dcd-43e5-a095-3c0a88823c1d" (UID: "97b89a1b-5dcd-43e5-a095-3c0a88823c1d"). InnerVolumeSpecName "kube-api-access-qxt9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:36:16.466279 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.466259 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-config\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:16.466374 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.466280 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxt9n\" (UniqueName: \"kubernetes.io/projected/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-kube-api-access-qxt9n\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:16.466374 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.466290 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-oauth-config\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:16.466374 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.466298 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-service-ca\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:16.466374 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.466306 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-trusted-ca-bundle\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:16.466374 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.466313 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-oauth-serving-cert\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:16.466374 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:16.466321 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b89a1b-5dcd-43e5-a095-3c0a88823c1d-console-serving-cert\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:17.052602 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:17.052564 2577 generic.go:356] "Generic (PLEG): container finished" podID="97b89a1b-5dcd-43e5-a095-3c0a88823c1d" containerID="48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8" exitCode=0 Sep 15 12:36:17.052984 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:17.052622 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668df678f5-bwtcl" Sep 15 12:36:17.052984 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:17.052649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668df678f5-bwtcl" event={"ID":"97b89a1b-5dcd-43e5-a095-3c0a88823c1d","Type":"ContainerDied","Data":"48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8"} Sep 15 12:36:17.052984 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:17.052726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668df678f5-bwtcl" event={"ID":"97b89a1b-5dcd-43e5-a095-3c0a88823c1d","Type":"ContainerDied","Data":"5f4c33ad618c1a2ad6c51775bd070c5ef58a4756b3f35cb5d1f252aa530d7247"} Sep 15 12:36:17.052984 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:17.052749 2577 scope.go:117] "RemoveContainer" containerID="48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8" Sep 15 12:36:17.061076 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:17.061061 2577 scope.go:117] "RemoveContainer" containerID="48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8" Sep 15 12:36:17.061385 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:17.061368 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8\": container with ID starting with 48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8 not found: ID does not exist" containerID="48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8" Sep 15 12:36:17.061438 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:17.061393 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8"} err="failed to get container status \"48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8\": rpc error: code = NotFound desc = could not find container \"48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8\": container with ID starting with 48dd23de63394675ad75e3aaabaccb4b082e237b863f82253dbad849c7f820b8 not found: ID does not exist" Sep 15 12:36:17.071645 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:17.071623 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668df678f5-bwtcl"] Sep 15 12:36:17.076708 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:17.076689 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-668df678f5-bwtcl"] Sep 15 12:36:18.453705 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:18.453672 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97b89a1b-5dcd-43e5-a095-3c0a88823c1d" path="/var/lib/kubelet/pods/97b89a1b-5dcd-43e5-a095-3c0a88823c1d/volumes" Sep 15 12:36:33.732274 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:33.732229 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:33.751892 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:33.751861 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:34.131386 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:34.131311 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:44.882092 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:44.882053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:36:44.988009 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:44.987970 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:36:47.587511 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:47.587476 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:36:47.587900 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:47.587831 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="alertmanager" containerID="cri-o://b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2" gracePeriod=120 Sep 15 12:36:47.587961 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:47.587879 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy-metric" containerID="cri-o://84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2" gracePeriod=120 Sep 15 12:36:47.587961 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:47.587902 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy-web" containerID="cri-o://82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507" gracePeriod=120 Sep 15 12:36:47.587961 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:47.587917 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy" containerID="cri-o://0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c" gracePeriod=120 Sep 15 12:36:47.588104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:47.587945 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="config-reloader" containerID="cri-o://85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d" gracePeriod=120 Sep 15 12:36:47.588104 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:47.587975 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="prom-label-proxy" containerID="cri-o://b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8" gracePeriod=120 Sep 15 12:36:48.172694 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.172663 2577 generic.go:356] "Generic (PLEG): container finished" podID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerID="b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8" exitCode=0 Sep 15 12:36:48.172694 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.172687 2577 generic.go:356] "Generic (PLEG): container finished" podID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerID="84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2" exitCode=0 Sep 15 12:36:48.172694 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.172693 2577 generic.go:356] "Generic (PLEG): container finished" podID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerID="0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c" exitCode=0 Sep 15 12:36:48.172694 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.172699 2577 generic.go:356] "Generic (PLEG): container finished" podID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerID="85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d" exitCode=0 Sep 15 12:36:48.172694 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.172704 2577 generic.go:356] "Generic (PLEG): container finished" podID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerID="b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2" exitCode=0 Sep 15 12:36:48.172978 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.172732 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerDied","Data":"b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8"} Sep 15 12:36:48.172978 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.172800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerDied","Data":"84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2"} Sep 15 12:36:48.172978 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.172828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerDied","Data":"0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c"} Sep 15 12:36:48.172978 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.172852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerDied","Data":"85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d"} Sep 15 12:36:48.172978 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.172875 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerDied","Data":"b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2"} Sep 15 12:36:48.829714 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.829691 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:36:48.918712 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918628 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-metrics-client-ca\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.918712 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918673 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-volume\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.918933 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918714 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-web-config\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.918933 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918751 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-metric\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.918933 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918787 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-main-tls\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.918933 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918828 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-main-db\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.918933 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918868 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-trusted-ca-bundle\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.918933 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918912 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-cluster-tls-config\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.919329 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918946 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-web\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.919329 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918975 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-tls-assets\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.919329 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.918999 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-out\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.919329 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.919029 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvztc\" (UniqueName: \"kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-kube-api-access-zvztc\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.919329 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.919041 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:48.919329 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.919067 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy\") pod \"454860b7-40e5-4c4c-ac68-f6fefbffc171\" (UID: \"454860b7-40e5-4c4c-ac68-f6fefbffc171\") " Sep 15 12:36:48.919950 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.919490 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-metrics-client-ca\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:48.920306 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.920271 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 12:36:48.920509 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.920483 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:48.922414 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.922374 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:48.922856 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.922807 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:36:48.922856 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.922813 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:48.923289 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.923238 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-kube-api-access-zvztc" (OuterVolumeSpecName: "kube-api-access-zvztc") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "kube-api-access-zvztc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:36:48.923393 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.923360 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-out" (OuterVolumeSpecName: "config-out") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 12:36:48.923552 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.923527 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:48.923655 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.923621 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:48.923880 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.923858 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-volume" (OuterVolumeSpecName: "config-volume") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:48.927130 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.927102 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:48.932768 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:48.932746 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-web-config" (OuterVolumeSpecName: "web-config") pod "454860b7-40e5-4c4c-ac68-f6fefbffc171" (UID: "454860b7-40e5-4c4c-ac68-f6fefbffc171"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:49.020389 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020336 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020389 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020380 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-cluster-tls-config\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020389 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020389 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020389 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020399 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-tls-assets\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020389 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020408 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-out\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020679 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020415 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvztc\" (UniqueName: \"kubernetes.io/projected/454860b7-40e5-4c4c-ac68-f6fefbffc171-kube-api-access-zvztc\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020679 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020424 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020679 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020432 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-config-volume\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020679 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020440 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-web-config\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020679 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020447 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020679 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020458 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/454860b7-40e5-4c4c-ac68-f6fefbffc171-secret-alertmanager-main-tls\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.020679 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.020466 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/454860b7-40e5-4c4c-ac68-f6fefbffc171-alertmanager-main-db\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:49.179831 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.179741 2577 generic.go:356] "Generic (PLEG): container finished" podID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerID="82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507" exitCode=0 Sep 15 12:36:49.179831 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.179811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerDied","Data":"82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507"} Sep 15 12:36:49.179831 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.179828 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 12:36:49.180095 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.179876 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"454860b7-40e5-4c4c-ac68-f6fefbffc171","Type":"ContainerDied","Data":"bc10dff3de2293922df026bfa322f0853a905eb709482d497ececfc55072484f"} Sep 15 12:36:49.180095 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.179909 2577 scope.go:117] "RemoveContainer" containerID="b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8" Sep 15 12:36:49.187753 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.187733 2577 scope.go:117] "RemoveContainer" containerID="84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2" Sep 15 12:36:49.195626 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.195607 2577 scope.go:117] "RemoveContainer" containerID="0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c" Sep 15 12:36:49.202834 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.202811 2577 scope.go:117] "RemoveContainer" containerID="82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507" Sep 15 12:36:49.205120 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.205100 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:36:49.209354 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.209333 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 12:36:49.211694 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.211676 2577 scope.go:117] "RemoveContainer" containerID="85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d" Sep 15 12:36:49.219221 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.219205 2577 scope.go:117] "RemoveContainer" containerID="b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2" Sep 15 12:36:49.226982 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.226962 2577 scope.go:117] "RemoveContainer" containerID="cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b" Sep 15 12:36:49.235948 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.235830 2577 scope.go:117] "RemoveContainer" containerID="b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8" Sep 15 12:36:49.236314 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:49.236292 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8\": container with ID starting with b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8 not found: ID does not exist" containerID="b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8" Sep 15 12:36:49.236406 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.236323 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8"} err="failed to get container status \"b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8\": rpc error: code = NotFound desc = could not find container \"b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8\": container with ID starting with b8feb19d05b0358e45fd6082e9522af225986da9b2bfa20392c1cf81c8f37eb8 not found: ID does not exist" Sep 15 12:36:49.236406 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.236344 2577 scope.go:117] "RemoveContainer" containerID="84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2" Sep 15 12:36:49.237064 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:49.237034 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2\": container with ID starting with 84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2 not found: ID does not exist" containerID="84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2" Sep 15 12:36:49.237143 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.237068 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2"} err="failed to get container status \"84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2\": rpc error: code = NotFound desc = could not find container \"84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2\": container with ID starting with 84619f13834fdd1e459ddea3b03d12b67efb5c69f774345df98493c6e62cb4d2 not found: ID does not exist" Sep 15 12:36:49.237143 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.237084 2577 scope.go:117] "RemoveContainer" containerID="0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c" Sep 15 12:36:49.237469 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:49.237442 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c\": container with ID starting with 0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c not found: ID does not exist" containerID="0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c" Sep 15 12:36:49.237552 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.237467 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c"} err="failed to get container status \"0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c\": rpc error: code = NotFound desc = could not find container \"0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c\": container with ID starting with 0491034a10bcd50ee83eac385404a640c385e43efaaaa3774356edf5cebd072c not found: ID does not exist" Sep 15 12:36:49.237552 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.237483 2577 scope.go:117] "RemoveContainer" containerID="82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507" Sep 15 12:36:49.237740 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:49.237725 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507\": container with ID starting with 82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507 not found: ID does not exist" containerID="82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507" Sep 15 12:36:49.237787 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.237744 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507"} err="failed to get container status \"82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507\": rpc error: code = NotFound desc = could not find container \"82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507\": container with ID starting with 82b1314fcbe87028c86ce8fb4451b236ba1456ea04e235cc63ff31c4672a2507 not found: ID does not exist" Sep 15 12:36:49.237787 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.237756 2577 scope.go:117] "RemoveContainer" containerID="85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d" Sep 15 12:36:49.238011 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:49.237993 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d\": container with ID starting with 85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d not found: ID does not exist" containerID="85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d" Sep 15 12:36:49.238083 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.238019 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d"} err="failed to get container status \"85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d\": rpc error: code = NotFound desc = could not find container \"85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d\": container with ID starting with 85efe6c4611acf0ff80df8240fff6b62cfd9de8173f4c1e5b0e812111d1d868d not found: ID does not exist" Sep 15 12:36:49.238083 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.238040 2577 scope.go:117] "RemoveContainer" containerID="b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2" Sep 15 12:36:49.238343 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:49.238327 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2\": container with ID starting with b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2 not found: ID does not exist" containerID="b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2" Sep 15 12:36:49.238392 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.238346 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2"} err="failed to get container status \"b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2\": rpc error: code = NotFound desc = could not find container \"b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2\": container with ID starting with b87dd769516838c3400d456211fc6061e890810c9451c3665db0c260ec9f1bb2 not found: ID does not exist" Sep 15 12:36:49.238392 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.238359 2577 scope.go:117] "RemoveContainer" containerID="cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b" Sep 15 12:36:49.238587 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:49.238570 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b\": container with ID starting with cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b not found: ID does not exist" containerID="cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b" Sep 15 12:36:49.238633 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:49.238589 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b"} err="failed to get container status \"cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b\": rpc error: code = NotFound desc = could not find container \"cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b\": container with ID starting with cc3925e3d625b3160f04d233afaea2fda6a7ca5cf5e3b4aba404459a4426b46b not found: ID does not exist" Sep 15 12:36:50.453712 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:50.453678 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" path="/var/lib/kubelet/pods/454860b7-40e5-4c4c-ac68-f6fefbffc171/volumes" Sep 15 12:36:51.836413 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:51.836372 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:36:51.836813 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:51.836726 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="prometheus" containerID="cri-o://017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4" gracePeriod=600 Sep 15 12:36:51.836813 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:51.836762 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="thanos-sidecar" containerID="cri-o://ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a" gracePeriod=600 Sep 15 12:36:51.836813 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:51.836798 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy-web" containerID="cri-o://2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4" gracePeriod=600 Sep 15 12:36:51.836975 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:51.836771 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="config-reloader" containerID="cri-o://8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b" gracePeriod=600 Sep 15 12:36:51.836975 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:51.836782 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b" gracePeriod=600 Sep 15 12:36:51.836975 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:51.836748 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy" containerID="cri-o://7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d" gracePeriod=600 Sep 15 12:36:52.072960 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.072938 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.195822 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.195793 2577 generic.go:356] "Generic (PLEG): container finished" podID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerID="2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b" exitCode=0 Sep 15 12:36:52.195822 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.195816 2577 generic.go:356] "Generic (PLEG): container finished" podID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerID="7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d" exitCode=0 Sep 15 12:36:52.195822 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.195823 2577 generic.go:356] "Generic (PLEG): container finished" podID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerID="2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4" exitCode=0 Sep 15 12:36:52.195822 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.195828 2577 generic.go:356] "Generic (PLEG): container finished" podID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerID="ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a" exitCode=0 Sep 15 12:36:52.196048 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.195833 2577 generic.go:356] "Generic (PLEG): container finished" podID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerID="8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b" exitCode=0 Sep 15 12:36:52.196048 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.195838 2577 generic.go:356] "Generic (PLEG): container finished" podID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerID="017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4" exitCode=0 Sep 15 12:36:52.196048 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.195872 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.196048 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.195873 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerDied","Data":"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b"} Sep 15 12:36:52.196048 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.196004 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerDied","Data":"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d"} Sep 15 12:36:52.196048 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.196033 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerDied","Data":"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4"} Sep 15 12:36:52.196276 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.196056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerDied","Data":"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a"} Sep 15 12:36:52.196276 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.196069 2577 scope.go:117] "RemoveContainer" containerID="2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b" Sep 15 12:36:52.196276 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.196079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerDied","Data":"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b"} Sep 15 12:36:52.196276 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.196102 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerDied","Data":"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4"} Sep 15 12:36:52.196276 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.196126 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7904286-6eed-4f1f-b314-e15f8cc2ecc1","Type":"ContainerDied","Data":"cc4255802a0a8fb4aad43d29d5b39ceef2a391e5a7d9a8e4e7d02c74bc68b91b"} Sep 15 12:36:52.203337 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.203322 2577 scope.go:117] "RemoveContainer" containerID="7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d" Sep 15 12:36:52.210044 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.210027 2577 scope.go:117] "RemoveContainer" containerID="2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4" Sep 15 12:36:52.216321 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.216291 2577 scope.go:117] "RemoveContainer" containerID="ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a" Sep 15 12:36:52.222762 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.222745 2577 scope.go:117] "RemoveContainer" containerID="8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b" Sep 15 12:36:52.228922 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.228908 2577 scope.go:117] "RemoveContainer" containerID="017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4" Sep 15 12:36:52.235594 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.235578 2577 scope.go:117] "RemoveContainer" containerID="48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5" Sep 15 12:36:52.241663 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.241647 2577 scope.go:117] "RemoveContainer" containerID="2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b" Sep 15 12:36:52.241913 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:52.241894 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": container with ID starting with 2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b not found: ID does not exist" containerID="2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b" Sep 15 12:36:52.241983 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.241925 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b"} err="failed to get container status \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": rpc error: code = NotFound desc = could not find container \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": container with ID starting with 2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b not found: ID does not exist" Sep 15 12:36:52.241983 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.241953 2577 scope.go:117] "RemoveContainer" containerID="7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d" Sep 15 12:36:52.242244 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:52.242220 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": container with ID starting with 7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d not found: ID does not exist" containerID="7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d" Sep 15 12:36:52.242293 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.242251 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d"} err="failed to get container status \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": rpc error: code = NotFound desc = could not find container \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": container with ID starting with 7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d not found: ID does not exist" Sep 15 12:36:52.242293 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.242265 2577 scope.go:117] "RemoveContainer" containerID="2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4" Sep 15 12:36:52.242513 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:52.242496 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": container with ID starting with 2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4 not found: ID does not exist" containerID="2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4" Sep 15 12:36:52.242569 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.242521 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4"} err="failed to get container status \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": rpc error: code = NotFound desc = could not find container \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": container with ID starting with 2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4 not found: ID does not exist" Sep 15 12:36:52.242569 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.242542 2577 scope.go:117] "RemoveContainer" containerID="ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a" Sep 15 12:36:52.242773 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:52.242758 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": container with ID starting with ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a not found: ID does not exist" containerID="ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a" Sep 15 12:36:52.242807 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.242776 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a"} err="failed to get container status \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": rpc error: code = NotFound desc = could not find container \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": container with ID starting with ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a not found: ID does not exist" Sep 15 12:36:52.242807 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.242789 2577 scope.go:117] "RemoveContainer" containerID="8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b" Sep 15 12:36:52.243003 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:52.242985 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": container with ID starting with 8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b not found: ID does not exist" containerID="8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b" Sep 15 12:36:52.243037 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243009 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b"} err="failed to get container status \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": rpc error: code = NotFound desc = could not find container \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": container with ID starting with 8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b not found: ID does not exist" Sep 15 12:36:52.243037 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243024 2577 scope.go:117] "RemoveContainer" containerID="017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4" Sep 15 12:36:52.243270 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:52.243253 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": container with ID starting with 017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4 not found: ID does not exist" containerID="017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4" Sep 15 12:36:52.243313 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243272 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4"} err="failed to get container status \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": rpc error: code = NotFound desc = could not find container \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": container with ID starting with 017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4 not found: ID does not exist" Sep 15 12:36:52.243313 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243289 2577 scope.go:117] "RemoveContainer" containerID="48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5" Sep 15 12:36:52.243506 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:36:52.243490 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": container with ID starting with 48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5 not found: ID does not exist" containerID="48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5" Sep 15 12:36:52.243561 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243514 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5"} err="failed to get container status \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": rpc error: code = NotFound desc = could not find container \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": container with ID starting with 48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5 not found: ID does not exist" Sep 15 12:36:52.243561 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243533 2577 scope.go:117] "RemoveContainer" containerID="2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b" Sep 15 12:36:52.243744 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243727 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b"} err="failed to get container status \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": rpc error: code = NotFound desc = could not find container \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": container with ID starting with 2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b not found: ID does not exist" Sep 15 12:36:52.243836 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243744 2577 scope.go:117] "RemoveContainer" containerID="7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d" Sep 15 12:36:52.243952 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243935 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d"} err="failed to get container status \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": rpc error: code = NotFound desc = could not find container \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": container with ID starting with 7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d not found: ID does not exist" Sep 15 12:36:52.244014 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243953 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-tls\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244014 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243975 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-1\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244014 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244004 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-0\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244184 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244026 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244184 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.243954 2577 scope.go:117] "RemoveContainer" containerID="2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4" Sep 15 12:36:52.244184 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244051 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-metrics-client-ca\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244184 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244079 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25l9x\" (UniqueName: \"kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-kube-api-access-25l9x\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244184 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244131 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-db\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244184 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244180 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-grpc-tls\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244214 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-metrics-client-certs\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244237 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-web-config\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244261 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-kube-rbac-proxy\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244289 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-tls-assets\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244312 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244308 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244333 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-trusted-ca-bundle\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244372 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-thanos-prometheus-http-client-file\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244403 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-serving-certs-ca-bundle\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244429 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config-out\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244434 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4"} err="failed to get container status \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": rpc error: code = NotFound desc = could not find container \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": container with ID starting with 2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4 not found: ID does not exist" Sep 15 12:36:52.244479 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244461 2577 scope.go:117] "RemoveContainer" containerID="ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a" Sep 15 12:36:52.245607 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244460 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.245607 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244555 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-2\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.245607 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244601 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-kubelet-serving-ca-bundle\") pod \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\" (UID: \"a7904286-6eed-4f1f-b314-e15f8cc2ecc1\") " Sep 15 12:36:52.245607 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244640 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:52.245607 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244850 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.245607 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.244867 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-metrics-client-ca\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.245607 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.245445 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 12:36:52.245607 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.245534 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:52.245993 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.245791 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:52.245993 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.245791 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a"} err="failed to get container status \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": rpc error: code = NotFound desc = could not find container \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": container with ID starting with ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a not found: ID does not exist" Sep 15 12:36:52.245993 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.245826 2577 scope.go:117] "RemoveContainer" containerID="8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b" Sep 15 12:36:52.246245 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.246218 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:52.246328 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.246221 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b"} err="failed to get container status \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": rpc error: code = NotFound desc = could not find container \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": container with ID starting with 8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b not found: ID does not exist" Sep 15 12:36:52.246328 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.246264 2577 scope.go:117] "RemoveContainer" containerID="017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4" Sep 15 12:36:52.246328 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.246282 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:52.246771 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.246547 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4"} err="failed to get container status \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": rpc error: code = NotFound desc = could not find container \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": container with ID starting with 017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4 not found: ID does not exist" Sep 15 12:36:52.246771 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.246578 2577 scope.go:117] "RemoveContainer" containerID="48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5" Sep 15 12:36:52.246969 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.246941 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:52.247059 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.247035 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5"} err="failed to get container status \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": rpc error: code = NotFound desc = could not find container \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": container with ID starting with 48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5 not found: ID does not exist" Sep 15 12:36:52.247220 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.247207 2577 scope.go:117] "RemoveContainer" containerID="2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b" Sep 15 12:36:52.247355 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.247080 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:36:52.247659 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.247633 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b"} err="failed to get container status \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": rpc error: code = NotFound desc = could not find container \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": container with ID starting with 2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b not found: ID does not exist" Sep 15 12:36:52.247849 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.247662 2577 scope.go:117] "RemoveContainer" containerID="7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d" Sep 15 12:36:52.248004 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.247938 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d"} err="failed to get container status \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": rpc error: code = NotFound desc = could not find container \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": container with ID starting with 7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d not found: ID does not exist" Sep 15 12:36:52.248004 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.247967 2577 scope.go:117] "RemoveContainer" containerID="2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4" Sep 15 12:36:52.248274 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.248253 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:52.248465 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.248443 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4"} err="failed to get container status \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": rpc error: code = NotFound desc = could not find container \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": container with ID starting with 2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4 not found: ID does not exist" Sep 15 12:36:52.248583 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.248571 2577 scope.go:117] "RemoveContainer" containerID="ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a" Sep 15 12:36:52.248986 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.248950 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a"} err="failed to get container status \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": rpc error: code = NotFound desc = could not find container \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": container with ID starting with ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a not found: ID does not exist" Sep 15 12:36:52.248986 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.248986 2577 scope.go:117] "RemoveContainer" containerID="8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b" Sep 15 12:36:52.249487 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.249458 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b"} err="failed to get container status \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": rpc error: code = NotFound desc = could not find container \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": container with ID starting with 8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b not found: ID does not exist" Sep 15 12:36:52.249583 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.249488 2577 scope.go:117] "RemoveContainer" containerID="017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4" Sep 15 12:36:52.249941 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.249919 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-kube-api-access-25l9x" (OuterVolumeSpecName: "kube-api-access-25l9x") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "kube-api-access-25l9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:36:52.250146 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250030 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config-out" (OuterVolumeSpecName: "config-out") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 12:36:52.250146 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250050 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:52.250146 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250080 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:52.250146 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250099 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:52.250146 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250118 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config" (OuterVolumeSpecName: "config") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:52.250146 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250110 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4"} err="failed to get container status \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": rpc error: code = NotFound desc = could not find container \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": container with ID starting with 017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4 not found: ID does not exist" Sep 15 12:36:52.250452 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250187 2577 scope.go:117] "RemoveContainer" containerID="48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5" Sep 15 12:36:52.250452 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250227 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:52.250529 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250468 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:36:52.250570 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250511 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5"} err="failed to get container status \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": rpc error: code = NotFound desc = could not find container \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": container with ID starting with 48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5 not found: ID does not exist" Sep 15 12:36:52.250570 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250546 2577 scope.go:117] "RemoveContainer" containerID="2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b" Sep 15 12:36:52.250820 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250801 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b"} err="failed to get container status \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": rpc error: code = NotFound desc = could not find container \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": container with ID starting with 2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b not found: ID does not exist" Sep 15 12:36:52.250906 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.250823 2577 scope.go:117] "RemoveContainer" containerID="7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d" Sep 15 12:36:52.251135 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.251117 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d"} err="failed to get container status \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": rpc error: code = NotFound desc = could not find container \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": container with ID starting with 7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d not found: ID does not exist" Sep 15 12:36:52.251135 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.251135 2577 scope.go:117] "RemoveContainer" containerID="2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4" Sep 15 12:36:52.251312 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.251238 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:52.251476 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.251458 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4"} err="failed to get container status \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": rpc error: code = NotFound desc = could not find container \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": container with ID starting with 2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4 not found: ID does not exist" Sep 15 12:36:52.251535 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.251476 2577 scope.go:117] "RemoveContainer" containerID="ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a" Sep 15 12:36:52.251715 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.251696 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a"} err="failed to get container status \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": rpc error: code = NotFound desc = could not find container \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": container with ID starting with ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a not found: ID does not exist" Sep 15 12:36:52.251773 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.251716 2577 scope.go:117] "RemoveContainer" containerID="8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b" Sep 15 12:36:52.251961 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.251944 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b"} err="failed to get container status \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": rpc error: code = NotFound desc = could not find container \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": container with ID starting with 8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b not found: ID does not exist" Sep 15 12:36:52.251961 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.251961 2577 scope.go:117] "RemoveContainer" containerID="017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4" Sep 15 12:36:52.252223 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.252206 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4"} err="failed to get container status \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": rpc error: code = NotFound desc = could not find container \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": container with ID starting with 017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4 not found: ID does not exist" Sep 15 12:36:52.252275 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.252224 2577 scope.go:117] "RemoveContainer" containerID="48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5" Sep 15 12:36:52.252436 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.252421 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5"} err="failed to get container status \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": rpc error: code = NotFound desc = could not find container \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": container with ID starting with 48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5 not found: ID does not exist" Sep 15 12:36:52.252498 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.252439 2577 scope.go:117] "RemoveContainer" containerID="2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b" Sep 15 12:36:52.252664 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.252647 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b"} err="failed to get container status \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": rpc error: code = NotFound desc = could not find container \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": container with ID starting with 2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b not found: ID does not exist" Sep 15 12:36:52.252715 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.252665 2577 scope.go:117] "RemoveContainer" containerID="7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d" Sep 15 12:36:52.252921 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.252907 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d"} err="failed to get container status \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": rpc error: code = NotFound desc = could not find container \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": container with ID starting with 7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d not found: ID does not exist" Sep 15 12:36:52.252967 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.252921 2577 scope.go:117] "RemoveContainer" containerID="2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4" Sep 15 12:36:52.253250 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.253223 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4"} err="failed to get container status \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": rpc error: code = NotFound desc = could not find container \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": container with ID starting with 2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4 not found: ID does not exist" Sep 15 12:36:52.253250 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.253250 2577 scope.go:117] "RemoveContainer" containerID="ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a" Sep 15 12:36:52.253507 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.253492 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a"} err="failed to get container status \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": rpc error: code = NotFound desc = could not find container \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": container with ID starting with ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a not found: ID does not exist" Sep 15 12:36:52.253507 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.253508 2577 scope.go:117] "RemoveContainer" containerID="8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b" Sep 15 12:36:52.253743 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.253726 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b"} err="failed to get container status \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": rpc error: code = NotFound desc = could not find container \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": container with ID starting with 8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b not found: ID does not exist" Sep 15 12:36:52.253743 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.253743 2577 scope.go:117] "RemoveContainer" containerID="017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4" Sep 15 12:36:52.253938 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.253922 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4"} err="failed to get container status \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": rpc error: code = NotFound desc = could not find container \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": container with ID starting with 017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4 not found: ID does not exist" Sep 15 12:36:52.253995 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.253938 2577 scope.go:117] "RemoveContainer" containerID="48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5" Sep 15 12:36:52.254130 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.254115 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5"} err="failed to get container status \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": rpc error: code = NotFound desc = could not find container \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": container with ID starting with 48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5 not found: ID does not exist" Sep 15 12:36:52.254192 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.254130 2577 scope.go:117] "RemoveContainer" containerID="2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b" Sep 15 12:36:52.254345 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.254329 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b"} err="failed to get container status \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": rpc error: code = NotFound desc = could not find container \"2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b\": container with ID starting with 2f73b8678afe36ce877c1b9ad13fe56e452a29e08d2628daaa2f29ffc2ae932b not found: ID does not exist" Sep 15 12:36:52.254345 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.254344 2577 scope.go:117] "RemoveContainer" containerID="7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d" Sep 15 12:36:52.254517 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.254499 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d"} err="failed to get container status \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": rpc error: code = NotFound desc = could not find container \"7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d\": container with ID starting with 7892123bb7e885edfa184c6e93cebecffc4df3d5d818b6edd65b3b53207be23d not found: ID does not exist" Sep 15 12:36:52.254569 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.254519 2577 scope.go:117] "RemoveContainer" containerID="2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4" Sep 15 12:36:52.254726 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.254702 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4"} err="failed to get container status \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": rpc error: code = NotFound desc = could not find container \"2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4\": container with ID starting with 2eec961761bba9dbc63d71e11ae948a02b39790139e82fda8292f6062e7659f4 not found: ID does not exist" Sep 15 12:36:52.254726 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.254715 2577 scope.go:117] "RemoveContainer" containerID="ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a" Sep 15 12:36:52.254958 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.254937 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a"} err="failed to get container status \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": rpc error: code = NotFound desc = could not find container \"ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a\": container with ID starting with ca9003c81fbc7ea1a412667095c6185c5a8d7d79fd12179b0198663c4e5da51a not found: ID does not exist" Sep 15 12:36:52.255038 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.254960 2577 scope.go:117] "RemoveContainer" containerID="8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b" Sep 15 12:36:52.255302 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.255284 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b"} err="failed to get container status \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": rpc error: code = NotFound desc = could not find container \"8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b\": container with ID starting with 8bec48ce82cbc80a27735ee30c1c619aa269838caeb4561e8064ab28f0f2b11b not found: ID does not exist" Sep 15 12:36:52.255302 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.255301 2577 scope.go:117] "RemoveContainer" containerID="017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4" Sep 15 12:36:52.255520 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.255500 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4"} err="failed to get container status \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": rpc error: code = NotFound desc = could not find container \"017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4\": container with ID starting with 017e42cfb14f3c2128b661f92c5ec10c4ac11a9245e72f7d393808d6d76f71c4 not found: ID does not exist" Sep 15 12:36:52.255590 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.255523 2577 scope.go:117] "RemoveContainer" containerID="48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5" Sep 15 12:36:52.255805 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.255782 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5"} err="failed to get container status \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": rpc error: code = NotFound desc = could not find container \"48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5\": container with ID starting with 48ab14341cb3142eb178871b0fc7dbfac4b0d7da4787da802f2826108cb5bea5 not found: ID does not exist" Sep 15 12:36:52.258296 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.258277 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-web-config" (OuterVolumeSpecName: "web-config") pod "a7904286-6eed-4f1f-b314-e15f8cc2ecc1" (UID: "a7904286-6eed-4f1f-b314-e15f8cc2ecc1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:36:52.345830 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345799 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25l9x\" (UniqueName: \"kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-kube-api-access-25l9x\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.345830 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345829 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-db\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.345830 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345838 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-grpc-tls\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345848 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-metrics-client-certs\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345856 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-web-config\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345864 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-kube-rbac-proxy\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345873 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-tls-assets\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345881 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345888 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345897 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345905 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345913 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-config-out\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345921 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345930 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345938 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345946 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345954 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.346013 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.345962 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7904286-6eed-4f1f-b314-e15f8cc2ecc1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:36:52.516399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.516376 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:36:52.521134 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.521114 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:36:52.545749 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.545730 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:36:52.545956 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.545943 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="config-reloader" Sep 15 12:36:52.545956 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.545956 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="config-reloader" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.545966 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97b89a1b-5dcd-43e5-a095-3c0a88823c1d" containerName="console" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.545971 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b89a1b-5dcd-43e5-a095-3c0a88823c1d" containerName="console" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.545979 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="init-config-reloader" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.545984 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="init-config-reloader" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.545990 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="init-config-reloader" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.545994 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="init-config-reloader" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.545999 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy-metric" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546004 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy-metric" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546011 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy-web" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546015 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy-web" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546022 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e6ead01-a0df-4dc8-97c2-e978e06c9b58" containerName="console" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546026 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6ead01-a0df-4dc8-97c2-e978e06c9b58" containerName="console" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546036 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy" Sep 15 12:36:52.546033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546041 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546047 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="prometheus" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546052 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="prometheus" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546057 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546062 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546069 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy-web" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546074 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy-web" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546079 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="prom-label-proxy" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546085 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="prom-label-proxy" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546090 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy-thanos" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546096 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy-thanos" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546102 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="alertmanager" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546107 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="alertmanager" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546113 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="config-reloader" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546117 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="config-reloader" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546123 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="thanos-sidecar" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546128 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="thanos-sidecar" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546177 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546183 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="97b89a1b-5dcd-43e5-a095-3c0a88823c1d" containerName="console" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546190 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="config-reloader" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546195 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy-web" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546200 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy-web" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546204 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy-thanos" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546209 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="prom-label-proxy" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546214 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="alertmanager" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546218 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="prometheus" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546222 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="thanos-sidecar" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546227 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" containerName="kube-rbac-proxy" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546231 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="kube-rbac-proxy-metric" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546236 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="454860b7-40e5-4c4c-ac68-f6fefbffc171" containerName="config-reloader" Sep 15 12:36:52.546482 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.546241 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e6ead01-a0df-4dc8-97c2-e978e06c9b58" containerName="console" Sep 15 12:36:52.549623 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.549607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.552132 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.552116 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 15 12:36:52.552516 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.552494 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 15 12:36:52.552590 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.552506 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5wfz7\"" Sep 15 12:36:52.552860 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.552842 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 15 12:36:52.552949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.552922 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 15 12:36:52.553005 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.552957 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 15 12:36:52.553005 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.552967 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a5rkonnp980uv\"" Sep 15 12:36:52.553117 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.553037 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 15 12:36:52.553117 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.552960 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 15 12:36:52.553117 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.553085 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 15 12:36:52.553290 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.553127 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 15 12:36:52.553290 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.553183 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 15 12:36:52.553290 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.553196 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 15 12:36:52.553290 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.552973 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 15 12:36:52.553290 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.553066 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 15 12:36:52.561231 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.560939 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 15 12:36:52.562726 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.562708 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 15 12:36:52.569724 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.569704 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:36:52.647971 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.647949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648059 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.647978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648059 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.647997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-config\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648059 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648208 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648208 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt8n2\" (UniqueName: \"kubernetes.io/projected/15153b34-c80b-4d98-b189-a02707b450c2-kube-api-access-xt8n2\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648208 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648208 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648190 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648208 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648453 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648453 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648453 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648453 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648453 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648453 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648453 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15153b34-c80b-4d98-b189-a02707b450c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648690 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648690 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15153b34-c80b-4d98-b189-a02707b450c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648690 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.648690 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.648539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.748882 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.748828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.748882 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.748859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.748882 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.748876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.748893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-config\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.748909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.748926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.748944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt8n2\" (UniqueName: \"kubernetes.io/projected/15153b34-c80b-4d98-b189-a02707b450c2-kube-api-access-xt8n2\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.748970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.748999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749645 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749645 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749645 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749645 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749645 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15153b34-c80b-4d98-b189-a02707b450c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749645 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749645 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749541 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749996 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749762 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.749996 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.749976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15153b34-c80b-4d98-b189-a02707b450c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.750110 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.750019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.751075 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.750233 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.751075 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.750678 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.751075 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.750739 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.752730 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.752606 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.752730 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.752709 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.753292 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.753002 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.753292 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.753185 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-config\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.753292 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.753247 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.753489 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.753418 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.753609 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.753561 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.754094 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.754071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.754225 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.754137 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15153b34-c80b-4d98-b189-a02707b450c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.754284 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.754246 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15153b34-c80b-4d98-b189-a02707b450c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.754646 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.754625 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.755206 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.755153 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.755518 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.755483 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15153b34-c80b-4d98-b189-a02707b450c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.755518 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.755484 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15153b34-c80b-4d98-b189-a02707b450c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.757729 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.757712 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt8n2\" (UniqueName: \"kubernetes.io/projected/15153b34-c80b-4d98-b189-a02707b450c2-kube-api-access-xt8n2\") pod \"prometheus-k8s-0\" (UID: \"15153b34-c80b-4d98-b189-a02707b450c2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:52.861421 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:52.861402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:36:53.142674 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:53.142646 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 12:36:53.145017 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:36:53.144992 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15153b34_c80b_4d98_b189_a02707b450c2.slice/crio-7adcb6f3fc7a4f608dbd57c15a4abdb342357e9dfec50503a52b61c8085df0aa WatchSource:0}: Error finding container 7adcb6f3fc7a4f608dbd57c15a4abdb342357e9dfec50503a52b61c8085df0aa: Status 404 returned error can't find the container with id 7adcb6f3fc7a4f608dbd57c15a4abdb342357e9dfec50503a52b61c8085df0aa Sep 15 12:36:53.200766 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:53.200741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15153b34-c80b-4d98-b189-a02707b450c2","Type":"ContainerStarted","Data":"7adcb6f3fc7a4f608dbd57c15a4abdb342357e9dfec50503a52b61c8085df0aa"} Sep 15 12:36:54.209841 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:54.209802 2577 generic.go:356] "Generic (PLEG): container finished" podID="15153b34-c80b-4d98-b189-a02707b450c2" containerID="f7188a60255b96c2e3ed0881b6146c88ffa2ce51e1a162de785937d97a8ae187" exitCode=0 Sep 15 12:36:54.210352 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:54.209888 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15153b34-c80b-4d98-b189-a02707b450c2","Type":"ContainerDied","Data":"f7188a60255b96c2e3ed0881b6146c88ffa2ce51e1a162de785937d97a8ae187"} Sep 15 12:36:54.455620 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:54.455599 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7904286-6eed-4f1f-b314-e15f8cc2ecc1" path="/var/lib/kubelet/pods/a7904286-6eed-4f1f-b314-e15f8cc2ecc1/volumes" Sep 15 12:36:54.995832 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:54.995802 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cbdf8b9fd-8hbj6"] Sep 15 12:36:55.153233 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:55.153199 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:36:55.217039 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:55.217002 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15153b34-c80b-4d98-b189-a02707b450c2","Type":"ContainerStarted","Data":"90733d5ae103b1fbf467e36e03b4a7c7f256593b0f3fca68d2113d6d7b7c3076"} Sep 15 12:36:55.217503 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:55.217078 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15153b34-c80b-4d98-b189-a02707b450c2","Type":"ContainerStarted","Data":"3c3ae036148a1a11f7fbf385aab5c9a2a925f4cbc8300871db18baaf6c9e0cfb"} Sep 15 12:36:55.217503 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:55.217110 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15153b34-c80b-4d98-b189-a02707b450c2","Type":"ContainerStarted","Data":"bde416c059bb93e33a116a14fa2c086235ba27963681e4031ba3585f38d3d19f"} Sep 15 12:36:55.217503 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:55.217135 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15153b34-c80b-4d98-b189-a02707b450c2","Type":"ContainerStarted","Data":"ce22c603593c932612a1ace79d3fcad435984b42de5d58e60bee74b1a97f7abf"} Sep 15 12:36:55.217503 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:55.217185 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15153b34-c80b-4d98-b189-a02707b450c2","Type":"ContainerStarted","Data":"196942807de5c662063c6637e807f2d15941854e56aa6e1a17ba2404242ec0c8"} Sep 15 12:36:55.217503 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:55.217218 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15153b34-c80b-4d98-b189-a02707b450c2","Type":"ContainerStarted","Data":"9909cf0bd45b7b212ad148e7ae7c57a1b73f0e75d8f09505c3e3513397b9b0a1"} Sep 15 12:36:55.246703 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:55.246608 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.227649649 podStartE2EDuration="3.246564389s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.91474ms" isStatefulPod=false podCreationTimestamp="2026-09-15 12:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:36:55.244951223 +0000 UTC m=+173.288198849" watchObservedRunningTime="2026-09-15 12:36:55.246564389 +0000 UTC m=+173.289812000" Sep 15 12:36:55.250410 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:55.250375 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:36:55.319718 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:55.319681 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:36:57.862550 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:36:57.862509 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:37:00.429799 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:00.429753 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:37:00.530246 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:00.530216 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:37:00.630434 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:00.630404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:37:13.139854 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:13.139820 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:37:20.016023 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.015986 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cbdf8b9fd-8hbj6" podUID="bc0c77dc-8344-4023-9bd7-f1de36d8724d" containerName="console" containerID="cri-o://1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b" gracePeriod=15 Sep 15 12:37:20.256423 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.256401 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:37:20.310227 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.310128 2577 generic.go:356] "Generic (PLEG): container finished" podID="bc0c77dc-8344-4023-9bd7-f1de36d8724d" containerID="1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b" exitCode=0 Sep 15 12:37:20.310227 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.310206 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbdf8b9fd-8hbj6" Sep 15 12:37:20.310227 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.310207 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbdf8b9fd-8hbj6" event={"ID":"bc0c77dc-8344-4023-9bd7-f1de36d8724d","Type":"ContainerDied","Data":"1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b"} Sep 15 12:37:20.310421 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.310253 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbdf8b9fd-8hbj6" event={"ID":"bc0c77dc-8344-4023-9bd7-f1de36d8724d","Type":"ContainerDied","Data":"0f283485372d44d42f6cd370eebdb012c1b527d8c6ceaa72f5338bfa245bf05d"} Sep 15 12:37:20.310421 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.310272 2577 scope.go:117] "RemoveContainer" containerID="1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b" Sep 15 12:37:20.317975 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.317953 2577 scope.go:117] "RemoveContainer" containerID="1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b" Sep 15 12:37:20.318278 ip-10-0-140-90 kubenswrapper[2577]: E0915 12:37:20.318258 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b\": container with ID starting with 1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b not found: ID does not exist" containerID="1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b" Sep 15 12:37:20.318348 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.318286 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b"} err="failed to get container status \"1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b\": rpc error: code = NotFound desc = could not find container \"1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b\": container with ID starting with 1fa81c4798327d0264a31e29b5942d8039d58c991672b08fb603cf57a8e94e2b not found: ID does not exist" Sep 15 12:37:20.330656 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.330636 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-serving-cert\") pod \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " Sep 15 12:37:20.330723 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.330700 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-oauth-config\") pod \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " Sep 15 12:37:20.330723 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.330716 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-service-ca\") pod \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " Sep 15 12:37:20.330795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.330732 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-config\") pod \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " Sep 15 12:37:20.330795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.330752 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-trusted-ca-bundle\") pod \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " Sep 15 12:37:20.330795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.330767 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-oauth-serving-cert\") pod \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " Sep 15 12:37:20.330795 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.330787 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clqkf\" (UniqueName: \"kubernetes.io/projected/bc0c77dc-8344-4023-9bd7-f1de36d8724d-kube-api-access-clqkf\") pod \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\" (UID: \"bc0c77dc-8344-4023-9bd7-f1de36d8724d\") " Sep 15 12:37:20.331206 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.331154 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-config" (OuterVolumeSpecName: "console-config") pod "bc0c77dc-8344-4023-9bd7-f1de36d8724d" (UID: "bc0c77dc-8344-4023-9bd7-f1de36d8724d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:37:20.331330 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.331179 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-service-ca" (OuterVolumeSpecName: "service-ca") pod "bc0c77dc-8344-4023-9bd7-f1de36d8724d" (UID: "bc0c77dc-8344-4023-9bd7-f1de36d8724d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:37:20.331330 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.331198 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bc0c77dc-8344-4023-9bd7-f1de36d8724d" (UID: "bc0c77dc-8344-4023-9bd7-f1de36d8724d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:37:20.331330 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.331270 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bc0c77dc-8344-4023-9bd7-f1de36d8724d" (UID: "bc0c77dc-8344-4023-9bd7-f1de36d8724d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 12:37:20.332831 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.332810 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bc0c77dc-8344-4023-9bd7-f1de36d8724d" (UID: "bc0c77dc-8344-4023-9bd7-f1de36d8724d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:37:20.332959 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.332932 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bc0c77dc-8344-4023-9bd7-f1de36d8724d" (UID: "bc0c77dc-8344-4023-9bd7-f1de36d8724d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 12:37:20.333030 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.333001 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0c77dc-8344-4023-9bd7-f1de36d8724d-kube-api-access-clqkf" (OuterVolumeSpecName: "kube-api-access-clqkf") pod "bc0c77dc-8344-4023-9bd7-f1de36d8724d" (UID: "bc0c77dc-8344-4023-9bd7-f1de36d8724d"). InnerVolumeSpecName "kube-api-access-clqkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:37:20.431628 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.431601 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-oauth-config\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:37:20.431628 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.431626 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-service-ca\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:37:20.431767 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.431636 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-config\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:37:20.431767 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.431644 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-trusted-ca-bundle\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:37:20.431767 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.431652 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc0c77dc-8344-4023-9bd7-f1de36d8724d-oauth-serving-cert\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:37:20.431767 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.431660 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clqkf\" (UniqueName: \"kubernetes.io/projected/bc0c77dc-8344-4023-9bd7-f1de36d8724d-kube-api-access-clqkf\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:37:20.431767 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.431671 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc0c77dc-8344-4023-9bd7-f1de36d8724d-console-serving-cert\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:37:20.629263 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.629200 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cbdf8b9fd-8hbj6"] Sep 15 12:37:20.633902 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:20.633876 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cbdf8b9fd-8hbj6"] Sep 15 12:37:22.452575 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:22.452536 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc0c77dc-8344-4023-9bd7-f1de36d8724d" path="/var/lib/kubelet/pods/bc0c77dc-8344-4023-9bd7-f1de36d8724d/volumes" Sep 15 12:37:22.677476 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:22.677449 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:37:31.528370 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:31.528327 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:37:47.349959 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:47.349919 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:37:48.494102 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:48.494065 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:37:48.592076 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:48.592019 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:37:52.862540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:52.862508 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:37:52.879350 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:52.879324 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:37:53.449026 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:37:53.448995 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 12:38:14.965952 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:14.965918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:16.309896 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:16.309859 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:18.576550 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:18.576518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:18.637283 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:18.637249 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:20.048872 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:20.048834 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:20.151568 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:20.151536 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:22.300248 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:22.300217 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:22.869521 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:22.869486 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:23.173579 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:23.173470 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:23.274108 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:23.274069 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:29.035403 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:29.035358 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:29.187749 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:29.187707 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:29.288547 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:29.288432 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:30.870344 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:30.870310 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:42.609449 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:42.609415 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:42.707515 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:42.707483 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:50.841543 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:50.841501 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:38:50.939834 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:38:50.939804 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:02.375327 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:02.375302 2577 kubelet.go:1648] "Image garbage collection succeeded" Sep 15 12:39:04.692399 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:04.692356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:08.873928 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:08.873896 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:09.308102 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:09.308075 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:09.366471 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:09.366448 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:11.051081 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.051052 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq"] Sep 15 12:39:11.051535 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.051384 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0c77dc-8344-4023-9bd7-f1de36d8724d" containerName="console" Sep 15 12:39:11.051535 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.051401 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0c77dc-8344-4023-9bd7-f1de36d8724d" containerName="console" Sep 15 12:39:11.051535 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.051486 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc0c77dc-8344-4023-9bd7-f1de36d8724d" containerName="console" Sep 15 12:39:11.054483 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.054462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.058866 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.058833 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-7vpjp\"" Sep 15 12:39:11.060205 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.060187 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 15 12:39:11.060382 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.060351 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Sep 15 12:39:11.060511 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.060187 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 15 12:39:11.060511 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.060187 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Sep 15 12:39:11.060630 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.060286 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Sep 15 12:39:11.063884 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.063862 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq"] Sep 15 12:39:11.165589 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.165557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh2bg\" (UniqueName: \"kubernetes.io/projected/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-kube-api-access-xh2bg\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.165589 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.165590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-manager-config\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.165768 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.165633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-metrics-certs\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.165768 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.165698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-cert\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.266532 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.266504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-cert\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.266645 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.266548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh2bg\" (UniqueName: \"kubernetes.io/projected/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-kube-api-access-xh2bg\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.266645 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.266576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-manager-config\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.266762 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.266644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-metrics-certs\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.267373 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.267354 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-manager-config\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.269312 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.269290 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-cert\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.269419 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.269397 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-metrics-certs\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.277037 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.277008 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh2bg\" (UniqueName: \"kubernetes.io/projected/e8e79846-e721-4dd2-a6b8-94e8fcef0be9-kube-api-access-xh2bg\") pod \"jobset-controller-manager-56768944c6-6bzsq\" (UID: \"e8e79846-e721-4dd2-a6b8-94e8fcef0be9\") " pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.367649 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.367588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:11.639227 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.639202 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq"] Sep 15 12:39:11.641554 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:39:11.641529 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e79846_e721_4dd2_a6b8_94e8fcef0be9.slice/crio-06bbd51deb4a5fc98f23efe19a21844b787e443df3ff5561be13144c44dc3add WatchSource:0}: Error finding container 06bbd51deb4a5fc98f23efe19a21844b787e443df3ff5561be13144c44dc3add: Status 404 returned error can't find the container with id 06bbd51deb4a5fc98f23efe19a21844b787e443df3ff5561be13144c44dc3add Sep 15 12:39:11.643514 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.643497 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 12:39:11.688922 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:11.688901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" event={"ID":"e8e79846-e721-4dd2-a6b8-94e8fcef0be9","Type":"ContainerStarted","Data":"06bbd51deb4a5fc98f23efe19a21844b787e443df3ff5561be13144c44dc3add"} Sep 15 12:39:17.711002 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:17.710968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" event={"ID":"e8e79846-e721-4dd2-a6b8-94e8fcef0be9","Type":"ContainerStarted","Data":"287a7e6b3c9db09f424fd0069420f7bcf9d08a4b064b5c320fb68fdae557ddbc"} Sep 15 12:39:18.714711 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:18.714678 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:18.734696 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:18.734647 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" podStartSLOduration=1.724947025 podStartE2EDuration="7.734632835s" totalImagesPullingTime="6.00968581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:39:18.733184869 +0000 UTC m=+316.776432479" watchObservedRunningTime="2026-09-15 12:39:18.734632835 +0000 UTC m=+316.777880442" Sep 15 12:39:29.722740 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:29.722714 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-56768944c6-6bzsq" Sep 15 12:39:30.003081 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:30.003012 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:30.103816 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:30.103791 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:33.200999 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:33.200967 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:33.257360 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:33.257330 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:36.674866 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:36.674826 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:36.773494 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:36.773463 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:41.020333 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:41.020304 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:41.121734 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:41.121695 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:42.971397 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:42.971352 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:39:43.031592 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:39:43.031566 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:40:18.131533 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.131502 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84d76c94db-nl58f"] Sep 15 12:40:18.134705 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.134689 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.137462 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.137428 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 15 12:40:18.138810 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.138793 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 15 12:40:18.139010 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.138993 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 15 12:40:18.139113 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.139009 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 15 12:40:18.139113 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.139033 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 15 12:40:18.139227 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.139130 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 15 12:40:18.139306 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.139293 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 15 12:40:18.139498 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.139483 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nm4hj\"" Sep 15 12:40:18.143262 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.143242 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 15 12:40:18.148089 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.148072 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84d76c94db-nl58f"] Sep 15 12:40:18.180915 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.180893 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:40:18.225385 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.225358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-oauth-serving-cert\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.225487 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.225393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-service-ca\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.225487 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.225444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2792adcd-0664-41b0-9bbc-cb835887868c-console-oauth-config\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.225597 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.225495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-trusted-ca-bundle\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.225597 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.225518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5qj8\" (UniqueName: \"kubernetes.io/projected/2792adcd-0664-41b0-9bbc-cb835887868c-kube-api-access-t5qj8\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.225597 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.225548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2792adcd-0664-41b0-9bbc-cb835887868c-console-serving-cert\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.225597 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.225572 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-console-config\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.245128 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.245096 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:40:18.326750 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.326728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-console-config\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.326852 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.326761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-oauth-serving-cert\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.326852 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.326781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-service-ca\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.326852 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.326825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2792adcd-0664-41b0-9bbc-cb835887868c-console-oauth-config\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.326985 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.326867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-trusted-ca-bundle\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.326985 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.326888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5qj8\" (UniqueName: \"kubernetes.io/projected/2792adcd-0664-41b0-9bbc-cb835887868c-kube-api-access-t5qj8\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.326985 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.326913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2792adcd-0664-41b0-9bbc-cb835887868c-console-serving-cert\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.327557 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.327534 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-oauth-serving-cert\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.327557 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.327555 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-service-ca\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.327681 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.327541 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-console-config\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.327837 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.327821 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2792adcd-0664-41b0-9bbc-cb835887868c-trusted-ca-bundle\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.329402 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.329379 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2792adcd-0664-41b0-9bbc-cb835887868c-console-serving-cert\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.329476 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.329428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2792adcd-0664-41b0-9bbc-cb835887868c-console-oauth-config\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.338217 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.338195 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5qj8\" (UniqueName: \"kubernetes.io/projected/2792adcd-0664-41b0-9bbc-cb835887868c-kube-api-access-t5qj8\") pod \"console-84d76c94db-nl58f\" (UID: \"2792adcd-0664-41b0-9bbc-cb835887868c\") " pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.443552 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.443534 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:18.714635 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.714559 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84d76c94db-nl58f"] Sep 15 12:40:18.717109 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:40:18.717087 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2792adcd_0664_41b0_9bbc_cb835887868c.slice/crio-d1d92a663a1813e0b0ee9a0b06f6e5f7a6826150dd99e4ef00f1438b0a991de4 WatchSource:0}: Error finding container d1d92a663a1813e0b0ee9a0b06f6e5f7a6826150dd99e4ef00f1438b0a991de4: Status 404 returned error can't find the container with id d1d92a663a1813e0b0ee9a0b06f6e5f7a6826150dd99e4ef00f1438b0a991de4 Sep 15 12:40:18.907381 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.907346 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d76c94db-nl58f" event={"ID":"2792adcd-0664-41b0-9bbc-cb835887868c","Type":"ContainerStarted","Data":"49916dd14fcd5aa00c460f3b18e52ed4e73974a73841a7e23260b21d9317c691"} Sep 15 12:40:18.907513 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.907392 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d76c94db-nl58f" event={"ID":"2792adcd-0664-41b0-9bbc-cb835887868c","Type":"ContainerStarted","Data":"d1d92a663a1813e0b0ee9a0b06f6e5f7a6826150dd99e4ef00f1438b0a991de4"} Sep 15 12:40:18.928294 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:18.928239 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84d76c94db-nl58f" podStartSLOduration=0.928218384 podStartE2EDuration="928.218384ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:40:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:40:18.926178169 +0000 UTC m=+376.969425777" watchObservedRunningTime="2026-09-15 12:40:18.928218384 +0000 UTC m=+376.971465991" Sep 15 12:40:28.444655 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:28.444622 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:28.445131 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:28.444736 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:28.453348 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:28.453327 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:28.946639 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:28.946611 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84d76c94db-nl58f" Sep 15 12:40:29.120791 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:29.120761 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:40:29.220734 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:29.220670 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:40:29.278731 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:29.278708 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:40:48.921340 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:40:48.921299 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:41:03.173392 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:41:03.173355 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:41:07.411251 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:41:07.411219 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:41:07.511544 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:41:07.511517 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:41:07.637777 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:41:07.637744 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:41:41.623767 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:41:41.623693 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:41:58.178335 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:41:58.178298 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:41:58.238429 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:41:58.238399 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:43:16.013621 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:43:16.013582 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:43:51.040756 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:43:51.040725 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:44:06.085217 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.085176 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:44:06.617214 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.617155 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n"] Sep 15 12:44:06.620232 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.620211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" Sep 15 12:44:06.622555 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.622529 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-nj48r\"/\"openshift-service-ca.crt\"" Sep 15 12:44:06.622647 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.622624 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-nj48r\"/\"default-dockercfg-zqqkq\"" Sep 15 12:44:06.623905 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.623890 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-nj48r\"/\"kube-root-ca.crt\"" Sep 15 12:44:06.631507 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.631484 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n"] Sep 15 12:44:06.641418 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.641392 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:44:06.741512 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.741483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rncsr\" (UniqueName: \"kubernetes.io/projected/8c0af828-e32a-46c1-af4f-05624e8ea6e1-kube-api-access-rncsr\") pod \"progression-job-failure-node-0-0-rmr5n\" (UID: \"8c0af828-e32a-46c1-af4f-05624e8ea6e1\") " pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" Sep 15 12:44:06.842838 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.842806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rncsr\" (UniqueName: \"kubernetes.io/projected/8c0af828-e32a-46c1-af4f-05624e8ea6e1-kube-api-access-rncsr\") pod \"progression-job-failure-node-0-0-rmr5n\" (UID: \"8c0af828-e32a-46c1-af4f-05624e8ea6e1\") " pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" Sep 15 12:44:06.851540 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.851514 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rncsr\" (UniqueName: \"kubernetes.io/projected/8c0af828-e32a-46c1-af4f-05624e8ea6e1-kube-api-access-rncsr\") pod \"progression-job-failure-node-0-0-rmr5n\" (UID: \"8c0af828-e32a-46c1-af4f-05624e8ea6e1\") " pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" Sep 15 12:44:06.929418 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:06.929335 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" Sep 15 12:44:07.201864 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:07.201840 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n"] Sep 15 12:44:07.203770 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:44:07.203746 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0af828_e32a_46c1_af4f_05624e8ea6e1.slice/crio-a6274c32b071639ac3b1347f2633048f0e17ce7fc593552444c532dfacd477aa WatchSource:0}: Error finding container a6274c32b071639ac3b1347f2633048f0e17ce7fc593552444c532dfacd477aa: Status 404 returned error can't find the container with id a6274c32b071639ac3b1347f2633048f0e17ce7fc593552444c532dfacd477aa Sep 15 12:44:07.695075 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:44:07.695041 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" event={"ID":"8c0af828-e32a-46c1-af4f-05624e8ea6e1","Type":"ContainerStarted","Data":"a6274c32b071639ac3b1347f2633048f0e17ce7fc593552444c532dfacd477aa"} Sep 15 12:45:46.092705 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:46.092671 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" event={"ID":"8c0af828-e32a-46c1-af4f-05624e8ea6e1","Type":"ContainerStarted","Data":"847c67953575021ad0b918e3462eb0dfe494fd699b8b7294be02c29aed1decd8"} Sep 15 12:45:46.093094 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:46.092803 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" Sep 15 12:45:46.111642 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:46.111586 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" podStartSLOduration=2.072043978 podStartE2EDuration="1m40.111572117s" totalImagesPullingTime="1m38.039528139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:46.109896118 +0000 UTC m=+704.153143728" watchObservedRunningTime="2026-09-15 12:45:46.111572117 +0000 UTC m=+704.154819727" Sep 15 12:45:47.096196 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:47.096146 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" Sep 15 12:45:55.093900 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:55.093854 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" podUID="8c0af828-e32a-46c1-af4f-05624e8ea6e1" containerName="node" probeResult="failure" output="Get \"http://10.134.0.20:28080/metrics\": dial tcp 10.134.0.20:28080: connect: connection refused" Sep 15 12:45:55.129033 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:55.128998 2577 generic.go:356] "Generic (PLEG): container finished" podID="8c0af828-e32a-46c1-af4f-05624e8ea6e1" containerID="847c67953575021ad0b918e3462eb0dfe494fd699b8b7294be02c29aed1decd8" exitCode=1 Sep 15 12:45:55.129204 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:55.129070 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" event={"ID":"8c0af828-e32a-46c1-af4f-05624e8ea6e1","Type":"ContainerDied","Data":"847c67953575021ad0b918e3462eb0dfe494fd699b8b7294be02c29aed1decd8"} Sep 15 12:45:56.274240 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:56.274217 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" Sep 15 12:45:56.321572 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:56.321545 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rncsr\" (UniqueName: \"kubernetes.io/projected/8c0af828-e32a-46c1-af4f-05624e8ea6e1-kube-api-access-rncsr\") pod \"8c0af828-e32a-46c1-af4f-05624e8ea6e1\" (UID: \"8c0af828-e32a-46c1-af4f-05624e8ea6e1\") " Sep 15 12:45:56.323732 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:56.323711 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c0af828-e32a-46c1-af4f-05624e8ea6e1-kube-api-access-rncsr" (OuterVolumeSpecName: "kube-api-access-rncsr") pod "8c0af828-e32a-46c1-af4f-05624e8ea6e1" (UID: "8c0af828-e32a-46c1-af4f-05624e8ea6e1"). InnerVolumeSpecName "kube-api-access-rncsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 12:45:56.422953 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:56.422895 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rncsr\" (UniqueName: \"kubernetes.io/projected/8c0af828-e32a-46c1-af4f-05624e8ea6e1-kube-api-access-rncsr\") on node \"ip-10-0-140-90.ec2.internal\" DevicePath \"\"" Sep 15 12:45:57.138665 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:57.138633 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" Sep 15 12:45:57.138821 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:57.138633 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n" event={"ID":"8c0af828-e32a-46c1-af4f-05624e8ea6e1","Type":"ContainerDied","Data":"a6274c32b071639ac3b1347f2633048f0e17ce7fc593552444c532dfacd477aa"} Sep 15 12:45:57.138821 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:57.138759 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6274c32b071639ac3b1347f2633048f0e17ce7fc593552444c532dfacd477aa" Sep 15 12:45:58.612874 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:45:58.612833 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:46:08.688142 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:46:08.688106 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:46:09.804282 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:46:09.804246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:46:09.866994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:46:09.866965 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:46:13.714255 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:46:13.714219 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n"] Sep 15 12:46:13.721662 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:46:13.721630 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-nj48r/progression-job-failure-node-0-0-rmr5n"] Sep 15 12:46:13.960782 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:46:13.960751 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:46:14.022079 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:46:14.022015 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:46:14.453249 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:46:14.453219 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c0af828-e32a-46c1-af4f-05624e8ea6e1" path="/var/lib/kubelet/pods/8c0af828-e32a-46c1-af4f-05624e8ea6e1/volumes" Sep 15 12:46:14.950248 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:46:14.950218 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:46:15.010031 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:46:15.009997 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:47:02.022322 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.022286 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:47:02.133584 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.133552 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bpvzg/must-gather-dfrmd"] Sep 15 12:47:02.133813 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.133802 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0af828-e32a-46c1-af4f-05624e8ea6e1" containerName="node" Sep 15 12:47:02.133856 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.133815 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0af828-e32a-46c1-af4f-05624e8ea6e1" containerName="node" Sep 15 12:47:02.133889 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.133870 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c0af828-e32a-46c1-af4f-05624e8ea6e1" containerName="node" Sep 15 12:47:02.135608 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.135594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpvzg/must-gather-dfrmd" Sep 15 12:47:02.138078 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.138053 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bpvzg\"/\"default-dockercfg-9nwxx\"" Sep 15 12:47:02.138261 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.138217 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpvzg\"/\"kube-root-ca.crt\"" Sep 15 12:47:02.138261 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.138244 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpvzg\"/\"openshift-service-ca.crt\"" Sep 15 12:47:02.145678 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.145658 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpvzg/must-gather-dfrmd"] Sep 15 12:47:02.279733 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.279637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxr29\" (UniqueName: \"kubernetes.io/projected/1b722486-bc08-4e60-b6ad-54eda5efad36-kube-api-access-cxr29\") pod \"must-gather-dfrmd\" (UID: \"1b722486-bc08-4e60-b6ad-54eda5efad36\") " pod="openshift-must-gather-bpvzg/must-gather-dfrmd" Sep 15 12:47:02.279882 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.279733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b722486-bc08-4e60-b6ad-54eda5efad36-must-gather-output\") pod \"must-gather-dfrmd\" (UID: \"1b722486-bc08-4e60-b6ad-54eda5efad36\") " pod="openshift-must-gather-bpvzg/must-gather-dfrmd" Sep 15 12:47:02.380372 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.380334 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxr29\" (UniqueName: \"kubernetes.io/projected/1b722486-bc08-4e60-b6ad-54eda5efad36-kube-api-access-cxr29\") pod \"must-gather-dfrmd\" (UID: \"1b722486-bc08-4e60-b6ad-54eda5efad36\") " pod="openshift-must-gather-bpvzg/must-gather-dfrmd" Sep 15 12:47:02.380529 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.380406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b722486-bc08-4e60-b6ad-54eda5efad36-must-gather-output\") pod \"must-gather-dfrmd\" (UID: \"1b722486-bc08-4e60-b6ad-54eda5efad36\") " pod="openshift-must-gather-bpvzg/must-gather-dfrmd" Sep 15 12:47:02.380863 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.380842 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b722486-bc08-4e60-b6ad-54eda5efad36-must-gather-output\") pod \"must-gather-dfrmd\" (UID: \"1b722486-bc08-4e60-b6ad-54eda5efad36\") " pod="openshift-must-gather-bpvzg/must-gather-dfrmd" Sep 15 12:47:02.389429 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.389408 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpvzg\"/\"kube-root-ca.crt\"" Sep 15 12:47:02.399715 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.399697 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpvzg\"/\"openshift-service-ca.crt\"" Sep 15 12:47:02.410194 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.410150 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxr29\" (UniqueName: \"kubernetes.io/projected/1b722486-bc08-4e60-b6ad-54eda5efad36-kube-api-access-cxr29\") pod \"must-gather-dfrmd\" (UID: \"1b722486-bc08-4e60-b6ad-54eda5efad36\") " pod="openshift-must-gather-bpvzg/must-gather-dfrmd" Sep 15 12:47:02.453593 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.453566 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bpvzg\"/\"default-dockercfg-9nwxx\"" Sep 15 12:47:02.462005 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.461989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpvzg/must-gather-dfrmd" Sep 15 12:47:02.475963 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.475934 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:47:02.589101 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.589012 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:47:02.729573 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.729543 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpvzg/must-gather-dfrmd"] Sep 15 12:47:02.733084 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:47:02.733056 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b722486_bc08_4e60_b6ad_54eda5efad36.slice/crio-71b60718b7af5886ed1665d27af14f75310d6637f0449066fec3c8c08541c472 WatchSource:0}: Error finding container 71b60718b7af5886ed1665d27af14f75310d6637f0449066fec3c8c08541c472: Status 404 returned error can't find the container with id 71b60718b7af5886ed1665d27af14f75310d6637f0449066fec3c8c08541c472 Sep 15 12:47:02.735099 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:02.735082 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 12:47:03.394414 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:03.394384 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpvzg/must-gather-dfrmd" event={"ID":"1b722486-bc08-4e60-b6ad-54eda5efad36","Type":"ContainerStarted","Data":"71b60718b7af5886ed1665d27af14f75310d6637f0449066fec3c8c08541c472"} Sep 15 12:47:05.404744 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:05.404707 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpvzg/must-gather-dfrmd" event={"ID":"1b722486-bc08-4e60-b6ad-54eda5efad36","Type":"ContainerStarted","Data":"91340617044a5dc6833885be292de369d61dc08ec4cfbae59853f82ccd0e9d99"} Sep 15 12:47:05.405302 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:05.405278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpvzg/must-gather-dfrmd" event={"ID":"1b722486-bc08-4e60-b6ad-54eda5efad36","Type":"ContainerStarted","Data":"3f4a19fef5ecac74558b54f87836b1fed32ba568d69a7436a25c45a9c692aa61"} Sep 15 12:47:05.421803 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:05.421744 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bpvzg/must-gather-dfrmd" podStartSLOduration=1.538542477 podStartE2EDuration="3.421722044s" totalImagesPullingTime="1.883179567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:47:05.420221626 +0000 UTC m=+783.463469236" watchObservedRunningTime="2026-09-15 12:47:05.421722044 +0000 UTC m=+783.464969656" Sep 15 12:47:05.979222 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:05.979181 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-62k6l_1a879af0-932e-4723-8e63-4741e13aca35/global-pull-secret-syncer/0.log" Sep 15 12:47:06.114486 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:06.114450 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" Sep 15 12:47:06.236187 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:06.236089 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-90.ec2.internal_b2f52dba7b06215d463d19570335e32a/haproxy/0.log" Sep 15 12:47:07.654786 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:07.654732 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:47:07.711475 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:07.711442 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:47:09.917665 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:09.917581 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-lj9gz_a9822c43-f3e7-4191-bd30-71f46aa63294/kube-state-metrics/0.log" Sep 15 12:47:09.946778 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:09.946742 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-lj9gz_a9822c43-f3e7-4191-bd30-71f46aa63294/kube-rbac-proxy-main/0.log" Sep 15 12:47:09.983497 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:09.983460 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-lj9gz_a9822c43-f3e7-4191-bd30-71f46aa63294/kube-rbac-proxy-self/0.log" Sep 15 12:47:10.165748 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:10.165718 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dwbc6_ee1d019e-f862-474d-83ce-6539200b001f/node-exporter/0.log" Sep 15 12:47:10.189289 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:10.189267 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dwbc6_ee1d019e-f862-474d-83ce-6539200b001f/kube-rbac-proxy/0.log" Sep 15 12:47:10.213509 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:10.213483 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dwbc6_ee1d019e-f862-474d-83ce-6539200b001f/init-textfile/0.log" Sep 15 12:47:10.437491 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:10.437468 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15153b34-c80b-4d98-b189-a02707b450c2/prometheus/0.log" Sep 15 12:47:10.458658 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:10.458587 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15153b34-c80b-4d98-b189-a02707b450c2/config-reloader/0.log" Sep 15 12:47:10.481844 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:10.481815 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15153b34-c80b-4d98-b189-a02707b450c2/thanos-sidecar/0.log" Sep 15 12:47:10.505692 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:10.505656 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15153b34-c80b-4d98-b189-a02707b450c2/kube-rbac-proxy-web/0.log" Sep 15 12:47:10.531813 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:10.531782 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15153b34-c80b-4d98-b189-a02707b450c2/kube-rbac-proxy/0.log" Sep 15 12:47:10.554739 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:10.554702 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15153b34-c80b-4d98-b189-a02707b450c2/kube-rbac-proxy-thanos/0.log" Sep 15 12:47:10.579691 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:10.579663 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15153b34-c80b-4d98-b189-a02707b450c2/init-config-reloader/0.log" Sep 15 12:47:13.087409 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.087372 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84d76c94db-nl58f_2792adcd-0664-41b0-9bbc-cb835887868c/console/0.log" Sep 15 12:47:13.644735 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.644698 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk"] Sep 15 12:47:13.648542 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.648513 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.659718 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.659686 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk"] Sep 15 12:47:13.784131 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.784097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-proc\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.784302 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.784137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-podres\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.784302 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.784231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wvmj\" (UniqueName: \"kubernetes.io/projected/831c1179-0d37-4823-8499-092f49216495-kube-api-access-7wvmj\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.784376 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.784333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-sys\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.784413 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.784372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-lib-modules\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.885806 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.885758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-proc\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.885994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.885815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-podres\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.885994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.885861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wvmj\" (UniqueName: \"kubernetes.io/projected/831c1179-0d37-4823-8499-092f49216495-kube-api-access-7wvmj\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.885994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.885922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-sys\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.885994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.885941 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-proc\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.885994 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.885952 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-lib-modules\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.886289 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.886029 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-podres\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.886289 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.886066 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-sys\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.886289 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.886138 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/831c1179-0d37-4823-8499-092f49216495-lib-modules\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.896218 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.896119 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wvmj\" (UniqueName: \"kubernetes.io/projected/831c1179-0d37-4823-8499-092f49216495-kube-api-access-7wvmj\") pod \"perf-node-gather-daemonset-xqbnk\" (UID: \"831c1179-0d37-4823-8499-092f49216495\") " pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:13.960073 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:13.960020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:14.250501 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:14.250473 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk"] Sep 15 12:47:14.254004 ip-10-0-140-90 kubenswrapper[2577]: W0915 12:47:14.253961 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod831c1179_0d37_4823_8499_092f49216495.slice/crio-430134b8237f6cdc17da632410d475171c78bf0a990c9fd8cf7946b3a5a8f935 WatchSource:0}: Error finding container 430134b8237f6cdc17da632410d475171c78bf0a990c9fd8cf7946b3a5a8f935: Status 404 returned error can't find the container with id 430134b8237f6cdc17da632410d475171c78bf0a990c9fd8cf7946b3a5a8f935 Sep 15 12:47:14.313889 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:14.313827 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hf76k_4782aaed-5fcf-4ec2-bd25-e0c7bcea509c/konnectivity-agent/0.log" limit=1024 Sep 15 12:47:14.453459 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:14.453429 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:14.453615 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:14.453473 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" event={"ID":"831c1179-0d37-4823-8499-092f49216495","Type":"ContainerStarted","Data":"addbc1da3665609cbc3467a701b91dbfee3410cae9aa2a3a3625f73b7ff65b42"} Sep 15 12:47:14.453615 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:14.453492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" event={"ID":"831c1179-0d37-4823-8499-092f49216495","Type":"ContainerStarted","Data":"430134b8237f6cdc17da632410d475171c78bf0a990c9fd8cf7946b3a5a8f935"} Sep 15 12:47:14.474777 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:14.474721 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" podStartSLOduration=1.474705128 podStartE2EDuration="1.474705128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:47:14.473311386 +0000 UTC m=+792.516559028" watchObservedRunningTime="2026-09-15 12:47:14.474705128 +0000 UTC m=+792.517952737" Sep 15 12:47:14.710743 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:14.710719 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-plcqs_9642da35-2137-4967-9686-8a7600afa9a8/dns/0.log" Sep 15 12:47:14.731712 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:14.731685 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-plcqs_9642da35-2137-4967-9686-8a7600afa9a8/kube-rbac-proxy/0.log" Sep 15 12:47:14.872845 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:14.872812 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2x4p_10d627cd-9fbd-4577-bbe7-6673f64d1128/dns-node-resolver/0.log" Sep 15 12:47:15.266928 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:15.266888 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-799f5fdcfb-t2nx9_77472cbf-34ca-426f-818c-f39a3554c182/registry/0.log" Sep 15 12:47:15.319541 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:15.319503 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-phcb7_79346abd-b9d2-43ae-826c-15595d93fb31/node-ca/0.log" Sep 15 12:47:16.423748 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:16.423707 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9fbpr_929b6173-f547-4414-983a-480eadbcb7d3/serve-healthcheck-canary/0.log" Sep 15 12:47:16.870915 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:16.870887 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gwp8t_d3fb5e08-d821-42e2-aaac-86eff39f0c37/kube-rbac-proxy/0.log" Sep 15 12:47:16.892210 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:16.892179 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gwp8t_d3fb5e08-d821-42e2-aaac-86eff39f0c37/exporter/0.log" Sep 15 12:47:16.912701 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:16.912659 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gwp8t_d3fb5e08-d821-42e2-aaac-86eff39f0c37/extractor/0.log" Sep 15 12:47:18.593949 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:18.593921 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-56768944c6-6bzsq_e8e79846-e721-4dd2-a6b8-94e8fcef0be9/manager/0.log" Sep 15 12:47:20.466916 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:20.466893 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bpvzg/perf-node-gather-daemonset-xqbnk" Sep 15 12:47:21.810253 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:21.810197 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-5zp9b_082d00b8-fe7e-4da8-b11b-3657c951115f/migrator/0.log" Sep 15 12:47:21.836138 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:21.836100 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-5zp9b_082d00b8-fe7e-4da8-b11b-3657c951115f/graceful-termination/0.log" Sep 15 12:47:23.612006 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:23.611980 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtvb6_a523ad61-1003-4072-a5fc-34ce5c564562/kube-multus-additional-cni-plugins/0.log" Sep 15 12:47:23.632549 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:23.632505 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtvb6_a523ad61-1003-4072-a5fc-34ce5c564562/egress-router-binary-copy/0.log" Sep 15 12:47:23.653137 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:23.653118 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtvb6_a523ad61-1003-4072-a5fc-34ce5c564562/cni-plugins/0.log" Sep 15 12:47:23.674565 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:23.674547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtvb6_a523ad61-1003-4072-a5fc-34ce5c564562/bond-cni-plugin/0.log" Sep 15 12:47:23.694901 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:23.694881 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtvb6_a523ad61-1003-4072-a5fc-34ce5c564562/routeoverride-cni/0.log" Sep 15 12:47:23.714506 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:23.714486 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtvb6_a523ad61-1003-4072-a5fc-34ce5c564562/whereabouts-cni-bincopy/0.log" Sep 15 12:47:23.735148 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:23.735128 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtvb6_a523ad61-1003-4072-a5fc-34ce5c564562/whereabouts-cni/0.log" Sep 15 12:47:23.792073 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:23.792049 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v27dm_2fbb7e09-a658-4fbb-a203-fd9ef176a246/kube-multus/0.log" Sep 15 12:47:23.898195 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:23.898111 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wj7jq_1f7d1a45-ddaa-468f-b8ca-427b0c66fb04/network-metrics-daemon/0.log" Sep 15 12:47:23.919180 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:23.919122 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wj7jq_1f7d1a45-ddaa-468f-b8ca-427b0c66fb04/kube-rbac-proxy/0.log" Sep 15 12:47:24.725728 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:24.725701 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6zghl_62de769f-9b0d-40f1-81bf-985f1d81da81/ovn-controller/0.log" Sep 15 12:47:24.746143 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:24.746118 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6zghl_62de769f-9b0d-40f1-81bf-985f1d81da81/ovn-acl-logging/0.log" Sep 15 12:47:24.769880 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:24.769860 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6zghl_62de769f-9b0d-40f1-81bf-985f1d81da81/kube-rbac-proxy-node/0.log" Sep 15 12:47:24.793811 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:24.793792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6zghl_62de769f-9b0d-40f1-81bf-985f1d81da81/kube-rbac-proxy-ovn-metrics/0.log" Sep 15 12:47:24.812756 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:24.812722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6zghl_62de769f-9b0d-40f1-81bf-985f1d81da81/northd/0.log" Sep 15 12:47:24.832916 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:24.832897 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6zghl_62de769f-9b0d-40f1-81bf-985f1d81da81/nbdb/0.log" Sep 15 12:47:24.852446 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:24.852423 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6zghl_62de769f-9b0d-40f1-81bf-985f1d81da81/sbdb/0.log" Sep 15 12:47:24.888068 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:24.888045 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6zghl_62de769f-9b0d-40f1-81bf-985f1d81da81/ovnkube-controller/0.log" Sep 15 12:47:26.262362 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:26.262332 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cptf6_c531254c-20b6-4fd1-a34c-bf6ae5c17288/network-check-target-container/0.log" Sep 15 12:47:27.204294 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:27.204265 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-zr8w8_523809b4-42bc-4780-9955-952204e85b4d/iptables-alerter/0.log" Sep 15 12:47:27.818091 ip-10-0-140-90 kubenswrapper[2577]: I0915 12:47:27.818034 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-tcx97_11bbfa0d-be73-43f9-892e-54c24632af38/tuned/0.log"