Sep 19 02:40:26.510331 ip-10-0-137-27 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 19 02:40:26.510435 ip-10-0-137-27 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 19 02:40:26.510450 ip-10-0-137-27 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 19 02:40:26.510717 ip-10-0-137-27 systemd[1]: Failed to start Kubernetes Kubelet. Sep 19 02:40:36.759621 ip-10-0-137-27 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 19 02:40:36.759635 ip-10-0-137-27 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 23f7eef9672e4f539075032ab167d40c -- Sep 19 02:42:23.358032 ip-10-0-137-27 systemd[1]: Starting Kubernetes Kubelet... Sep 19 02:42:23.682321 ip-10-0-137-27 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 02:42:23.682321 ip-10-0-137-27 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 19 02:42:23.682321 ip-10-0-137-27 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 02:42:23.682321 ip-10-0-137-27 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 19 02:42:23.682321 ip-10-0-137-27 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 02:42:23.685063 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.684990 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 19 02:42:23.690905 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690878 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 02:42:23.690905 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690897 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 02:42:23.690905 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690902 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 02:42:23.690905 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690906 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 02:42:23.690905 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690911 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690915 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690919 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690923 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690926 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690930 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690934 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690937 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690941 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690945 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690948 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690952 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690956 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690960 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690964 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690969 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690976 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690981 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690985 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 02:42:23.691171 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690990 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690994 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.690997 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691001 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691005 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691008 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691012 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691016 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691020 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691028 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691033 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691037 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691041 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691044 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691049 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691054 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691058 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691062 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691066 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691070 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 02:42:23.691993 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691074 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691078 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691086 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691093 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691097 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691101 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691105 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691109 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691113 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691117 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691121 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691126 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691130 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691134 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691138 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691143 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691147 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691151 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691155 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691159 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 02:42:23.692854 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691163 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691167 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691170 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691174 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691178 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691182 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691186 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691192 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691196 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691200 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691204 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691209 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691213 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691219 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691223 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691227 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691231 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691235 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691239 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691243 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 02:42:23.693666 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691262 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691267 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691271 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691275 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691279 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691283 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691288 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691292 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691296 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691300 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691304 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691308 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691312 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691317 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691323 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.691328 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692562 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692572 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692578 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692583 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 02:42:23.694527 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692588 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692592 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692597 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692601 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692621 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692627 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692631 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692636 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692641 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692645 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692649 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692653 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692657 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692669 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692673 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692677 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692681 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692685 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692690 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 02:42:23.695372 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692694 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692698 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692702 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692706 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692710 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692714 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692717 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692721 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692725 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692730 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692734 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692738 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692743 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692748 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692754 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692776 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692781 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692785 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692790 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692794 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 02:42:23.696041 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692799 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692803 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692807 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692811 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692815 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692818 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692822 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692834 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692838 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692842 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692846 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692850 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692854 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692859 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692863 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692867 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692871 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692875 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692879 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692883 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 02:42:23.696621 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692886 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692890 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692894 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692898 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692903 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692908 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692912 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692916 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692920 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692924 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692928 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692932 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692936 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692940 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692944 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692948 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692952 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692956 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692964 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692970 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 02:42:23.697139 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692984 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692989 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692993 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.692997 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693002 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693006 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693010 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693014 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693018 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693022 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693026 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693030 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693034 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693038 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693042 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693046 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693648 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693656 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693661 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693666 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 02:42:23.697710 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693670 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693674 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693677 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693681 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693685 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693689 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693693 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693699 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693704 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693708 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693712 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693716 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693720 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693725 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693729 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693733 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693737 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693741 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693745 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693749 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 02:42:23.698335 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693753 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693757 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693776 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693781 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693785 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693789 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693793 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693798 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693803 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693807 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693811 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693815 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693819 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693823 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693827 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693831 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693835 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693840 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693844 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693849 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 02:42:23.698830 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693853 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693857 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693864 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693870 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693874 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693880 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693885 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693889 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693894 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693898 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693902 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693906 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693910 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693916 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693920 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693924 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693928 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693932 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693936 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 02:42:23.699451 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693941 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693945 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693949 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693953 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693960 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693965 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693972 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693978 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693984 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693989 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693993 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.693997 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694001 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694005 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694009 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694013 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694018 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694022 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694025 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 02:42:23.699959 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694030 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694034 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694039 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694042 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694046 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694050 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694054 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694061 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694066 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694070 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694074 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694077 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694081 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694086 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694089 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694093 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.694097 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694195 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694241 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694250 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694257 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 19 02:42:23.700428 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694263 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694268 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694274 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694280 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694285 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694291 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694296 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694302 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694306 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694311 2579 flags.go:64] FLAG: --cgroup-root="" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694316 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694320 2579 flags.go:64] FLAG: --client-ca-file="" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694326 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694330 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694341 2579 flags.go:64] FLAG: --cluster-domain="" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694346 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694351 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694356 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694363 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694369 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694373 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694378 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694383 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694391 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 19 02:42:23.701059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694396 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694400 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694405 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694410 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694416 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694421 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694426 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694430 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694435 2579 flags.go:64] FLAG: --enable-server="true" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694439 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694445 2579 flags.go:64] FLAG: --event-burst="100" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694450 2579 flags.go:64] FLAG: --event-qps="50" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694454 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694459 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694464 2579 flags.go:64] FLAG: --eviction-hard="" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694469 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694474 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694479 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694484 2579 flags.go:64] FLAG: --eviction-soft="" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694488 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694492 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694498 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694503 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694507 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694511 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 19 02:42:23.701617 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694516 2579 flags.go:64] FLAG: --feature-gates="" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694523 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694528 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694532 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694536 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694541 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694547 2579 flags.go:64] FLAG: --help="false" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694551 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-137-27.ec2.internal" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694556 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694561 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694566 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694571 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694577 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694581 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694586 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694590 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694594 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694599 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694604 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694609 2579 flags.go:64] FLAG: --kube-reserved="" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694613 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694618 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694622 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694627 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 19 02:42:23.702292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694631 2579 flags.go:64] FLAG: --lock-file="" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694635 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694640 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694645 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694653 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694658 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694663 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694667 2579 flags.go:64] FLAG: --logging-format="text" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694672 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694679 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694683 2579 flags.go:64] FLAG: --manifest-url="" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694688 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694694 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694699 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694717 2579 flags.go:64] FLAG: --max-pods="110" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694722 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694727 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694731 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694736 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694741 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694745 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694749 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694775 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694781 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694785 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 19 02:42:23.702891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694790 2579 flags.go:64] FLAG: --pod-cidr="" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694794 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694801 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694806 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694810 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694814 2579 flags.go:64] FLAG: --port="10250" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694819 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694824 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-082e9abd8df486349" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694829 2579 flags.go:64] FLAG: --qos-reserved="" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694834 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694839 2579 flags.go:64] FLAG: --register-node="true" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694843 2579 flags.go:64] FLAG: --register-with-taints="" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694849 2579 flags.go:64] FLAG: --registry-burst="10" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694854 2579 flags.go:64] FLAG: --registry-qps="5" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694859 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694864 2579 flags.go:64] FLAG: --reserved-memory="" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694869 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694877 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694882 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694886 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694891 2579 flags.go:64] FLAG: --runonce="false" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694898 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694903 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694907 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694912 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 19 02:42:23.703510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694916 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694921 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694926 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694930 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694935 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694940 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694945 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694949 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694954 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694958 2579 flags.go:64] FLAG: --system-cgroups="" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694963 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694971 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694975 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694980 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694987 2579 flags.go:64] FLAG: --tls-min-version="" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694992 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.694996 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.695001 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.695005 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.695010 2579 flags.go:64] FLAG: --v="2" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.695016 2579 flags.go:64] FLAG: --version="false" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.695023 2579 flags.go:64] FLAG: --vmodule="" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.695029 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.695034 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695215 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 02:42:23.704138 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695221 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695226 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695230 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695236 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695240 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695244 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695248 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695252 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695257 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695262 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695266 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695270 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695274 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695279 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695283 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695286 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695290 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695294 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695298 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695302 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 02:42:23.704802 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695306 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695310 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695314 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695318 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695322 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695327 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695331 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695335 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695339 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695343 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695350 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695368 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695375 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695381 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695385 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695391 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695415 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695419 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 02:42:23.705280 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695424 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695431 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695437 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695442 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695446 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695452 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695457 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695461 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695465 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695470 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695474 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695479 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695483 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695487 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695491 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695495 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695500 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695504 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695510 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695514 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 02:42:23.705707 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695519 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695523 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695527 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695531 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695536 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695542 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695546 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695551 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695555 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695561 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695565 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695569 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695573 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695577 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695582 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695586 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695590 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695594 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695599 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695603 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 02:42:23.706214 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695607 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695611 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695615 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695619 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695623 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695628 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695632 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695636 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695640 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695644 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695648 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695653 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695657 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695661 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695665 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695670 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695674 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695680 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695685 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 02:42:23.706689 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.695689 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.696245 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.703195 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.703209 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.703229 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.703234 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703288 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703292 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703295 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703299 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703302 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703305 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703308 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703311 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703313 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 02:42:23.707162 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703316 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703318 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703321 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703323 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703326 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703329 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703331 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703333 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703336 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703338 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703341 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703344 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703346 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703349 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703351 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703354 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703363 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703367 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703370 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703373 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 02:42:23.707568 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703377 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703380 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703383 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703385 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703388 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703390 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703412 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703415 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703432 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703436 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703439 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703442 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703445 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703448 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703451 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703454 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703457 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703460 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703462 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703465 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 02:42:23.708120 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703467 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703470 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703473 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703477 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703481 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703484 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703487 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703489 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703492 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703495 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703499 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703503 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703507 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703512 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703514 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703517 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703521 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703523 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703526 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 02:42:23.708607 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703529 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703532 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703534 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703537 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703540 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703542 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703545 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703547 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703550 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703552 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703555 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703558 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703561 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703563 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703566 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703568 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703571 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703573 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703576 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 02:42:23.709090 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703579 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703581 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703584 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703586 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703589 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703592 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703595 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703597 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703600 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703603 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703605 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703608 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.703613 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703723 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703728 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 02:42:23.709539 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703732 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703735 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703738 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703741 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703744 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703747 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703749 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703752 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703754 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703757 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703776 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703779 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703782 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703785 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703788 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703790 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703793 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703795 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703798 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703801 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 02:42:23.709908 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703803 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703806 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703809 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703811 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703814 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703818 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703824 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703827 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703829 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703832 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703834 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703837 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703839 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703842 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703845 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703847 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703850 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703852 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703855 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 02:42:23.710373 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703857 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703860 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703862 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703865 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703868 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703870 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703873 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703876 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703878 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703881 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703883 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703886 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703888 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703891 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703893 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703896 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703900 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703903 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703906 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 02:42:23.710828 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703910 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703913 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703916 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703920 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703923 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703926 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703929 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703932 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703935 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703937 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703940 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703943 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703945 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703948 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703950 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703953 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703956 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703958 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703961 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 02:42:23.711270 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703964 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703966 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703969 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703971 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703974 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703977 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703979 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703982 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703984 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703987 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703991 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703994 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703996 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.703999 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.704001 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.704004 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.704007 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.704009 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.704012 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 02:42:23.711808 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:23.704014 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 02:42:23.712314 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.704019 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 02:42:23.712314 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.704128 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 19 02:42:23.712314 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.706134 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 19 02:42:23.712314 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.706891 2579 server.go:1019] "Starting client certificate rotation" Sep 19 02:42:23.712314 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.706982 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 02:42:23.712314 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.707103 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 02:42:23.712314 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.709028 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 02:42:23.712985 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.712964 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 02:42:23.724378 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.724359 2579 log.go:25] "Validated CRI v1 runtime API" Sep 19 02:42:23.726009 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.725995 2579 log.go:25] "Validated CRI v1 image API" Sep 19 02:42:23.726865 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.726847 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 19 02:42:23.729402 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.729384 2579 fs.go:135] Filesystem UUIDs: map[046c0d2f-b3a1-45c5-9ac0-d1cd4abe8274:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fcfd79f6-60d8-4d64-b1fa-8776121c611c:/dev/nvme0n1p3] Sep 19 02:42:23.729467 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.729402 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 19 02:42:23.733466 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.733355 2579 manager.go:216] Machine: {Timestamp:2026-09-19 02:42:23.732903477 +0000 UTC m=+0.279386266 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200192 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d3f56819413ac916b54fd8215cc7e SystemUUID:ec2d3f56-8194-13ac-916b-54fd8215cc7e BootID:23f7eef9-672e-4f53-9075-032ab167d40c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c7:fd:85:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c7:fd:85:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:40:8a:23:e4:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 19 02:42:23.733466 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.733458 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 19 02:42:23.733592 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.733558 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 19 02:42:23.736314 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.736284 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 19 02:42:23.736475 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.736317 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 19 02:42:23.737009 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.736997 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 19 02:42:23.737060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.737015 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 19 02:42:23.737060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.737026 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 02:42:23.737722 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.737711 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 02:42:23.737815 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.737805 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 19 02:42:23.740061 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.740043 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 02:42:23.742073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.742059 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 19 02:42:23.742200 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.742190 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 19 02:42:23.742265 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.742227 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 19 02:42:23.742265 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.742247 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 19 02:42:23.742265 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.742262 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 19 02:42:23.742377 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.742276 2579 kubelet.go:398] "Adding apiserver pod source" Sep 19 02:42:23.742377 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.742290 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 19 02:42:23.742647 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.742629 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 02:42:23.742707 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.742656 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 02:42:23.744732 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.744713 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 19 02:42:23.747169 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.747156 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 19 02:42:23.747228 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.747185 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 19 02:42:23.748697 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748686 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 19 02:42:23.748735 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748702 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 19 02:42:23.748735 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748708 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 19 02:42:23.748735 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748714 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 19 02:42:23.748735 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748722 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 19 02:42:23.748735 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748728 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 19 02:42:23.748880 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748740 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 19 02:42:23.748880 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748746 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 19 02:42:23.748880 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748752 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 19 02:42:23.748880 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748758 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 19 02:42:23.748880 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748789 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 19 02:42:23.748880 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.748795 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 19 02:42:23.749422 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.749413 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 19 02:42:23.749422 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.749421 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 19 02:42:23.752484 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.752454 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 19 02:42:23.753131 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.753107 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 19 02:42:23.753174 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.753116 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 19 02:42:23.753558 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.753545 2579 server.go:1268] "Started kubelet" Sep 19 02:42:23.753653 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.753627 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 19 02:42:23.753712 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.753638 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 19 02:42:23.753772 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.753713 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 19 02:42:23.754349 ip-10-0-137-27 systemd[1]: Started Kubernetes Kubelet. Sep 19 02:42:23.755447 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.755427 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 19 02:42:23.755544 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.755464 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 19 02:42:23.757896 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.757876 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5sjdr" Sep 19 02:42:23.758452 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.758436 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 19 02:42:23.759653 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.758784 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-27.ec2.internal.18d698a6b87c7dff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-27.ec2.internal,UID:ip-10-0-137-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-27.ec2.internal,},FirstTimestamp:2026-09-19 02:42:23.753510399 +0000 UTC m=+0.299993187,LastTimestamp:2026-09-19 02:42:23.753510399 +0000 UTC m=+0.299993187,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-27.ec2.internal,}" Sep 19 02:42:23.761805 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.761785 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 19 02:42:23.762250 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.762235 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 19 02:42:23.762406 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.762384 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:23.762824 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.762806 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 19 02:42:23.762824 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.762822 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 19 02:42:23.762974 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.762806 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 19 02:42:23.763036 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.762991 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 19 02:42:23.763036 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.762997 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 19 02:42:23.763152 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.763139 2579 factory.go:55] Registering systemd factory Sep 19 02:42:23.763182 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.763158 2579 factory.go:223] Registration of the systemd container factory successfully Sep 19 02:42:23.763220 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.763202 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5sjdr" Sep 19 02:42:23.763353 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.763342 2579 factory.go:153] Registering CRI-O factory Sep 19 02:42:23.763353 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.763352 2579 factory.go:223] Registration of the crio container factory successfully Sep 19 02:42:23.763444 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.763418 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 19 02:42:23.763444 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.763433 2579 factory.go:103] Registering Raw factory Sep 19 02:42:23.763444 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.763443 2579 manager.go:1196] Started watching for new ooms in manager Sep 19 02:42:23.764207 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.764194 2579 manager.go:349] Starting recovery of all containers Sep 19 02:42:23.767795 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.767753 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 19 02:42:23.767884 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.767817 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 19 02:42:23.775101 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.775078 2579 manager.go:354] Recovery completed Sep 19 02:42:23.779216 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.779201 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 02:42:23.781702 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.781688 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientMemory" Sep 19 02:42:23.781783 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.781714 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 02:42:23.781783 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.781724 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientPID" Sep 19 02:42:23.782348 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.782335 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 19 02:42:23.782348 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.782347 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 19 02:42:23.782486 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.782349 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 02:42:23.782486 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.782364 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 19 02:42:23.782983 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.782963 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientMemory" Sep 19 02:42:23.783024 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.782991 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 02:42:23.783024 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.783004 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientPID" Sep 19 02:42:23.784454 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.784441 2579 policy_none.go:49] "None policy: Start" Sep 19 02:42:23.784507 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.784459 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 19 02:42:23.784507 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.784473 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 19 02:42:23.863028 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.862997 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:23.927025 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.926456 2579 policy_none.go:47] "Start" Sep 19 02:42:23.932017 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.931992 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 19 02:42:23.933155 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.933108 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 19 02:42:23.933225 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.933164 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 19 02:42:23.933225 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.933196 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 19 02:42:23.933316 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.933279 2579 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 19 02:42:23.935253 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.935234 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 02:42:23.960450 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.960275 2579 manager.go:337] "Starting Device Plugin manager" Sep 19 02:42:23.960533 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.960473 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 19 02:42:23.960533 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.960488 2579 server.go:87] "Starting device plugin registration server" Sep 19 02:42:23.960711 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.960700 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 19 02:42:23.960779 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.960712 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 19 02:42:23.960847 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.960832 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 19 02:42:23.960937 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.960900 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 19 02:42:23.960937 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:23.960909 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 19 02:42:23.961406 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.961387 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 19 02:42:23.961488 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.961445 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:23.972293 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:23.972275 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-27.ec2.internal\" not found" node="ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.034099 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.033464 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal"] Sep 19 02:42:24.034158 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.034140 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 02:42:24.035027 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.035013 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientMemory" Sep 19 02:42:24.035091 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.035041 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 02:42:24.035091 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.035056 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientPID" Sep 19 02:42:24.037397 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.037383 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 02:42:24.037524 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.037511 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.037567 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.037538 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 02:42:24.038015 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.037996 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientMemory" Sep 19 02:42:24.038091 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.038022 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 02:42:24.038091 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.038037 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientPID" Sep 19 02:42:24.038091 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.038068 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientMemory" Sep 19 02:42:24.038091 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.038084 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 02:42:24.038216 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.038099 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientPID" Sep 19 02:42:24.040391 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.040373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.040466 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.040395 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 02:42:24.040995 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.040978 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientMemory" Sep 19 02:42:24.041076 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.041007 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 02:42:24.041076 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.041021 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientPID" Sep 19 02:42:24.054259 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.054239 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-27.ec2.internal\" not found" node="ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.058327 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.058312 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-27.ec2.internal\" not found" node="ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.061171 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.061144 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 02:42:24.061790 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.061774 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientMemory" Sep 19 02:42:24.061878 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.061802 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 02:42:24.061878 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.061815 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeHasSufficientPID" Sep 19 02:42:24.061878 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.061839 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.064403 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.064387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed2314bd2deae1665a958c5450f2e01e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal\" (UID: \"ed2314bd2deae1665a958c5450f2e01e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.064455 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.064420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed2314bd2deae1665a958c5450f2e01e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal\" (UID: \"ed2314bd2deae1665a958c5450f2e01e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.064455 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.064450 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a273ac8b2cca19fe2190dc3d23e4202f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-27.ec2.internal\" (UID: \"a273ac8b2cca19fe2190dc3d23e4202f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.069426 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.069414 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.069475 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.069431 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-27.ec2.internal\": node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.085591 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.085570 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.164678 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.164658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed2314bd2deae1665a958c5450f2e01e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal\" (UID: \"ed2314bd2deae1665a958c5450f2e01e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.164744 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.164708 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed2314bd2deae1665a958c5450f2e01e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal\" (UID: \"ed2314bd2deae1665a958c5450f2e01e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.164806 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.164745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a273ac8b2cca19fe2190dc3d23e4202f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-27.ec2.internal\" (UID: \"a273ac8b2cca19fe2190dc3d23e4202f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.164806 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.164780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed2314bd2deae1665a958c5450f2e01e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal\" (UID: \"ed2314bd2deae1665a958c5450f2e01e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.164876 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.164815 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed2314bd2deae1665a958c5450f2e01e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal\" (UID: \"ed2314bd2deae1665a958c5450f2e01e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.164876 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.164828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a273ac8b2cca19fe2190dc3d23e4202f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-27.ec2.internal\" (UID: \"a273ac8b2cca19fe2190dc3d23e4202f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.186665 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.186613 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.287314 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.287282 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.358489 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.358457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.362404 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.362386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal" Sep 19 02:42:24.387626 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.387599 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.488259 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.488159 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.588654 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.588624 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.689192 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.689167 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.707333 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.707312 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 19 02:42:24.707485 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.707468 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 19 02:42:24.768955 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.768879 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 02:37:23 +0000 UTC" deadline="2028-04-04 17:44:49.876327449 +0000 UTC" Sep 19 02:42:24.768955 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:24.768911 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13527h2m25.10741959s" Sep 19 02:42:24.789724 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.789704 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.890233 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.890204 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.991428 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:24.991398 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-27.ec2.internal\" not found" Sep 19 02:42:24.994838 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:24.994811 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda273ac8b2cca19fe2190dc3d23e4202f.slice/crio-cf4a733066baef606ac916e4cf9de9b179918e40b79e043c4e17134887dcede2 WatchSource:0}: Error finding container cf4a733066baef606ac916e4cf9de9b179918e40b79e043c4e17134887dcede2: Status 404 returned error can't find the container with id cf4a733066baef606ac916e4cf9de9b179918e40b79e043c4e17134887dcede2 Sep 19 02:42:24.995256 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:24.995235 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2314bd2deae1665a958c5450f2e01e.slice/crio-969a32338279390403b7e09feb5dfaa0f9aef534ba32ef96943cc9c03858d983 WatchSource:0}: Error finding container 969a32338279390403b7e09feb5dfaa0f9aef534ba32ef96943cc9c03858d983: Status 404 returned error can't find the container with id 969a32338279390403b7e09feb5dfaa0f9aef534ba32ef96943cc9c03858d983 Sep 19 02:42:25.002169 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.002153 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 02:42:25.034092 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.034043 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 02:42:25.062994 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.062973 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" Sep 19 02:42:25.076130 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.076108 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 02:42:25.079353 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.079309 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal" Sep 19 02:42:25.080720 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.080703 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 02:42:25.088494 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.088477 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 02:42:25.311972 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.311864 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 02:42:25.743216 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.743185 2579 apiserver.go:52] "Watching apiserver" Sep 19 02:42:25.751414 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.751388 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 19 02:42:25.751896 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.751863 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482","openshift-cluster-node-tuning-operator/tuned-252nd","openshift-dns/node-resolver-j58r8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal","openshift-multus/multus-qnkgw","openshift-network-diagnostics/network-check-target-vjcgr","openshift-ovn-kubernetes/ovnkube-node-gsmzv","kube-system/global-pull-secret-syncer-nhbtz","kube-system/konnectivity-agent-p7ctn","openshift-image-registry/node-ca-7d4rq","openshift-multus/multus-additional-cni-plugins-5xkvs","openshift-multus/network-metrics-daemon-7jpb8","openshift-network-operator/iptables-alerter-c7x9d"] Sep 19 02:42:25.754952 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.754929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:25.755052 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.755012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:25.757178 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.757028 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:25.759372 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.759345 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 19 02:42:25.759817 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.759799 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f5bn8\"" Sep 19 02:42:25.760060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.760043 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 19 02:42:25.760268 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.760251 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 19 02:42:25.760734 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.760688 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.761895 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.761873 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:25.762233 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.762213 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 19 02:42:25.764337 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.764170 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:25.765338 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.765294 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 19 02:42:25.765338 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.765308 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 19 02:42:25.765442 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.765378 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-prtqh\"" Sep 19 02:42:25.765530 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.765511 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 19 02:42:25.765655 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.765308 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xf8v5\"" Sep 19 02:42:25.766574 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.766556 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 19 02:42:25.766699 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.766684 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.767675 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.767655 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-88pp4\"" Sep 19 02:42:25.767941 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.767924 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 19 02:42:25.768023 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.767970 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 19 02:42:25.768150 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.768134 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 19 02:42:25.769151 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.768967 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 19 02:42:25.769585 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.769567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:25.769715 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.769689 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:25.770367 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.770344 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 19 02:42:25.770473 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.770387 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bzmlj\"" Sep 19 02:42:25.770539 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.770515 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 19 02:42:25.770539 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.770351 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 19 02:42:25.772630 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.772297 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:25.772630 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.772372 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:25.774438 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-host\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.774545 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-tuned\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.774545 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8aa6346-b659-436f-b75e-440d5e15c5d9-tmp\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.774660 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd5f2ab1-66bd-442e-878a-38b76d70f702-iptables-alerter-script\") pod \"iptables-alerter-c7x9d\" (UID: \"cd5f2ab1-66bd-442e-878a-38b76d70f702\") " pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:25.774660 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.774857 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-sysctl-conf\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.774960 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-lib-modules\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.774960 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94c0cdbe-b80a-40be-816b-c1efdaebada8-hosts-file\") pod \"node-resolver-j58r8\" (UID: \"94c0cdbe-b80a-40be-816b-c1efdaebada8\") " pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:25.774960 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c0cdbe-b80a-40be-816b-c1efdaebada8-tmp-dir\") pod \"node-resolver-j58r8\" (UID: \"94c0cdbe-b80a-40be-816b-c1efdaebada8\") " pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:25.775123 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5h7m\" (UniqueName: \"kubernetes.io/projected/94c0cdbe-b80a-40be-816b-c1efdaebada8-kube-api-access-b5h7m\") pod \"node-resolver-j58r8\" (UID: \"94c0cdbe-b80a-40be-816b-c1efdaebada8\") " pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:25.775123 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.774996 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-var-lib-kubelet\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.775123 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775017 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs9fl\" (UniqueName: \"kubernetes.io/projected/f8aa6346-b659-436f-b75e-440d5e15c5d9-kube-api-access-gs9fl\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.775123 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd5f2ab1-66bd-442e-878a-38b76d70f702-host-slash\") pod \"iptables-alerter-c7x9d\" (UID: \"cd5f2ab1-66bd-442e-878a-38b76d70f702\") " pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:25.775123 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2wjj\" (UniqueName: \"kubernetes.io/projected/cd5f2ab1-66bd-442e-878a-38b76d70f702-kube-api-access-h2wjj\") pod \"iptables-alerter-c7x9d\" (UID: \"cd5f2ab1-66bd-442e-878a-38b76d70f702\") " pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:25.775123 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8m7d\" (UniqueName: \"kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d\") pod \"network-check-target-vjcgr\" (UID: \"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11\") " pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775146 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fdc1553-466c-416d-8218-0ef10191b152-host\") pod \"node-ca-7d4rq\" (UID: \"6fdc1553-466c-416d-8218-0ef10191b152\") " pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fdc1553-466c-416d-8218-0ef10191b152-serviceca\") pod \"node-ca-7d4rq\" (UID: \"6fdc1553-466c-416d-8218-0ef10191b152\") " pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmhsj\" (UniqueName: \"kubernetes.io/projected/6fdc1553-466c-416d-8218-0ef10191b152-kube-api-access-mmhsj\") pod \"node-ca-7d4rq\" (UID: \"6fdc1553-466c-416d-8218-0ef10191b152\") " pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775192 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-sysconfig\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775240 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-kubernetes\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-sysctl-d\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-systemd\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-modprobe-d\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-run\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.775418 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.775386 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-sys\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.777810 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.776961 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-69w4x\"" Sep 19 02:42:25.777810 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.777103 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 19 02:42:25.777810 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.777203 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 19 02:42:25.779532 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.779286 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 19 02:42:25.782440 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.780082 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:25.782440 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.781573 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.782440 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.782354 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 19 02:42:25.783860 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.783426 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 19 02:42:25.783860 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.783431 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dn4pf\"" Sep 19 02:42:25.785761 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.784554 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8fkvf\"" Sep 19 02:42:25.785761 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.784564 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 19 02:42:25.785761 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.784708 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 19 02:42:25.785761 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.784726 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 19 02:42:25.786022 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.785983 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 19 02:42:25.786227 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.786102 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 19 02:42:25.786991 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.786956 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 19 02:42:25.787475 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.787451 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.790169 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.790134 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 19 02:42:25.790370 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.790352 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 19 02:42:25.790615 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.790588 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jslnn\"" Sep 19 02:42:25.795670 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.795586 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zj5gs" Sep 19 02:42:25.805678 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.805180 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zj5gs" Sep 19 02:42:25.863787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.863761 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 19 02:42:25.876238 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c0cdbe-b80a-40be-816b-c1efdaebada8-tmp-dir\") pod \"node-resolver-j58r8\" (UID: \"94c0cdbe-b80a-40be-816b-c1efdaebada8\") " pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:25.876380 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s6t7\" (UniqueName: \"kubernetes.io/projected/924b04f6-d98c-445a-ad4b-feef03aa9f67-kube-api-access-7s6t7\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:25.876380 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v42q5\" (UniqueName: \"kubernetes.io/projected/d8991102-63cd-4f82-8c04-acd42fb82c2a-kube-api-access-v42q5\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.876380 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-run-multus-certs\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.876520 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:25.876520 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-system-cni-dir\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.876520 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876434 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-system-cni-dir\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.876520 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-run-netns\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.876520 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-cnibin\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.876520 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-registration-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.876822 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-sys-fs\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.876822 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876560 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-cni-dir\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.876822 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-systemd-units\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.876822 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8991102-63cd-4f82-8c04-acd42fb82c2a-ovnkube-config\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.876822 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876666 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8991102-63cd-4f82-8c04-acd42fb82c2a-env-overrides\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.876822 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-lib-modules\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.876822 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-socket-dir-parent\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.876822 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-hostroot\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.876822 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-conf-dir\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxfzr\" (UniqueName: \"kubernetes.io/projected/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-kube-api-access-xxfzr\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876844 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-lib-modules\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876861 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-dbus\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-run-systemd\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-var-lib-openvswitch\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876929 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c0cdbe-b80a-40be-816b-c1efdaebada8-tmp-dir\") pod \"node-resolver-j58r8\" (UID: \"94c0cdbe-b80a-40be-816b-c1efdaebada8\") " pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8m7d\" (UniqueName: \"kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d\") pod \"network-check-target-vjcgr\" (UID: \"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11\") " pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.876985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-run-k8s-cni-cncf-io\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-etc-kubernetes\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877079 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877103 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-device-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fdc1553-466c-416d-8218-0ef10191b152-host\") pod \"node-ca-7d4rq\" (UID: \"6fdc1553-466c-416d-8218-0ef10191b152\") " pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877192 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-run\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.877259 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877247 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fdc1553-466c-416d-8218-0ef10191b152-host\") pod \"node-ca-7d4rq\" (UID: \"6fdc1553-466c-416d-8218-0ef10191b152\") " pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-log-socket\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877280 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-run\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8991102-63cd-4f82-8c04-acd42fb82c2a-ovn-node-metrics-cert\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877321 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95kth\" (UniqueName: \"kubernetes.io/projected/dde6afb9-b468-47df-b086-08d4ffff5fde-kube-api-access-95kth\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-sysctl-conf\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-run-netns\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-var-lib-kubelet\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs9fl\" (UniqueName: \"kubernetes.io/projected/f8aa6346-b659-436f-b75e-440d5e15c5d9-kube-api-access-gs9fl\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-var-lib-cni-bin\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-daemon-config\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877536 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-sysctl-conf\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877587 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-var-lib-kubelet\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg2k8\" (UniqueName: \"kubernetes.io/projected/a6f886a6-d581-4ae4-b26d-d832521867db-kube-api-access-rg2k8\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877614 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4b52b9b-8cd9-41cb-883e-802bc91be819-konnectivity-ca\") pod \"konnectivity-agent-p7ctn\" (UID: \"c4b52b9b-8cd9-41cb-883e-802bc91be819\") " pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-run-ovn\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.878060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8991102-63cd-4f82-8c04-acd42fb82c2a-ovnkube-script-lib\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmhsj\" (UniqueName: \"kubernetes.io/projected/6fdc1553-466c-416d-8218-0ef10191b152-kube-api-access-mmhsj\") pod \"node-ca-7d4rq\" (UID: \"6fdc1553-466c-416d-8218-0ef10191b152\") " pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-sysctl-d\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-systemd\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877891 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-systemd\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-sys\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd5f2ab1-66bd-442e-878a-38b76d70f702-iptables-alerter-script\") pod \"iptables-alerter-c7x9d\" (UID: \"cd5f2ab1-66bd-442e-878a-38b76d70f702\") " pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.877972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-sysctl-d\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-var-lib-cni-multus\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-slash\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878073 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-sys\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-node-log\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8aa6346-b659-436f-b75e-440d5e15c5d9-tmp\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-kubelet-config\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-run-openvswitch\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878368 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.878927 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5h7m\" (UniqueName: \"kubernetes.io/projected/94c0cdbe-b80a-40be-816b-c1efdaebada8-kube-api-access-b5h7m\") pod \"node-resolver-j58r8\" (UID: \"94c0cdbe-b80a-40be-816b-c1efdaebada8\") " pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878446 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-var-lib-kubelet\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd5f2ab1-66bd-442e-878a-38b76d70f702-host-slash\") pod \"iptables-alerter-c7x9d\" (UID: \"cd5f2ab1-66bd-442e-878a-38b76d70f702\") " pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wjj\" (UniqueName: \"kubernetes.io/projected/cd5f2ab1-66bd-442e-878a-38b76d70f702-kube-api-access-h2wjj\") pod \"iptables-alerter-c7x9d\" (UID: \"cd5f2ab1-66bd-442e-878a-38b76d70f702\") " pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-socket-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fdc1553-466c-416d-8218-0ef10191b152-serviceca\") pod \"node-ca-7d4rq\" (UID: \"6fdc1553-466c-416d-8218-0ef10191b152\") " pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-sysconfig\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878695 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd5f2ab1-66bd-442e-878a-38b76d70f702-iptables-alerter-script\") pod \"iptables-alerter-c7x9d\" (UID: \"cd5f2ab1-66bd-442e-878a-38b76d70f702\") " pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-kubernetes\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878707 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878798 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-sysconfig\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878803 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-cnibin\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dde6afb9-b468-47df-b086-08d4ffff5fde-cni-binary-copy\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-etc-selinux\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-kubelet\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878903 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-kubernetes\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878934 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd5f2ab1-66bd-442e-878a-38b76d70f702-host-slash\") pod \"iptables-alerter-c7x9d\" (UID: \"cd5f2ab1-66bd-442e-878a-38b76d70f702\") " pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:25.879787 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-modprobe-d\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.878981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-host\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-tuned\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4b52b9b-8cd9-41cb-883e-802bc91be819-agent-certs\") pod \"konnectivity-agent-p7ctn\" (UID: \"c4b52b9b-8cd9-41cb-883e-802bc91be819\") " pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879089 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-host\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-etc-openvswitch\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-cni-bin\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879184 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-modprobe-d\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-cni-netd\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94c0cdbe-b80a-40be-816b-c1efdaebada8-hosts-file\") pod \"node-resolver-j58r8\" (UID: \"94c0cdbe-b80a-40be-816b-c1efdaebada8\") " pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fdc1553-466c-416d-8218-0ef10191b152-serviceca\") pod \"node-ca-7d4rq\" (UID: \"6fdc1553-466c-416d-8218-0ef10191b152\") " pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879319 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94c0cdbe-b80a-40be-816b-c1efdaebada8-hosts-file\") pod \"node-resolver-j58r8\" (UID: \"94c0cdbe-b80a-40be-816b-c1efdaebada8\") " pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:25.880692 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.879754 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 02:42:25.882758 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.882737 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8aa6346-b659-436f-b75e-440d5e15c5d9-tmp\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.882874 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.882794 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8aa6346-b659-436f-b75e-440d5e15c5d9-etc-tuned\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.883072 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.883051 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 02:42:25.883186 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.883080 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 02:42:25.883186 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.883093 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r8m7d for pod openshift-network-diagnostics/network-check-target-vjcgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:25.883186 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.883156 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d podName:d22cd897-e0d4-4d29-8ad2-c75cd27f1a11 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:26.383136126 +0000 UTC m=+2.929618910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r8m7d" (UniqueName: "kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d") pod "network-check-target-vjcgr" (UID: "d22cd897-e0d4-4d29-8ad2-c75cd27f1a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:25.887415 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.887386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs9fl\" (UniqueName: \"kubernetes.io/projected/f8aa6346-b659-436f-b75e-440d5e15c5d9-kube-api-access-gs9fl\") pod \"tuned-252nd\" (UID: \"f8aa6346-b659-436f-b75e-440d5e15c5d9\") " pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:25.888404 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.888375 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmhsj\" (UniqueName: \"kubernetes.io/projected/6fdc1553-466c-416d-8218-0ef10191b152-kube-api-access-mmhsj\") pod \"node-ca-7d4rq\" (UID: \"6fdc1553-466c-416d-8218-0ef10191b152\") " pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:25.888504 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.888380 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5h7m\" (UniqueName: \"kubernetes.io/projected/94c0cdbe-b80a-40be-816b-c1efdaebada8-kube-api-access-b5h7m\") pod \"node-resolver-j58r8\" (UID: \"94c0cdbe-b80a-40be-816b-c1efdaebada8\") " pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:25.889520 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.889501 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2wjj\" (UniqueName: \"kubernetes.io/projected/cd5f2ab1-66bd-442e-878a-38b76d70f702-kube-api-access-h2wjj\") pod \"iptables-alerter-c7x9d\" (UID: \"cd5f2ab1-66bd-442e-878a-38b76d70f702\") " pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:25.939433 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.939298 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" event={"ID":"ed2314bd2deae1665a958c5450f2e01e","Type":"ContainerStarted","Data":"969a32338279390403b7e09feb5dfaa0f9aef534ba32ef96943cc9c03858d983"} Sep 19 02:42:25.943034 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.943002 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal" event={"ID":"a273ac8b2cca19fe2190dc3d23e4202f","Type":"ContainerStarted","Data":"cf4a733066baef606ac916e4cf9de9b179918e40b79e043c4e17134887dcede2"} Sep 19 02:42:25.980277 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-socket-dir-parent\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.980277 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-hostroot\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.980528 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-conf-dir\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.980528 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxfzr\" (UniqueName: \"kubernetes.io/projected/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-kube-api-access-xxfzr\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.980528 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980394 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-socket-dir-parent\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.980528 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-dbus\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:25.980528 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980397 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-hostroot\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.980528 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-run-systemd\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.980528 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-conf-dir\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.980528 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-var-lib-openvswitch\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.980528 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980465 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-dbus\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-run-k8s-cni-cncf-io\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980547 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-run-systemd\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-etc-kubernetes\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980585 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-etc-kubernetes\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980592 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-var-lib-openvswitch\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980624 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-run-k8s-cni-cncf-io\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-device-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-log-socket\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980808 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980815 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8991102-63cd-4f82-8c04-acd42fb82c2a-ovn-node-metrics-cert\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95kth\" (UniqueName: \"kubernetes.io/projected/dde6afb9-b468-47df-b086-08d4ffff5fde-kube-api-access-95kth\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980847 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980850 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-log-socket\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981073 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.980812 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.980942 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret podName:7a53515b-9a34-4f6a-9e4c-3a27db012dfe nodeName:}" failed. No retries permitted until 2026-09-19 02:42:26.480922993 +0000 UTC m=+3.027405783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret") pod "global-pull-secret-syncer-nhbtz" (UID: "7a53515b-9a34-4f6a-9e4c-3a27db012dfe") : object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980973 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-run-netns\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-var-lib-cni-bin\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-daemon-config\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981049 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg2k8\" (UniqueName: \"kubernetes.io/projected/a6f886a6-d581-4ae4-b26d-d832521867db-kube-api-access-rg2k8\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4b52b9b-8cd9-41cb-883e-802bc91be819-konnectivity-ca\") pod \"konnectivity-agent-p7ctn\" (UID: \"c4b52b9b-8cd9-41cb-883e-802bc91be819\") " pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-run-ovn\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8991102-63cd-4f82-8c04-acd42fb82c2a-ovnkube-script-lib\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981131 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-var-lib-cni-bin\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.980812 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-device-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-var-lib-cni-multus\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-slash\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-node-log\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.981992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-kubelet-config\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981266 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-run-netns\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-run-openvswitch\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981365 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981223 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981389 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981435 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-run-openvswitch\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981458 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-kubelet-config\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981503 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-slash\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-var-lib-cni-multus\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981587 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-run-ovn\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981625 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-node-log\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-var-lib-kubelet\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-socket-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-cnibin\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dde6afb9-b468-47df-b086-08d4ffff5fde-cni-binary-copy\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.982677 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-etc-selinux\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-kubelet\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4b52b9b-8cd9-41cb-883e-802bc91be819-agent-certs\") pod \"konnectivity-agent-p7ctn\" (UID: \"c4b52b9b-8cd9-41cb-883e-802bc91be819\") " pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-etc-openvswitch\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-cni-bin\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981930 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8991102-63cd-4f82-8c04-acd42fb82c2a-ovnkube-script-lib\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-cni-netd\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s6t7\" (UniqueName: \"kubernetes.io/projected/924b04f6-d98c-445a-ad4b-feef03aa9f67-kube-api-access-7s6t7\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981978 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4b52b9b-8cd9-41cb-883e-802bc91be819-konnectivity-ca\") pod \"konnectivity-agent-p7ctn\" (UID: \"c4b52b9b-8cd9-41cb-883e-802bc91be819\") " pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.981995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v42q5\" (UniqueName: \"kubernetes.io/projected/d8991102-63cd-4f82-8c04-acd42fb82c2a-kube-api-access-v42q5\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-run-multus-certs\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982035 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-etc-selinux\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982073 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-kubelet\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-system-cni-dir\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.983471 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982096 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-system-cni-dir\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982117 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-system-cni-dir\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982114 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-daemon-config\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982159 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-var-lib-kubelet\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982176 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-system-cni-dir\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-run-netns\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982194 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-socket-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982243 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-cnibin\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-cnibin\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982254 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-run-netns\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-registration-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-sys-fs\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-cni-dir\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-systemd-units\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982297 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-cni-bin\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8991102-63cd-4f82-8c04-acd42fb82c2a-ovnkube-config\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8991102-63cd-4f82-8c04-acd42fb82c2a-env-overrides\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.984424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982347 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dde6afb9-b468-47df-b086-08d4ffff5fde-cni-binary-copy\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982362 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-etc-openvswitch\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982415 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-host-cni-netd\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982420 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-host-run-multus-certs\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982422 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-multus-cni-dir\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-registration-dir\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8991102-63cd-4f82-8c04-acd42fb82c2a-systemd-units\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dde6afb9-b468-47df-b086-08d4ffff5fde-cnibin\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982526 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a6f886a6-d581-4ae4-b26d-d832521867db-sys-fs\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.982586 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:25.982633 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs podName:924b04f6-d98c-445a-ad4b-feef03aa9f67 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:26.482617441 +0000 UTC m=+3.029100228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs") pod "network-metrics-daemon-7jpb8" (UID: "924b04f6-d98c-445a-ad4b-feef03aa9f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982801 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8991102-63cd-4f82-8c04-acd42fb82c2a-ovnkube-config\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.982975 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8991102-63cd-4f82-8c04-acd42fb82c2a-env-overrides\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.984134 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8991102-63cd-4f82-8c04-acd42fb82c2a-ovn-node-metrics-cert\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:25.985366 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.984953 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4b52b9b-8cd9-41cb-883e-802bc91be819-agent-certs\") pod \"konnectivity-agent-p7ctn\" (UID: \"c4b52b9b-8cd9-41cb-883e-802bc91be819\") " pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:25.989781 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.989688 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95kth\" (UniqueName: \"kubernetes.io/projected/dde6afb9-b468-47df-b086-08d4ffff5fde-kube-api-access-95kth\") pod \"multus-qnkgw\" (UID: \"dde6afb9-b468-47df-b086-08d4ffff5fde\") " pod="openshift-multus/multus-qnkgw" Sep 19 02:42:25.990164 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.990136 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxfzr\" (UniqueName: \"kubernetes.io/projected/eadd361d-35a7-4c18-aa0a-7e38f9fb78c4-kube-api-access-xxfzr\") pod \"multus-additional-cni-plugins-5xkvs\" (UID: \"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4\") " pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:25.990390 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.990346 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg2k8\" (UniqueName: \"kubernetes.io/projected/a6f886a6-d581-4ae4-b26d-d832521867db-kube-api-access-rg2k8\") pod \"aws-ebs-csi-driver-node-5n482\" (UID: \"a6f886a6-d581-4ae4-b26d-d832521867db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:25.991293 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.991234 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s6t7\" (UniqueName: \"kubernetes.io/projected/924b04f6-d98c-445a-ad4b-feef03aa9f67-kube-api-access-7s6t7\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:25.992011 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:25.991994 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v42q5\" (UniqueName: \"kubernetes.io/projected/d8991102-63cd-4f82-8c04-acd42fb82c2a-kube-api-access-v42q5\") pod \"ovnkube-node-gsmzv\" (UID: \"d8991102-63cd-4f82-8c04-acd42fb82c2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:26.073334 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.073243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7d4rq" Sep 19 02:42:26.088063 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.088030 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-252nd" Sep 19 02:42:26.096951 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.096917 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j58r8" Sep 19 02:42:26.104947 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.104905 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c7x9d" Sep 19 02:42:26.112973 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.112953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qnkgw" Sep 19 02:42:26.121950 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.121931 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" Sep 19 02:42:26.128737 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.128719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:26.137533 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.137516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:26.144361 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.144343 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" Sep 19 02:42:26.385199 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.385115 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8m7d\" (UniqueName: \"kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d\") pod \"network-check-target-vjcgr\" (UID: \"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11\") " pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:26.385352 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:26.385256 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 02:42:26.385352 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:26.385274 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 02:42:26.385352 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:26.385288 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r8m7d for pod openshift-network-diagnostics/network-check-target-vjcgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:26.385352 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:26.385349 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d podName:d22cd897-e0d4-4d29-8ad2-c75cd27f1a11 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:27.385331276 +0000 UTC m=+3.931814053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8m7d" (UniqueName: "kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d") pod "network-check-target-vjcgr" (UID: "d22cd897-e0d4-4d29-8ad2-c75cd27f1a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:26.485841 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.485804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:26.486007 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.485907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:26.486007 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:26.485961 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:26.486102 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:26.486035 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:26.486102 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:26.486045 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret podName:7a53515b-9a34-4f6a-9e4c-3a27db012dfe nodeName:}" failed. No retries permitted until 2026-09-19 02:42:27.486023457 +0000 UTC m=+4.032506248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret") pod "global-pull-secret-syncer-nhbtz" (UID: "7a53515b-9a34-4f6a-9e4c-3a27db012dfe") : object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:26.486102 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:26.486092 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs podName:924b04f6-d98c-445a-ad4b-feef03aa9f67 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:27.486075469 +0000 UTC m=+4.032558271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs") pod "network-metrics-daemon-7jpb8" (UID: "924b04f6-d98c-445a-ad4b-feef03aa9f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:26.809405 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.809351 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 02:37:25 +0000 UTC" deadline="2028-04-19 13:56:51.359719106 +0000 UTC" Sep 19 02:42:26.809405 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.809399 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13883h14m24.550324812s" Sep 19 02:42:26.933370 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:26.933340 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:26.933537 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:26.933446 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:26.973579 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:26.973550 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c0cdbe_b80a_40be_816b_c1efdaebada8.slice/crio-c7563c17546c0d66a61fe25f06efa4d481020ca24c14491f3f4f639c6083e7f5 WatchSource:0}: Error finding container c7563c17546c0d66a61fe25f06efa4d481020ca24c14491f3f4f639c6083e7f5: Status 404 returned error can't find the container with id c7563c17546c0d66a61fe25f06efa4d481020ca24c14491f3f4f639c6083e7f5 Sep 19 02:42:26.974847 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:26.974818 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8991102_63cd_4f82_8c04_acd42fb82c2a.slice/crio-bb8b26f47b4e788a68d6cef19c225b5eb6bd5011ad61440dd2cee78dc93fbdb1 WatchSource:0}: Error finding container bb8b26f47b4e788a68d6cef19c225b5eb6bd5011ad61440dd2cee78dc93fbdb1: Status 404 returned error can't find the container with id bb8b26f47b4e788a68d6cef19c225b5eb6bd5011ad61440dd2cee78dc93fbdb1 Sep 19 02:42:26.979362 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:26.979338 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5f2ab1_66bd_442e_878a_38b76d70f702.slice/crio-3635b1f0a912009b4c1d60b7c152d6ecb9d156ee488d1ab52dadd30f158eefe4 WatchSource:0}: Error finding container 3635b1f0a912009b4c1d60b7c152d6ecb9d156ee488d1ab52dadd30f158eefe4: Status 404 returned error can't find the container with id 3635b1f0a912009b4c1d60b7c152d6ecb9d156ee488d1ab52dadd30f158eefe4 Sep 19 02:42:27.000554 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:27.000529 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8aa6346_b659_436f_b75e_440d5e15c5d9.slice/crio-069affa3443b7f160f441cc442cb3425146a8cf4b92b832837363e5d0c4db827 WatchSource:0}: Error finding container 069affa3443b7f160f441cc442cb3425146a8cf4b92b832837363e5d0c4db827: Status 404 returned error can't find the container with id 069affa3443b7f160f441cc442cb3425146a8cf4b92b832837363e5d0c4db827 Sep 19 02:42:27.001655 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:27.001619 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b52b9b_8cd9_41cb_883e_802bc91be819.slice/crio-df64b03a49d1775e5ea9e359e86d3f7d3c04a1aaa736d1a37ee4ca0a8e732e87 WatchSource:0}: Error finding container df64b03a49d1775e5ea9e359e86d3f7d3c04a1aaa736d1a37ee4ca0a8e732e87: Status 404 returned error can't find the container with id df64b03a49d1775e5ea9e359e86d3f7d3c04a1aaa736d1a37ee4ca0a8e732e87 Sep 19 02:42:27.002425 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:27.002303 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f886a6_d581_4ae4_b26d_d832521867db.slice/crio-d3096487c15e8a8e729e7173f0bc5b10adf06c975c8b24806f2efc664108587c WatchSource:0}: Error finding container d3096487c15e8a8e729e7173f0bc5b10adf06c975c8b24806f2efc664108587c: Status 404 returned error can't find the container with id d3096487c15e8a8e729e7173f0bc5b10adf06c975c8b24806f2efc664108587c Sep 19 02:42:27.003393 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:27.003377 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeadd361d_35a7_4c18_aa0a_7e38f9fb78c4.slice/crio-79fbc356f73a58786a9848f371006a372715f40cd5f009c2ef7a9530eb70b855 WatchSource:0}: Error finding container 79fbc356f73a58786a9848f371006a372715f40cd5f009c2ef7a9530eb70b855: Status 404 returned error can't find the container with id 79fbc356f73a58786a9848f371006a372715f40cd5f009c2ef7a9530eb70b855 Sep 19 02:42:27.006019 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:27.005987 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde6afb9_b468_47df_b086_08d4ffff5fde.slice/crio-653c27a0f244e9d26caf5e68b2ea28fa4fdc04d9c81725374649f0681d6bde03 WatchSource:0}: Error finding container 653c27a0f244e9d26caf5e68b2ea28fa4fdc04d9c81725374649f0681d6bde03: Status 404 returned error can't find the container with id 653c27a0f244e9d26caf5e68b2ea28fa4fdc04d9c81725374649f0681d6bde03 Sep 19 02:42:27.008424 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:27.008402 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdc1553_466c_416d_8218_0ef10191b152.slice/crio-72a36abbddd7c780c46673ae945f81cdb4a61f1621c3088fd52a377e60d4f3c3 WatchSource:0}: Error finding container 72a36abbddd7c780c46673ae945f81cdb4a61f1621c3088fd52a377e60d4f3c3: Status 404 returned error can't find the container with id 72a36abbddd7c780c46673ae945f81cdb4a61f1621c3088fd52a377e60d4f3c3 Sep 19 02:42:27.393076 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:27.392866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8m7d\" (UniqueName: \"kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d\") pod \"network-check-target-vjcgr\" (UID: \"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11\") " pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:27.393076 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:27.393024 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 02:42:27.393076 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:27.393047 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 02:42:27.393076 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:27.393058 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r8m7d for pod openshift-network-diagnostics/network-check-target-vjcgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:27.393294 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:27.393108 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d podName:d22cd897-e0d4-4d29-8ad2-c75cd27f1a11 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:29.393091812 +0000 UTC m=+5.939574589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8m7d" (UniqueName: "kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d") pod "network-check-target-vjcgr" (UID: "d22cd897-e0d4-4d29-8ad2-c75cd27f1a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:27.497416 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:27.497080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:27.497416 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:27.497188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:27.497416 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:27.497351 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:27.497416 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:27.497428 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs podName:924b04f6-d98c-445a-ad4b-feef03aa9f67 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:29.497407963 +0000 UTC m=+6.043890759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs") pod "network-metrics-daemon-7jpb8" (UID: "924b04f6-d98c-445a-ad4b-feef03aa9f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:27.498683 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:27.498021 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:27.498683 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:27.498092 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret podName:7a53515b-9a34-4f6a-9e4c-3a27db012dfe nodeName:}" failed. No retries permitted until 2026-09-19 02:42:29.498067342 +0000 UTC m=+6.044550125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret") pod "global-pull-secret-syncer-nhbtz" (UID: "7a53515b-9a34-4f6a-9e4c-3a27db012dfe") : object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:27.810179 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:27.810112 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 02:37:25 +0000 UTC" deadline="2028-03-01 16:38:38.238155386 +0000 UTC" Sep 19 02:42:27.810179 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:27.810176 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12709h56m10.427984026s" Sep 19 02:42:27.935635 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:27.934951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:27.935635 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:27.935089 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:27.935635 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:27.935495 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:27.935635 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:27.935587 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:27.964990 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:27.964953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" event={"ID":"a6f886a6-d581-4ae4-b26d-d832521867db","Type":"ContainerStarted","Data":"d3096487c15e8a8e729e7173f0bc5b10adf06c975c8b24806f2efc664108587c"} Sep 19 02:42:27.979196 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:27.979161 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p7ctn" event={"ID":"c4b52b9b-8cd9-41cb-883e-802bc91be819","Type":"ContainerStarted","Data":"df64b03a49d1775e5ea9e359e86d3f7d3c04a1aaa736d1a37ee4ca0a8e732e87"} Sep 19 02:42:27.993332 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:27.993302 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" event={"ID":"d8991102-63cd-4f82-8c04-acd42fb82c2a","Type":"ContainerStarted","Data":"bb8b26f47b4e788a68d6cef19c225b5eb6bd5011ad61440dd2cee78dc93fbdb1"} Sep 19 02:42:28.004991 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:28.004962 2579 generic.go:356] "Generic (PLEG): container finished" podID="ed2314bd2deae1665a958c5450f2e01e" containerID="c5e31d77bbce1fe5441291aea8e448851f136e1c5066b3cea1d5b7fb9e0a72d7" exitCode=0 Sep 19 02:42:28.005107 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:28.005045 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" event={"ID":"ed2314bd2deae1665a958c5450f2e01e","Type":"ContainerDied","Data":"c5e31d77bbce1fe5441291aea8e448851f136e1c5066b3cea1d5b7fb9e0a72d7"} Sep 19 02:42:28.042777 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:28.038897 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7d4rq" event={"ID":"6fdc1553-466c-416d-8218-0ef10191b152","Type":"ContainerStarted","Data":"72a36abbddd7c780c46673ae945f81cdb4a61f1621c3088fd52a377e60d4f3c3"} Sep 19 02:42:28.042993 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:28.042967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qnkgw" event={"ID":"dde6afb9-b468-47df-b086-08d4ffff5fde","Type":"ContainerStarted","Data":"653c27a0f244e9d26caf5e68b2ea28fa4fdc04d9c81725374649f0681d6bde03"} Sep 19 02:42:28.048255 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:28.048232 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-252nd" event={"ID":"f8aa6346-b659-436f-b75e-440d5e15c5d9","Type":"ContainerStarted","Data":"069affa3443b7f160f441cc442cb3425146a8cf4b92b832837363e5d0c4db827"} Sep 19 02:42:28.050457 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:28.050428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c7x9d" event={"ID":"cd5f2ab1-66bd-442e-878a-38b76d70f702","Type":"ContainerStarted","Data":"3635b1f0a912009b4c1d60b7c152d6ecb9d156ee488d1ab52dadd30f158eefe4"} Sep 19 02:42:28.058022 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:28.057996 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j58r8" event={"ID":"94c0cdbe-b80a-40be-816b-c1efdaebada8","Type":"ContainerStarted","Data":"c7563c17546c0d66a61fe25f06efa4d481020ca24c14491f3f4f639c6083e7f5"} Sep 19 02:42:28.068246 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:28.068217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal" event={"ID":"a273ac8b2cca19fe2190dc3d23e4202f","Type":"ContainerStarted","Data":"653e90fe0004c15835cb116bffa942c7a33f0009788d3e328fa47362889ce8c7"} Sep 19 02:42:28.081284 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:28.081258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" event={"ID":"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4","Type":"ContainerStarted","Data":"79fbc356f73a58786a9848f371006a372715f40cd5f009c2ef7a9530eb70b855"} Sep 19 02:42:28.933600 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:28.933567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:28.934201 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:28.933704 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:29.089854 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:29.089816 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" event={"ID":"ed2314bd2deae1665a958c5450f2e01e","Type":"ContainerStarted","Data":"b346b182c0d264bc3a036ee0bca1dcf328cbb44c8d115c14fbc724b04cd96a4e"} Sep 19 02:42:29.103262 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:29.103202 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-27.ec2.internal" podStartSLOduration=4.103183791 podStartE2EDuration="4.103183791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:42:28.083985191 +0000 UTC m=+4.630467988" watchObservedRunningTime="2026-09-19 02:42:29.103183791 +0000 UTC m=+5.649666590" Sep 19 02:42:29.411284 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:29.410576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8m7d\" (UniqueName: \"kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d\") pod \"network-check-target-vjcgr\" (UID: \"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11\") " pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:29.411284 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:29.410794 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 02:42:29.411284 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:29.410814 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 02:42:29.411284 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:29.410827 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r8m7d for pod openshift-network-diagnostics/network-check-target-vjcgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:29.411284 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:29.410880 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d podName:d22cd897-e0d4-4d29-8ad2-c75cd27f1a11 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:33.410863682 +0000 UTC m=+9.957346463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8m7d" (UniqueName: "kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d") pod "network-check-target-vjcgr" (UID: "d22cd897-e0d4-4d29-8ad2-c75cd27f1a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:29.511686 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:29.511650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:29.511876 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:29.511725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:29.511948 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:29.511884 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:29.511999 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:29.511949 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret podName:7a53515b-9a34-4f6a-9e4c-3a27db012dfe nodeName:}" failed. No retries permitted until 2026-09-19 02:42:33.511931495 +0000 UTC m=+10.058414273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret") pod "global-pull-secret-syncer-nhbtz" (UID: "7a53515b-9a34-4f6a-9e4c-3a27db012dfe") : object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:29.511999 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:29.511884 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:29.511999 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:29.512000 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs podName:924b04f6-d98c-445a-ad4b-feef03aa9f67 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:33.511983382 +0000 UTC m=+10.058466164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs") pod "network-metrics-daemon-7jpb8" (UID: "924b04f6-d98c-445a-ad4b-feef03aa9f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:29.935618 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:29.935136 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:29.935618 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:29.935273 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:29.935618 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:29.935305 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:29.935618 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:29.935476 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:30.934258 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:30.934226 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:30.935567 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:30.934525 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:31.935213 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:31.934681 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:31.935213 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:31.934828 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:31.935720 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:31.935257 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:31.935720 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:31.935350 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:32.934310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:32.934244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:32.934479 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:32.934382 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:33.446095 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:33.446056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8m7d\" (UniqueName: \"kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d\") pod \"network-check-target-vjcgr\" (UID: \"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11\") " pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:33.446560 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:33.446256 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 02:42:33.446560 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:33.446276 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 02:42:33.446560 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:33.446288 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r8m7d for pod openshift-network-diagnostics/network-check-target-vjcgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:33.446560 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:33.446348 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d podName:d22cd897-e0d4-4d29-8ad2-c75cd27f1a11 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:41.446329682 +0000 UTC m=+17.992812461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8m7d" (UniqueName: "kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d") pod "network-check-target-vjcgr" (UID: "d22cd897-e0d4-4d29-8ad2-c75cd27f1a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:33.547124 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:33.547089 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:33.547299 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:33.547167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:33.547299 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:33.547279 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:33.547461 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:33.547340 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs podName:924b04f6-d98c-445a-ad4b-feef03aa9f67 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:41.547320512 +0000 UTC m=+18.093803289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs") pod "network-metrics-daemon-7jpb8" (UID: "924b04f6-d98c-445a-ad4b-feef03aa9f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:33.547461 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:33.547400 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:33.547461 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:33.547434 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret podName:7a53515b-9a34-4f6a-9e4c-3a27db012dfe nodeName:}" failed. No retries permitted until 2026-09-19 02:42:41.547423121 +0000 UTC m=+18.093905898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret") pod "global-pull-secret-syncer-nhbtz" (UID: "7a53515b-9a34-4f6a-9e4c-3a27db012dfe") : object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:33.935363 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:33.934782 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:33.935363 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:33.934887 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:33.935363 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:33.935162 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:33.935363 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:33.935265 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:34.933896 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:34.933832 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:34.934465 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:34.934016 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:35.936702 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:35.936672 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:35.936702 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:35.936706 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:35.937186 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:35.936821 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:35.937186 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:35.936955 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:36.933997 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:36.933962 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:36.934163 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:36.934087 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:37.933688 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:37.933652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:37.933688 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:37.933676 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:37.934185 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:37.933804 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:37.934242 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:37.934205 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:38.933703 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:38.933669 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:38.934184 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:38.933810 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:39.937401 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:39.937369 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:39.937907 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:39.937502 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:39.937907 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:39.937535 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:39.937907 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:39.937605 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:40.933916 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:40.933878 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:40.934142 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:40.934014 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:41.504891 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:41.504859 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8m7d\" (UniqueName: \"kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d\") pod \"network-check-target-vjcgr\" (UID: \"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11\") " pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:41.505337 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:41.505005 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 02:42:41.505337 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:41.505027 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 02:42:41.505337 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:41.505040 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r8m7d for pod openshift-network-diagnostics/network-check-target-vjcgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:41.505337 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:41.505100 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d podName:d22cd897-e0d4-4d29-8ad2-c75cd27f1a11 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:57.505082675 +0000 UTC m=+34.051565455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8m7d" (UniqueName: "kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d") pod "network-check-target-vjcgr" (UID: "d22cd897-e0d4-4d29-8ad2-c75cd27f1a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:41.606075 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:41.606042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:41.606255 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:41.606116 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:41.606255 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:41.606182 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:41.606376 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:41.606269 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret podName:7a53515b-9a34-4f6a-9e4c-3a27db012dfe nodeName:}" failed. No retries permitted until 2026-09-19 02:42:57.606246288 +0000 UTC m=+34.152729079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret") pod "global-pull-secret-syncer-nhbtz" (UID: "7a53515b-9a34-4f6a-9e4c-3a27db012dfe") : object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:41.606376 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:41.606202 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:41.606376 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:41.606333 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs podName:924b04f6-d98c-445a-ad4b-feef03aa9f67 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:57.606315523 +0000 UTC m=+34.152798304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs") pod "network-metrics-daemon-7jpb8" (UID: "924b04f6-d98c-445a-ad4b-feef03aa9f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:41.936970 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:41.936943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:41.937156 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:41.937059 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:41.937571 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:41.937433 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:41.937571 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:41.937535 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:42.933685 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:42.933643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:42.934176 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:42.933778 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:43.938175 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:43.938141 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:43.938558 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:43.938261 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:43.938558 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:43.938317 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:43.938558 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:43.938413 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:44.934119 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:44.933755 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:44.934214 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:44.934199 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:45.127211 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.127185 2579 generic.go:356] "Generic (PLEG): container finished" podID="eadd361d-35a7-4c18-aa0a-7e38f9fb78c4" containerID="edd7dfa06ebe60010976d74d11d54998895df1f91ac2b9310bf8befef6cc0a2f" exitCode=0 Sep 19 02:42:45.127632 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.127263 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" event={"ID":"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4","Type":"ContainerDied","Data":"edd7dfa06ebe60010976d74d11d54998895df1f91ac2b9310bf8befef6cc0a2f"} Sep 19 02:42:45.128755 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.128723 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" event={"ID":"a6f886a6-d581-4ae4-b26d-d832521867db","Type":"ContainerStarted","Data":"f2900fa4b496692460ac75b2bb10495b3fdffe4f9d315c2d311f85a7268971a5"} Sep 19 02:42:45.130369 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.130339 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p7ctn" event={"ID":"c4b52b9b-8cd9-41cb-883e-802bc91be819","Type":"ContainerStarted","Data":"fb306239ba420e966d18f163f6ceee4e87b1c6b7e574b7ae5b0dfef4baf37bc5"} Sep 19 02:42:45.133154 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.133133 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" event={"ID":"d8991102-63cd-4f82-8c04-acd42fb82c2a","Type":"ContainerStarted","Data":"a47ac5bc6cf869365e7d9ebd8a5afcab7db058d066cd5c111c960171e17a40f7"} Sep 19 02:42:45.133236 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.133203 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" event={"ID":"d8991102-63cd-4f82-8c04-acd42fb82c2a","Type":"ContainerStarted","Data":"bce692901eb5efecb8403020322053ef28b1eea95b86b9c2efcfc590510f799b"} Sep 19 02:42:45.133282 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.133258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" event={"ID":"d8991102-63cd-4f82-8c04-acd42fb82c2a","Type":"ContainerStarted","Data":"beb8cf929ec6ca37f7338c7e3ed37f9ef514785a5cbfac83a3d65e7113393acb"} Sep 19 02:42:45.133315 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.133303 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" event={"ID":"d8991102-63cd-4f82-8c04-acd42fb82c2a","Type":"ContainerStarted","Data":"af8b98f7fee7c7a0b24ecb561dc662226611896cdfe81ce58767c9d23e381295"} Sep 19 02:42:45.133357 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.133345 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" event={"ID":"d8991102-63cd-4f82-8c04-acd42fb82c2a","Type":"ContainerStarted","Data":"7eccd094c87244b3d6df63e74ee48443ff9dd92d04d2e2f7fb6c58ea833fd17a"} Sep 19 02:42:45.134610 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.134589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7d4rq" event={"ID":"6fdc1553-466c-416d-8218-0ef10191b152","Type":"ContainerStarted","Data":"2364dedada27374322215cd6f230d7f8351a46cde699faebde591cfdff8568fc"} Sep 19 02:42:45.136000 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.135978 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qnkgw" event={"ID":"dde6afb9-b468-47df-b086-08d4ffff5fde","Type":"ContainerStarted","Data":"6447f522d2c2e448ee213aee1c7714f7fdccc4dc6aa42d2005d708f2458886ea"} Sep 19 02:42:45.137247 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.137230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-252nd" event={"ID":"f8aa6346-b659-436f-b75e-440d5e15c5d9","Type":"ContainerStarted","Data":"201fc21b860418dd7f61e0c971243c39854f439d13ef94b2ade1aa6ab6e5679b"} Sep 19 02:42:45.138560 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.138535 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j58r8" event={"ID":"94c0cdbe-b80a-40be-816b-c1efdaebada8","Type":"ContainerStarted","Data":"c27c3ae7f27bf28e3dc4373730da9ef5e3a1aa295f0a27821dd9b5eb5f19f458"} Sep 19 02:42:45.146820 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.146615 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-27.ec2.internal" podStartSLOduration=20.146598848 podStartE2EDuration="20.146598848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:42:29.104158112 +0000 UTC m=+5.650640908" watchObservedRunningTime="2026-09-19 02:42:45.146598848 +0000 UTC m=+21.693081648" Sep 19 02:42:45.158945 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.158886 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7d4rq" podStartSLOduration=3.588977431 podStartE2EDuration="21.158875369s" totalImagesPullingTime="17.569897938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:42:45.158230256 +0000 UTC m=+21.704713054" watchObservedRunningTime="2026-09-19 02:42:45.158875369 +0000 UTC m=+21.705358198" Sep 19 02:42:45.173379 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.173342 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-252nd" podStartSLOduration=3.592860617 podStartE2EDuration="21.17333028s" totalImagesPullingTime="17.580469663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:42:45.17291235 +0000 UTC m=+21.719395168" watchObservedRunningTime="2026-09-19 02:42:45.17333028 +0000 UTC m=+21.719813075" Sep 19 02:42:45.188208 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.188174 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qnkgw" podStartSLOduration=3.562114868 podStartE2EDuration="21.188163998s" totalImagesPullingTime="17.62604913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:42:45.187862227 +0000 UTC m=+21.734345023" watchObservedRunningTime="2026-09-19 02:42:45.188163998 +0000 UTC m=+21.734646794" Sep 19 02:42:45.215925 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.215893 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j58r8" podStartSLOduration=3.610279169 podStartE2EDuration="21.215882064s" totalImagesPullingTime="17.605602895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:42:45.201201585 +0000 UTC m=+21.747684382" watchObservedRunningTime="2026-09-19 02:42:45.215882064 +0000 UTC m=+21.762364861" Sep 19 02:42:45.216174 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.216154 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p7ctn" podStartSLOduration=10.963819525 podStartE2EDuration="21.216149968s" totalImagesPullingTime="10.252330443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:42:45.215818497 +0000 UTC m=+21.762301293" watchObservedRunningTime="2026-09-19 02:42:45.216149968 +0000 UTC m=+21.762632765" Sep 19 02:42:45.936710 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.936682 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:45.936964 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:45.936812 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:45.937095 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:45.937075 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:45.937216 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:45.937195 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:46.142207 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:46.142162 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c7x9d" event={"ID":"cd5f2ab1-66bd-442e-878a-38b76d70f702","Type":"ContainerStarted","Data":"ebe21603d6356641dd9cdc7d156bf25502bd17b3757d3094e494de1a153ca1fa"} Sep 19 02:42:46.145673 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:46.145642 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" event={"ID":"d8991102-63cd-4f82-8c04-acd42fb82c2a","Type":"ContainerStarted","Data":"8c41c1dd394bd353cc6d8c39f4f45531a7743b4226ed741665a9f5fa0e454a93"} Sep 19 02:42:46.156319 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:46.156281 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c7x9d" podStartSLOduration=4.573548089 podStartE2EDuration="22.156268981s" totalImagesPullingTime="17.582720892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:42:46.156118199 +0000 UTC m=+22.702600996" watchObservedRunningTime="2026-09-19 02:42:46.156268981 +0000 UTC m=+22.702751777" Sep 19 02:42:46.328401 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:46.328374 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 19 02:42:46.934194 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:46.934159 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:46.934380 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:46.934294 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:46.971564 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:46.971464 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T02:42:46.328395656Z","UUID":"3940fbcb-da18-456e-bac9-26e669ad5b41","Handler":null,"Name":"","Endpoint":""} Sep 19 02:42:46.973179 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:46.973144 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 19 02:42:46.973179 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:46.973178 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 19 02:42:47.150608 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:47.150571 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" event={"ID":"a6f886a6-d581-4ae4-b26d-d832521867db","Type":"ContainerStarted","Data":"c02dbad81794314889c358570da72c3a5aef4d1b8d5c4c6e42e24eaacc342a4d"} Sep 19 02:42:47.933533 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:47.933504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:47.933533 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:47.933524 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:47.933870 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:47.933621 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:47.933870 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:47.933772 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:48.156833 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:48.156802 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" event={"ID":"a6f886a6-d581-4ae4-b26d-d832521867db","Type":"ContainerStarted","Data":"c0ea4b53dbeac981faf51c6a44925f3b00c524cfe30d564a2aab87738b4a1c80"} Sep 19 02:42:48.160627 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:48.160597 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" event={"ID":"d8991102-63cd-4f82-8c04-acd42fb82c2a","Type":"ContainerStarted","Data":"b541b966b55bffd709da82e0727d01fa53bc1a735d84a25808e0d92275290aff"} Sep 19 02:42:48.176664 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:48.176615 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5n482" podStartSLOduration=4.05361889 podStartE2EDuration="24.176600726s" totalImagesPullingTime="20.122981836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:42:48.176595634 +0000 UTC m=+24.723078432" watchObservedRunningTime="2026-09-19 02:42:48.176600726 +0000 UTC m=+24.723083501" Sep 19 02:42:48.184668 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:48.184615 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:48.758709 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:48.758504 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:48.759158 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:48.759133 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:48.934337 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:48.934312 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:48.934507 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:48.934428 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:49.163374 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:49.163352 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p7ctn" Sep 19 02:42:49.933711 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:49.933683 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:49.933879 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:49.933716 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:49.933879 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:49.933822 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:49.933946 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:49.933927 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:50.166813 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:50.166785 2579 generic.go:356] "Generic (PLEG): container finished" podID="eadd361d-35a7-4c18-aa0a-7e38f9fb78c4" containerID="28f06154916063f1e14d8e18bb0ef1f89258b07d0b0e0a1bad9780647ba2e6eb" exitCode=0 Sep 19 02:42:50.167253 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:50.166865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" event={"ID":"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4","Type":"ContainerDied","Data":"28f06154916063f1e14d8e18bb0ef1f89258b07d0b0e0a1bad9780647ba2e6eb"} Sep 19 02:42:50.170952 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:50.170928 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" event={"ID":"d8991102-63cd-4f82-8c04-acd42fb82c2a","Type":"ContainerStarted","Data":"538ddc6d46dbe2b15dafac2bbb32ba66bb0bac01a715e47e51b5bb9f2260546c"} Sep 19 02:42:50.211170 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:50.211098 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" podStartSLOduration=8.592931866 podStartE2EDuration="26.211086245s" totalImagesPullingTime="17.618154379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:42:50.210940968 +0000 UTC m=+26.757423765" watchObservedRunningTime="2026-09-19 02:42:50.211086245 +0000 UTC m=+26.757569024" Sep 19 02:42:50.933734 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:50.933703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:50.933978 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:50.933822 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:51.173605 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.173432 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:51.174153 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.173684 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:51.174153 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.173734 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:51.188436 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.188370 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:51.188566 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.188505 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:42:51.380865 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.380831 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vjcgr"] Sep 19 02:42:51.380962 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.380925 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:51.381040 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:51.381023 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:51.384008 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.383980 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhbtz"] Sep 19 02:42:51.384121 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.384100 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:51.384251 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:51.384207 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:51.384649 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.384624 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7jpb8"] Sep 19 02:42:51.384781 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:51.384729 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:51.384857 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:51.384827 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:52.177424 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:52.177390 2579 generic.go:356] "Generic (PLEG): container finished" podID="eadd361d-35a7-4c18-aa0a-7e38f9fb78c4" containerID="e2e243bb43fd4b72146ebdcfa7e407a11cbe8739705c4f9537975535e9c44c52" exitCode=0 Sep 19 02:42:52.178064 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:52.177471 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" event={"ID":"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4","Type":"ContainerDied","Data":"e2e243bb43fd4b72146ebdcfa7e407a11cbe8739705c4f9537975535e9c44c52"} Sep 19 02:42:52.933979 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:52.933955 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:52.934117 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:52.934052 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:52.934117 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:52.934059 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:52.934190 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:52.934057 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:52.934190 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:52.934139 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:52.934252 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:52.934235 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:54.185311 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:54.185154 2579 generic.go:356] "Generic (PLEG): container finished" podID="eadd361d-35a7-4c18-aa0a-7e38f9fb78c4" containerID="3d60e4c0612804e8186b3f88be0b0356c5264d6b45e5ee85ef58f008be4fd292" exitCode=0 Sep 19 02:42:54.185708 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:54.185225 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" event={"ID":"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4","Type":"ContainerDied","Data":"3d60e4c0612804e8186b3f88be0b0356c5264d6b45e5ee85ef58f008be4fd292"} Sep 19 02:42:54.933557 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:54.933484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:54.933557 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:54.933506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:54.933798 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:54.933607 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:54.933798 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:54.933618 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:54.933798 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:54.933714 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:54.933965 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:54.933847 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:56.933894 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:56.933848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:56.934346 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:56.933897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:56.934346 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:56.933968 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jpb8" podUID="924b04f6-d98c-445a-ad4b-feef03aa9f67" Sep 19 02:42:56.934346 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:56.934037 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhbtz" podUID="7a53515b-9a34-4f6a-9e4c-3a27db012dfe" Sep 19 02:42:56.934346 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:56.934066 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:56.934346 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:56.934140 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjcgr" podUID="d22cd897-e0d4-4d29-8ad2-c75cd27f1a11" Sep 19 02:42:57.520884 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:57.520850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8m7d\" (UniqueName: \"kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d\") pod \"network-check-target-vjcgr\" (UID: \"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11\") " pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:57.521074 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:57.521045 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 02:42:57.521074 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:57.521076 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 02:42:57.521209 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:57.521090 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r8m7d for pod openshift-network-diagnostics/network-check-target-vjcgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:57.521209 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:57.521158 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d podName:d22cd897-e0d4-4d29-8ad2-c75cd27f1a11 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:29.521139006 +0000 UTC m=+66.067621787 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8m7d" (UniqueName: "kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d") pod "network-check-target-vjcgr" (UID: "d22cd897-e0d4-4d29-8ad2-c75cd27f1a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 02:42:57.621970 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:57.621930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:57.622151 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:57.621999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:57.622151 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:57.622108 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:57.622151 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:57.622110 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:57.622306 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:57.622174 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret podName:7a53515b-9a34-4f6a-9e4c-3a27db012dfe nodeName:}" failed. No retries permitted until 2026-09-19 02:43:29.622156743 +0000 UTC m=+66.168639537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret") pod "global-pull-secret-syncer-nhbtz" (UID: "7a53515b-9a34-4f6a-9e4c-3a27db012dfe") : object "kube-system"/"original-pull-secret" not registered Sep 19 02:42:57.622306 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:57.622196 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs podName:924b04f6-d98c-445a-ad4b-feef03aa9f67 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:29.622184915 +0000 UTC m=+66.168667691 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs") pod "network-metrics-daemon-7jpb8" (UID: "924b04f6-d98c-445a-ad4b-feef03aa9f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 02:42:58.272621 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.272601 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-27.ec2.internal" event="NodeReady" Sep 19 02:42:58.273050 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.272723 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 19 02:42:58.317347 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.317313 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fdstj"] Sep 19 02:42:58.320044 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.320029 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m9762"] Sep 19 02:42:58.320172 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.320156 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.322364 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.322339 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 19 02:42:58.322479 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.322367 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 19 02:42:58.322479 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.322367 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mlt87\"" Sep 19 02:42:58.327902 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.327408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m9762" Sep 19 02:42:58.328180 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.328161 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m9762"] Sep 19 02:42:58.330626 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.329669 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s6frz\"" Sep 19 02:42:58.330626 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.329946 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 19 02:42:58.330626 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.330148 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 19 02:42:58.330626 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.330389 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 19 02:42:58.331466 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.331447 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fdstj"] Sep 19 02:42:58.428146 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.428110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thhgv\" (UniqueName: \"kubernetes.io/projected/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-kube-api-access-thhgv\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.428253 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.428150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5747033-7ed2-4d77-a72b-5554fbd8ffe0-cert\") pod \"ingress-canary-m9762\" (UID: \"b5747033-7ed2-4d77-a72b-5554fbd8ffe0\") " pod="openshift-ingress-canary/ingress-canary-m9762" Sep 19 02:42:58.428253 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.428168 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkhvb\" (UniqueName: \"kubernetes.io/projected/b5747033-7ed2-4d77-a72b-5554fbd8ffe0-kube-api-access-zkhvb\") pod \"ingress-canary-m9762\" (UID: \"b5747033-7ed2-4d77-a72b-5554fbd8ffe0\") " pod="openshift-ingress-canary/ingress-canary-m9762" Sep 19 02:42:58.428253 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.428183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-tmp-dir\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.428351 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.428292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-config-volume\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.428351 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.428318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.528947 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.528914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-config-volume\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.529069 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.528952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.529069 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.529020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thhgv\" (UniqueName: \"kubernetes.io/projected/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-kube-api-access-thhgv\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.529069 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.529045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5747033-7ed2-4d77-a72b-5554fbd8ffe0-cert\") pod \"ingress-canary-m9762\" (UID: \"b5747033-7ed2-4d77-a72b-5554fbd8ffe0\") " pod="openshift-ingress-canary/ingress-canary-m9762" Sep 19 02:42:58.529069 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.529064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkhvb\" (UniqueName: \"kubernetes.io/projected/b5747033-7ed2-4d77-a72b-5554fbd8ffe0-kube-api-access-zkhvb\") pod \"ingress-canary-m9762\" (UID: \"b5747033-7ed2-4d77-a72b-5554fbd8ffe0\") " pod="openshift-ingress-canary/ingress-canary-m9762" Sep 19 02:42:58.529267 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.529087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-tmp-dir\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.529267 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:58.529155 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 02:42:58.529267 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:58.529226 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls podName:0a8c3901-cf7e-45de-ab56-9ac78c8d4588 nodeName:}" failed. No retries permitted until 2026-09-19 02:42:59.029206237 +0000 UTC m=+35.575689029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls") pod "dns-default-fdstj" (UID: "0a8c3901-cf7e-45de-ab56-9ac78c8d4588") : secret "dns-default-metrics-tls" not found Sep 19 02:42:58.529414 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.529385 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-tmp-dir\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.529495 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.529474 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-config-volume\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.532917 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.532892 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5747033-7ed2-4d77-a72b-5554fbd8ffe0-cert\") pod \"ingress-canary-m9762\" (UID: \"b5747033-7ed2-4d77-a72b-5554fbd8ffe0\") " pod="openshift-ingress-canary/ingress-canary-m9762" Sep 19 02:42:58.538253 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.538229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thhgv\" (UniqueName: \"kubernetes.io/projected/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-kube-api-access-thhgv\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:58.538358 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.538342 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkhvb\" (UniqueName: \"kubernetes.io/projected/b5747033-7ed2-4d77-a72b-5554fbd8ffe0-kube-api-access-zkhvb\") pod \"ingress-canary-m9762\" (UID: \"b5747033-7ed2-4d77-a72b-5554fbd8ffe0\") " pod="openshift-ingress-canary/ingress-canary-m9762" Sep 19 02:42:58.638441 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.638387 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m9762" Sep 19 02:42:58.912304 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.912215 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m9762"] Sep 19 02:42:58.916023 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:42:58.915994 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5747033_7ed2_4d77_a72b_5554fbd8ffe0.slice/crio-d230bd4aa594c9b9990eb5534a40221d7c942f2c0e068364a2cefae50efa7f34 WatchSource:0}: Error finding container d230bd4aa594c9b9990eb5534a40221d7c942f2c0e068364a2cefae50efa7f34: Status 404 returned error can't find the container with id d230bd4aa594c9b9990eb5534a40221d7c942f2c0e068364a2cefae50efa7f34 Sep 19 02:42:58.934268 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.934249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:42:58.934347 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.934249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:42:58.934433 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.934249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:42:58.937174 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.937114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 02:42:58.937269 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.937227 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 02:42:58.937269 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.937227 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 02:42:58.937362 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.937321 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2gjqm\"" Sep 19 02:42:58.937433 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.937420 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dsccn\"" Sep 19 02:42:58.937500 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:58.937485 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 02:42:59.032894 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:59.032847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:42:59.033043 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:59.032980 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 02:42:59.033082 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:42:59.033054 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls podName:0a8c3901-cf7e-45de-ab56-9ac78c8d4588 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:00.033034989 +0000 UTC m=+36.579517769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls") pod "dns-default-fdstj" (UID: "0a8c3901-cf7e-45de-ab56-9ac78c8d4588") : secret "dns-default-metrics-tls" not found Sep 19 02:42:59.199926 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:59.199856 2579 generic.go:356] "Generic (PLEG): container finished" podID="eadd361d-35a7-4c18-aa0a-7e38f9fb78c4" containerID="ce9fc709671a05346dea971e2986ec6b1e011ac939db496fa449245d935c588a" exitCode=0 Sep 19 02:42:59.200067 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:59.199939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" event={"ID":"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4","Type":"ContainerDied","Data":"ce9fc709671a05346dea971e2986ec6b1e011ac939db496fa449245d935c588a"} Sep 19 02:42:59.201200 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:42:59.201127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m9762" event={"ID":"b5747033-7ed2-4d77-a72b-5554fbd8ffe0","Type":"ContainerStarted","Data":"d230bd4aa594c9b9990eb5534a40221d7c942f2c0e068364a2cefae50efa7f34"} Sep 19 02:43:00.042162 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:00.041938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:43:00.042595 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:00.042084 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 02:43:00.042595 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:00.042251 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls podName:0a8c3901-cf7e-45de-ab56-9ac78c8d4588 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:02.042232447 +0000 UTC m=+38.588715223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls") pod "dns-default-fdstj" (UID: "0a8c3901-cf7e-45de-ab56-9ac78c8d4588") : secret "dns-default-metrics-tls" not found Sep 19 02:43:00.208313 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:00.208280 2579 generic.go:356] "Generic (PLEG): container finished" podID="eadd361d-35a7-4c18-aa0a-7e38f9fb78c4" containerID="90e8b57e5dc715d6563045feb394368dc2abade90654d4a7483c53d8de3f89f8" exitCode=0 Sep 19 02:43:00.208458 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:00.208336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" event={"ID":"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4","Type":"ContainerDied","Data":"90e8b57e5dc715d6563045feb394368dc2abade90654d4a7483c53d8de3f89f8"} Sep 19 02:43:01.215548 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:01.215467 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" event={"ID":"eadd361d-35a7-4c18-aa0a-7e38f9fb78c4","Type":"ContainerStarted","Data":"3a1166d12ca2afc92d8c672589c75a4876e04b96e11034a9d3fd430f241712e0"} Sep 19 02:43:01.237695 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:01.237652 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5xkvs" podStartSLOduration=9.432327526 podStartE2EDuration="37.23763649s" totalImagesPullingTime="27.805308964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:43:01.237103668 +0000 UTC m=+37.783586466" watchObservedRunningTime="2026-09-19 02:43:01.23763649 +0000 UTC m=+37.784119286" Sep 19 02:43:02.057934 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:02.057898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:43:02.058090 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:02.058050 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 02:43:02.058144 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:02.058132 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls podName:0a8c3901-cf7e-45de-ab56-9ac78c8d4588 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:06.058098405 +0000 UTC m=+42.604581181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls") pod "dns-default-fdstj" (UID: "0a8c3901-cf7e-45de-ab56-9ac78c8d4588") : secret "dns-default-metrics-tls" not found Sep 19 02:43:02.219628 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:02.219586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m9762" event={"ID":"b5747033-7ed2-4d77-a72b-5554fbd8ffe0","Type":"ContainerStarted","Data":"c356817c90a32c005bde7c00abf6c9871a9dca33ab7818bd16545f4fe36b1308"} Sep 19 02:43:02.235348 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:02.235294 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m9762" podStartSLOduration=1.868429859 podStartE2EDuration="4.235279155s" totalImagesPullingTime="2.366849296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:43:02.234525862 +0000 UTC m=+38.781008660" watchObservedRunningTime="2026-09-19 02:43:02.235279155 +0000 UTC m=+38.781761943" Sep 19 02:43:06.085106 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:06.085069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:43:06.085477 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:06.085216 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 02:43:06.085477 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:06.085277 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls podName:0a8c3901-cf7e-45de-ab56-9ac78c8d4588 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:14.085261398 +0000 UTC m=+50.631744177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls") pod "dns-default-fdstj" (UID: "0a8c3901-cf7e-45de-ab56-9ac78c8d4588") : secret "dns-default-metrics-tls" not found Sep 19 02:43:14.136501 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:14.136461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:43:14.136931 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:14.136598 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 02:43:14.136931 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:14.136667 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls podName:0a8c3901-cf7e-45de-ab56-9ac78c8d4588 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:30.136651657 +0000 UTC m=+66.683134433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls") pod "dns-default-fdstj" (UID: "0a8c3901-cf7e-45de-ab56-9ac78c8d4588") : secret "dns-default-metrics-tls" not found Sep 19 02:43:23.190736 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:23.190697 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gsmzv" Sep 19 02:43:27.106436 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.106401 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx"] Sep 19 02:43:27.110231 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.110214 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx" Sep 19 02:43:27.113078 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.113054 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vt7rp\"" Sep 19 02:43:27.113194 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.113054 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 19 02:43:27.113502 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.113488 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd"] Sep 19 02:43:27.113602 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.113584 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 19 02:43:27.116195 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.116175 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-8bmqw"] Sep 19 02:43:27.116319 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.116301 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:27.117205 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.116976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94cln\" (UniqueName: \"kubernetes.io/projected/70555ce4-b805-4e31-8e3d-03ee5495a2a7-kube-api-access-94cln\") pod \"volume-data-source-validator-5c4db8bdf9-q7gsx\" (UID: \"70555ce4-b805-4e31-8e3d-03ee5495a2a7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx" Sep 19 02:43:27.118905 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.118885 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 19 02:43:27.119022 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.118916 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 19 02:43:27.119022 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.118962 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 19 02:43:27.119022 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.118992 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ttx6w\"" Sep 19 02:43:27.119206 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.119177 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx"] Sep 19 02:43:27.119258 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.119250 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.120025 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.120004 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 19 02:43:27.121561 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.121543 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-svb77\"" Sep 19 02:43:27.121657 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.121570 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 19 02:43:27.121657 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.121578 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 19 02:43:27.121992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.121974 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 19 02:43:27.122361 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.122345 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 19 02:43:27.130636 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.130613 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-8bmqw"] Sep 19 02:43:27.130840 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.130826 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd"] Sep 19 02:43:27.132553 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.132536 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 19 02:43:27.214684 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.214652 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-vww7w"] Sep 19 02:43:27.217529 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.217506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.217657 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.217626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ad93860-508d-4204-ad22-24ddca59afa9-config\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.217903 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.217867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:27.218106 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.218059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94cln\" (UniqueName: \"kubernetes.io/projected/70555ce4-b805-4e31-8e3d-03ee5495a2a7-kube-api-access-94cln\") pod \"volume-data-source-validator-5c4db8bdf9-q7gsx\" (UID: \"70555ce4-b805-4e31-8e3d-03ee5495a2a7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx" Sep 19 02:43:27.218247 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.218097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:27.218315 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.218263 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzq84\" (UniqueName: \"kubernetes.io/projected/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-kube-api-access-zzq84\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:27.218375 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.218348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ad93860-508d-4204-ad22-24ddca59afa9-serving-cert\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.218429 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.218380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ad93860-508d-4204-ad22-24ddca59afa9-trusted-ca\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.218429 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.218414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8lr6\" (UniqueName: \"kubernetes.io/projected/6ad93860-508d-4204-ad22-24ddca59afa9-kube-api-access-p8lr6\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.219829 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.219811 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 19 02:43:27.219916 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.219831 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 19 02:43:27.220124 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.220109 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qvbp5\"" Sep 19 02:43:27.220124 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.220118 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 19 02:43:27.220248 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.220118 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 19 02:43:27.225281 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.225264 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 19 02:43:27.231596 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.231574 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-vww7w"] Sep 19 02:43:27.236503 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.236486 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94cln\" (UniqueName: \"kubernetes.io/projected/70555ce4-b805-4e31-8e3d-03ee5495a2a7-kube-api-access-94cln\") pod \"volume-data-source-validator-5c4db8bdf9-q7gsx\" (UID: \"70555ce4-b805-4e31-8e3d-03ee5495a2a7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx" Sep 19 02:43:27.309265 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.309232 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-976f6c564-979qp"] Sep 19 02:43:27.312130 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.312112 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.314202 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.314179 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 19 02:43:27.314441 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.314425 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ssr6h\"" Sep 19 02:43:27.314529 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.314456 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 19 02:43:27.314595 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.314530 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 19 02:43:27.314595 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.314586 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 19 02:43:27.314722 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.314708 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 19 02:43:27.315063 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.315047 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 19 02:43:27.318904 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.318883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8d1df1-7e9a-4144-b668-4cc3e1567102-serving-cert\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.318991 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.318919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.318991 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.318941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ad93860-508d-4204-ad22-24ddca59afa9-config\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.318991 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.318979 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8d1df1-7e9a-4144-b668-4cc3e1567102-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.319135 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmjgq\" (UniqueName: \"kubernetes.io/projected/1f8d1df1-7e9a-4144-b668-4cc3e1567102-kube-api-access-xmjgq\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.319135 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98mgq\" (UniqueName: \"kubernetes.io/projected/432e30df-07e6-4293-bc8c-b9e6631d6324-kube-api-access-98mgq\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.319195 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:27.319195 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f8d1df1-7e9a-4144-b668-4cc3e1567102-tmp\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.319269 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-stats-auth\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.319269 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f8d1df1-7e9a-4144-b668-4cc3e1567102-snapshots\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.319269 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8d1df1-7e9a-4144-b668-4cc3e1567102-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.319356 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:27.319356 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319310 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzq84\" (UniqueName: \"kubernetes.io/projected/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-kube-api-access-zzq84\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:27.319455 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ad93860-508d-4204-ad22-24ddca59afa9-serving-cert\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.319455 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:27.319378 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:27.319455 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ad93860-508d-4204-ad22-24ddca59afa9-trusted-ca\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.319455 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8lr6\" (UniqueName: \"kubernetes.io/projected/6ad93860-508d-4204-ad22-24ddca59afa9-kube-api-access-p8lr6\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.319455 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:27.319427 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls podName:7cb3cf59-75d2-4c10-8d9c-a95558e93a9d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:27.819414057 +0000 UTC m=+64.365896833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-jdqpd" (UID: "7cb3cf59-75d2-4c10-8d9c-a95558e93a9d") : secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:27.319610 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ad93860-508d-4204-ad22-24ddca59afa9-config\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.319650 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.319650 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319643 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-default-certificate\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.319914 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.319891 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:27.320592 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.320575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ad93860-508d-4204-ad22-24ddca59afa9-trusted-ca\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.321744 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.321726 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ad93860-508d-4204-ad22-24ddca59afa9-serving-cert\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.325144 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.325122 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-976f6c564-979qp"] Sep 19 02:43:27.332502 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.332485 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8lr6\" (UniqueName: \"kubernetes.io/projected/6ad93860-508d-4204-ad22-24ddca59afa9-kube-api-access-p8lr6\") pod \"console-operator-fd4bb46c-8bmqw\" (UID: \"6ad93860-508d-4204-ad22-24ddca59afa9\") " pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.335702 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.335678 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzq84\" (UniqueName: \"kubernetes.io/projected/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-kube-api-access-zzq84\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:27.420595 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.420575 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx" Sep 19 02:43:27.420714 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.420695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8d1df1-7e9a-4144-b668-4cc3e1567102-serving-cert\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.420757 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.420723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.420757 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.420742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8d1df1-7e9a-4144-b668-4cc3e1567102-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.420757 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.420758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjgq\" (UniqueName: \"kubernetes.io/projected/1f8d1df1-7e9a-4144-b668-4cc3e1567102-kube-api-access-xmjgq\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.420930 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.420793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98mgq\" (UniqueName: \"kubernetes.io/projected/432e30df-07e6-4293-bc8c-b9e6631d6324-kube-api-access-98mgq\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.420930 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.420833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f8d1df1-7e9a-4144-b668-4cc3e1567102-tmp\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.420930 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.420851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-stats-auth\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.420930 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:27.420863 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 02:43:27.420930 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.420876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f8d1df1-7e9a-4144-b668-4cc3e1567102-snapshots\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.420930 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.420901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8d1df1-7e9a-4144-b668-4cc3e1567102-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.420930 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:27.420918 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:27.920901373 +0000 UTC m=+64.467384162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : secret "router-metrics-certs-default" not found Sep 19 02:43:27.421257 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.421003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.421257 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.421031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-default-certificate\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.421390 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:27.421368 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:27.92134954 +0000 UTC m=+64.467832317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : configmap references non-existent config key: service-ca.crt Sep 19 02:43:27.421459 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.421373 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8d1df1-7e9a-4144-b668-4cc3e1567102-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.421512 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.421463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f8d1df1-7e9a-4144-b668-4cc3e1567102-tmp\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.421775 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.421737 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8d1df1-7e9a-4144-b668-4cc3e1567102-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.421944 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.421923 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f8d1df1-7e9a-4144-b668-4cc3e1567102-snapshots\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.423057 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.423036 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8d1df1-7e9a-4144-b668-4cc3e1567102-serving-cert\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.423361 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.423344 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-stats-auth\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.423409 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.423383 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-default-certificate\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.430790 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.430752 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98mgq\" (UniqueName: \"kubernetes.io/projected/432e30df-07e6-4293-bc8c-b9e6631d6324-kube-api-access-98mgq\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.430867 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.430830 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmjgq\" (UniqueName: \"kubernetes.io/projected/1f8d1df1-7e9a-4144-b668-4cc3e1567102-kube-api-access-xmjgq\") pod \"insights-operator-6f9c644dd9-vww7w\" (UID: \"1f8d1df1-7e9a-4144-b668-4cc3e1567102\") " pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.437615 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.437595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:27.526320 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.526289 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" Sep 19 02:43:27.690121 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.690057 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx"] Sep 19 02:43:27.693049 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:43:27.693019 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70555ce4_b805_4e31_8e3d_03ee5495a2a7.slice/crio-c2962e80a50d6ae82aa3be3613c1593600cad64fb5593077100dade6c1dc79bc WatchSource:0}: Error finding container c2962e80a50d6ae82aa3be3613c1593600cad64fb5593077100dade6c1dc79bc: Status 404 returned error can't find the container with id c2962e80a50d6ae82aa3be3613c1593600cad64fb5593077100dade6c1dc79bc Sep 19 02:43:27.710472 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.710447 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-8bmqw"] Sep 19 02:43:27.712634 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:43:27.712613 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad93860_508d_4204_ad22_24ddca59afa9.slice/crio-26d5a84667cd2e4e9faba04286f0f1a17152b6fac9046794747a46713f4442c5 WatchSource:0}: Error finding container 26d5a84667cd2e4e9faba04286f0f1a17152b6fac9046794747a46713f4442c5: Status 404 returned error can't find the container with id 26d5a84667cd2e4e9faba04286f0f1a17152b6fac9046794747a46713f4442c5 Sep 19 02:43:27.790533 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.790503 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-vww7w"] Sep 19 02:43:27.793295 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:43:27.793272 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8d1df1_7e9a_4144_b668_4cc3e1567102.slice/crio-c079c75607a21a74afaf57f0221cc69088cd5ee903f5715a2817c6e5cb995b7e WatchSource:0}: Error finding container c079c75607a21a74afaf57f0221cc69088cd5ee903f5715a2817c6e5cb995b7e: Status 404 returned error can't find the container with id c079c75607a21a74afaf57f0221cc69088cd5ee903f5715a2817c6e5cb995b7e Sep 19 02:43:27.824746 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.824721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:27.824841 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:27.824833 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:27.824889 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:27.824880 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls podName:7cb3cf59-75d2-4c10-8d9c-a95558e93a9d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:28.824866904 +0000 UTC m=+65.371349679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-jdqpd" (UID: "7cb3cf59-75d2-4c10-8d9c-a95558e93a9d") : secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:27.925773 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.925740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.925869 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:27.925839 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:27.925919 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:27.925901 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 02:43:27.925969 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:27.925960 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:28.925944463 +0000 UTC m=+65.472427239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : secret "router-metrics-certs-default" not found Sep 19 02:43:27.926020 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:27.925975 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:28.925969397 +0000 UTC m=+65.472452177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : configmap references non-existent config key: service-ca.crt Sep 19 02:43:28.281880 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:28.281823 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" event={"ID":"6ad93860-508d-4204-ad22-24ddca59afa9","Type":"ContainerStarted","Data":"26d5a84667cd2e4e9faba04286f0f1a17152b6fac9046794747a46713f4442c5"} Sep 19 02:43:28.283440 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:28.283375 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" event={"ID":"1f8d1df1-7e9a-4144-b668-4cc3e1567102","Type":"ContainerStarted","Data":"c079c75607a21a74afaf57f0221cc69088cd5ee903f5715a2817c6e5cb995b7e"} Sep 19 02:43:28.284928 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:28.284881 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx" event={"ID":"70555ce4-b805-4e31-8e3d-03ee5495a2a7","Type":"ContainerStarted","Data":"c2962e80a50d6ae82aa3be3613c1593600cad64fb5593077100dade6c1dc79bc"} Sep 19 02:43:28.834281 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:28.834241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:28.834446 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:28.834397 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:28.834507 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:28.834475 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls podName:7cb3cf59-75d2-4c10-8d9c-a95558e93a9d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:30.834453352 +0000 UTC m=+67.380936142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-jdqpd" (UID: "7cb3cf59-75d2-4c10-8d9c-a95558e93a9d") : secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:28.935088 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:28.935038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:28.935263 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:28.935111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:28.935263 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:28.935230 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:30.935208622 +0000 UTC m=+67.481691401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : configmap references non-existent config key: service-ca.crt Sep 19 02:43:28.935263 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:28.935233 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 02:43:28.935423 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:28.935284 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:30.935273583 +0000 UTC m=+67.481756361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : secret "router-metrics-certs-default" not found Sep 19 02:43:29.540688 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.540652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8m7d\" (UniqueName: \"kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d\") pod \"network-check-target-vjcgr\" (UID: \"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11\") " pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:43:29.543488 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.543464 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 02:43:29.553525 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.553504 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 02:43:29.564916 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.564891 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8m7d\" (UniqueName: \"kubernetes.io/projected/d22cd897-e0d4-4d29-8ad2-c75cd27f1a11-kube-api-access-r8m7d\") pod \"network-check-target-vjcgr\" (UID: \"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11\") " pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:43:29.642135 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.642096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:43:29.642332 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.642306 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:43:29.644594 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.644569 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 02:43:29.644721 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.644622 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 02:43:29.652528 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:29.652503 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 19 02:43:29.652629 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:29.652578 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs podName:924b04f6-d98c-445a-ad4b-feef03aa9f67 nodeName:}" failed. No retries permitted until 2026-09-19 02:44:33.652556066 +0000 UTC m=+130.199038851 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs") pod "network-metrics-daemon-7jpb8" (UID: "924b04f6-d98c-445a-ad4b-feef03aa9f67") : secret "metrics-daemon-secret" not found Sep 19 02:43:29.654922 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.654901 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a53515b-9a34-4f6a-9e4c-3a27db012dfe-original-pull-secret\") pod \"global-pull-secret-syncer-nhbtz\" (UID: \"7a53515b-9a34-4f6a-9e4c-3a27db012dfe\") " pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:43:29.849586 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.849522 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhbtz" Sep 19 02:43:29.856491 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.856461 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2gjqm\"" Sep 19 02:43:29.864301 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:29.864280 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:43:30.145142 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:30.145059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:43:30.145290 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:30.145200 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 02:43:30.145290 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:30.145272 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls podName:0a8c3901-cf7e-45de-ab56-9ac78c8d4588 nodeName:}" failed. No retries permitted until 2026-09-19 02:44:02.145253351 +0000 UTC m=+98.691736130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls") pod "dns-default-fdstj" (UID: "0a8c3901-cf7e-45de-ab56-9ac78c8d4588") : secret "dns-default-metrics-tls" not found Sep 19 02:43:30.553233 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:30.553033 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vjcgr"] Sep 19 02:43:30.553882 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:30.553826 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhbtz"] Sep 19 02:43:30.556917 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:43:30.556894 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a53515b_9a34_4f6a_9e4c_3a27db012dfe.slice/crio-cc3570aa00586dd22206ddbef1dc9cc5ec2bbd0600e69fde784d28c3c248132f WatchSource:0}: Error finding container cc3570aa00586dd22206ddbef1dc9cc5ec2bbd0600e69fde784d28c3c248132f: Status 404 returned error can't find the container with id cc3570aa00586dd22206ddbef1dc9cc5ec2bbd0600e69fde784d28c3c248132f Sep 19 02:43:30.557460 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:43:30.557440 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22cd897_e0d4_4d29_8ad2_c75cd27f1a11.slice/crio-c5d7041fdce8fdd1b4e041b232d2630baecaf5193bdc7abbb42d1dc52c44fbac WatchSource:0}: Error finding container c5d7041fdce8fdd1b4e041b232d2630baecaf5193bdc7abbb42d1dc52c44fbac: Status 404 returned error can't find the container with id c5d7041fdce8fdd1b4e041b232d2630baecaf5193bdc7abbb42d1dc52c44fbac Sep 19 02:43:30.850302 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:30.850218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:30.850427 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:30.850332 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:30.850427 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:30.850384 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls podName:7cb3cf59-75d2-4c10-8d9c-a95558e93a9d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:34.850370883 +0000 UTC m=+71.396853658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-jdqpd" (UID: "7cb3cf59-75d2-4c10-8d9c-a95558e93a9d") : secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:30.950937 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:30.950894 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:30.951125 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:30.951085 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 02:43:30.951125 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:30.951118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:30.951247 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:30.951153 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:34.951133311 +0000 UTC m=+71.497616100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : secret "router-metrics-certs-default" not found Sep 19 02:43:30.951247 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:30.951227 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:34.951211274 +0000 UTC m=+71.497694064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : configmap references non-existent config key: service-ca.crt Sep 19 02:43:31.296549 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.296511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" event={"ID":"1f8d1df1-7e9a-4144-b668-4cc3e1567102","Type":"ContainerStarted","Data":"042b6ddec97ad4e7679a45304213693571ac650616c659df7875ec4268249b14"} Sep 19 02:43:31.299875 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.299840 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx" event={"ID":"70555ce4-b805-4e31-8e3d-03ee5495a2a7","Type":"ContainerStarted","Data":"f80f52e5d495cfecfbf66483810e8c13b11e255e4e77790d6b9722e186720789"} Sep 19 02:43:31.301914 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.301746 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/0.log" Sep 19 02:43:31.301914 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.301798 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ad93860-508d-4204-ad22-24ddca59afa9" containerID="d7c310da00cd8d21e408ab34d5f396553dabb66742858936da18c7737762ff62" exitCode=255 Sep 19 02:43:31.301914 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.301837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" event={"ID":"6ad93860-508d-4204-ad22-24ddca59afa9","Type":"ContainerDied","Data":"d7c310da00cd8d21e408ab34d5f396553dabb66742858936da18c7737762ff62"} Sep 19 02:43:31.302490 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.302124 2579 scope.go:117] "RemoveContainer" containerID="d7c310da00cd8d21e408ab34d5f396553dabb66742858936da18c7737762ff62" Sep 19 02:43:31.304226 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.304162 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhbtz" event={"ID":"7a53515b-9a34-4f6a-9e4c-3a27db012dfe","Type":"ContainerStarted","Data":"cc3570aa00586dd22206ddbef1dc9cc5ec2bbd0600e69fde784d28c3c248132f"} Sep 19 02:43:31.306151 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.306127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vjcgr" event={"ID":"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11","Type":"ContainerStarted","Data":"c5d7041fdce8fdd1b4e041b232d2630baecaf5193bdc7abbb42d1dc52c44fbac"} Sep 19 02:43:31.313469 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.313224 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" podStartSLOduration=1.8302820770000001 podStartE2EDuration="4.313204878s" totalImagesPullingTime="2.482922801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:43:31.311690461 +0000 UTC m=+67.858173258" watchObservedRunningTime="2026-09-19 02:43:31.313204878 +0000 UTC m=+67.859687680" Sep 19 02:43:31.340186 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.340140 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-q7gsx" podStartSLOduration=1.7651792149999999 podStartE2EDuration="4.340120643s" totalImagesPullingTime="2.574941428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:43:31.339948887 +0000 UTC m=+67.886431686" watchObservedRunningTime="2026-09-19 02:43:31.340120643 +0000 UTC m=+67.886603440" Sep 19 02:43:31.465734 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.465704 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99"] Sep 19 02:43:31.468979 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.468953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99" Sep 19 02:43:31.471408 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.471388 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 19 02:43:31.471539 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.471393 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 19 02:43:31.471588 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.471523 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sv7hj\"" Sep 19 02:43:31.477326 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.477153 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99"] Sep 19 02:43:31.557924 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.557827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl7d2\" (UniqueName: \"kubernetes.io/projected/2b054038-9f86-4006-88f1-97c1b76891f0-kube-api-access-kl7d2\") pod \"migrator-76794cbd6c-t9b99\" (UID: \"2b054038-9f86-4006-88f1-97c1b76891f0\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99" Sep 19 02:43:31.658402 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.658364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl7d2\" (UniqueName: \"kubernetes.io/projected/2b054038-9f86-4006-88f1-97c1b76891f0-kube-api-access-kl7d2\") pod \"migrator-76794cbd6c-t9b99\" (UID: \"2b054038-9f86-4006-88f1-97c1b76891f0\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99" Sep 19 02:43:31.666432 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.666407 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl7d2\" (UniqueName: \"kubernetes.io/projected/2b054038-9f86-4006-88f1-97c1b76891f0-kube-api-access-kl7d2\") pod \"migrator-76794cbd6c-t9b99\" (UID: \"2b054038-9f86-4006-88f1-97c1b76891f0\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99" Sep 19 02:43:31.813822 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:31.813736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99" Sep 19 02:43:32.007136 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.007100 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tbwxd"] Sep 19 02:43:32.011808 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.011753 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.014234 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.014215 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wx8bd\"" Sep 19 02:43:32.014234 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.014227 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 19 02:43:32.014524 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.014485 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 19 02:43:32.025645 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.025621 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tbwxd"] Sep 19 02:43:32.064170 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.064097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-data-volume\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.064170 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.064140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.064360 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.064185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.064360 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.064250 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-crio-socket\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.064360 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.064331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tksxt\" (UniqueName: \"kubernetes.io/projected/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-api-access-tksxt\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.098316 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.098284 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99"] Sep 19 02:43:32.103653 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:43:32.103623 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b054038_9f86_4006_88f1_97c1b76891f0.slice/crio-943cc8d86bbd6b8c729247e3c9f51d06fdda0d93bdafb6ea8c02e36c017f69ce WatchSource:0}: Error finding container 943cc8d86bbd6b8c729247e3c9f51d06fdda0d93bdafb6ea8c02e36c017f69ce: Status 404 returned error can't find the container with id 943cc8d86bbd6b8c729247e3c9f51d06fdda0d93bdafb6ea8c02e36c017f69ce Sep 19 02:43:32.164874 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.164848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.165040 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.164891 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-crio-socket\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.165040 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.164957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tksxt\" (UniqueName: \"kubernetes.io/projected/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-api-access-tksxt\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.165040 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.165034 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-data-volume\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.165183 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.165064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.165233 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:32.165198 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 02:43:32.165282 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:32.165257 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls podName:1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:32.665238681 +0000 UTC m=+69.211721479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tbwxd" (UID: "1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d") : secret "insights-runtime-extractor-tls" not found Sep 19 02:43:32.165493 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:32.165466 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 02:43:32.165581 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.165502 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-crio-socket\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.165581 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:32.165542 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm podName:1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:32.665524801 +0000 UTC m=+69.212007589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tbwxd" (UID: "1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d") : configmap "kube-rbac-proxy" not found Sep 19 02:43:32.165744 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.165721 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-data-volume\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.174165 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.174121 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tksxt\" (UniqueName: \"kubernetes.io/projected/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-api-access-tksxt\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.312176 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.312145 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/1.log" Sep 19 02:43:32.312739 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.312716 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/0.log" Sep 19 02:43:32.312857 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.312791 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ad93860-508d-4204-ad22-24ddca59afa9" containerID="f16e14309c92f24fea7ef2cb3b014527935bbaaf086c2a075f084b606eeda10b" exitCode=255 Sep 19 02:43:32.312909 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.312873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" event={"ID":"6ad93860-508d-4204-ad22-24ddca59afa9","Type":"ContainerDied","Data":"f16e14309c92f24fea7ef2cb3b014527935bbaaf086c2a075f084b606eeda10b"} Sep 19 02:43:32.312966 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.312939 2579 scope.go:117] "RemoveContainer" containerID="d7c310da00cd8d21e408ab34d5f396553dabb66742858936da18c7737762ff62" Sep 19 02:43:32.313110 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.313090 2579 scope.go:117] "RemoveContainer" containerID="f16e14309c92f24fea7ef2cb3b014527935bbaaf086c2a075f084b606eeda10b" Sep 19 02:43:32.313322 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:32.313294 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-8bmqw_openshift-console-operator(6ad93860-508d-4204-ad22-24ddca59afa9)\"" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" podUID="6ad93860-508d-4204-ad22-24ddca59afa9" Sep 19 02:43:32.314902 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.314872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99" event={"ID":"2b054038-9f86-4006-88f1-97c1b76891f0","Type":"ContainerStarted","Data":"943cc8d86bbd6b8c729247e3c9f51d06fdda0d93bdafb6ea8c02e36c017f69ce"} Sep 19 02:43:32.670326 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.670281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.670326 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:32.670355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:32.671034 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:32.670447 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 02:43:32.671034 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:32.670475 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 02:43:32.671034 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:32.670513 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm podName:1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:33.670494049 +0000 UTC m=+70.216976832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tbwxd" (UID: "1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d") : configmap "kube-rbac-proxy" not found Sep 19 02:43:32.671034 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:32.670541 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls podName:1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:33.670523159 +0000 UTC m=+70.217005949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tbwxd" (UID: "1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d") : secret "insights-runtime-extractor-tls" not found Sep 19 02:43:33.319203 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:33.319176 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/1.log" Sep 19 02:43:33.319573 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:33.319547 2579 scope.go:117] "RemoveContainer" containerID="f16e14309c92f24fea7ef2cb3b014527935bbaaf086c2a075f084b606eeda10b" Sep 19 02:43:33.319737 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:33.319712 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-8bmqw_openshift-console-operator(6ad93860-508d-4204-ad22-24ddca59afa9)\"" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" podUID="6ad93860-508d-4204-ad22-24ddca59afa9" Sep 19 02:43:33.679493 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:33.679452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:33.680000 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:33.679511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:33.680000 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:33.679615 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 02:43:33.680000 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:33.679625 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 02:43:33.680000 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:33.679675 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm podName:1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:35.679656412 +0000 UTC m=+72.226139191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tbwxd" (UID: "1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d") : configmap "kube-rbac-proxy" not found Sep 19 02:43:33.680000 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:33.679691 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls podName:1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:35.679683106 +0000 UTC m=+72.226165882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tbwxd" (UID: "1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d") : secret "insights-runtime-extractor-tls" not found Sep 19 02:43:34.779311 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:34.779282 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j58r8_94c0cdbe-b80a-40be-816b-c1efdaebada8/dns-node-resolver/0.log" Sep 19 02:43:34.889261 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:34.889223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:34.889439 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:34.889404 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:34.889500 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:34.889488 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls podName:7cb3cf59-75d2-4c10-8d9c-a95558e93a9d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:42.889465721 +0000 UTC m=+79.435948501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-jdqpd" (UID: "7cb3cf59-75d2-4c10-8d9c-a95558e93a9d") : secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:34.989953 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:34.989914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:34.990121 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:34.989988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:34.990121 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:34.990088 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 02:43:34.990230 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:34.990125 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:42.990101163 +0000 UTC m=+79.536583953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : configmap references non-existent config key: service-ca.crt Sep 19 02:43:34.990230 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:34.990154 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:42.990143814 +0000 UTC m=+79.536626595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : secret "router-metrics-certs-default" not found Sep 19 02:43:35.579560 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:35.579527 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7d4rq_6fdc1553-466c-416d-8218-0ef10191b152/node-ca/0.log" Sep 19 02:43:35.696307 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:35.696261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:35.696307 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:35.696312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:35.696519 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:35.696411 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 02:43:35.696519 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:35.696412 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 02:43:35.696519 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:35.696465 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm podName:1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:39.69645131 +0000 UTC m=+76.242934085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tbwxd" (UID: "1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d") : configmap "kube-rbac-proxy" not found Sep 19 02:43:35.696519 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:35.696477 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls podName:1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:39.696471357 +0000 UTC m=+76.242954133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tbwxd" (UID: "1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d") : secret "insights-runtime-extractor-tls" not found Sep 19 02:43:36.332993 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:36.332952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99" event={"ID":"2b054038-9f86-4006-88f1-97c1b76891f0","Type":"ContainerStarted","Data":"1185635212a4b9bf30baee48ad68bd5e469b059b9f63fb0bf91b039f2ad3f7a6"} Sep 19 02:43:36.333434 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:36.333039 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99" event={"ID":"2b054038-9f86-4006-88f1-97c1b76891f0","Type":"ContainerStarted","Data":"48b54f276f9a16ace8f31bfa2ecfe8b17efb8211c01d1d9474c8f9d98057b0bf"} Sep 19 02:43:36.334408 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:36.334382 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhbtz" event={"ID":"7a53515b-9a34-4f6a-9e4c-3a27db012dfe","Type":"ContainerStarted","Data":"4f9f3d96ddb4e18c4f4b0fc3256f88f6712b1c348f8cfa95598512be53268273"} Sep 19 02:43:36.335780 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:36.335736 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vjcgr" event={"ID":"d22cd897-e0d4-4d29-8ad2-c75cd27f1a11","Type":"ContainerStarted","Data":"5cccf44454444004a421e1bf1cfddefa05b4fb53c77a0b0a3a67fd027ebe98ce"} Sep 19 02:43:36.335892 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:36.335875 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:43:36.350495 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:36.350452 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-t9b99" podStartSLOduration=2.07233468 podStartE2EDuration="5.350440146s" totalImagesPullingTime="3.278105466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:43:36.350056347 +0000 UTC m=+72.896539145" watchObservedRunningTime="2026-09-19 02:43:36.350440146 +0000 UTC m=+72.896922944" Sep 19 02:43:36.368127 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:36.368090 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vjcgr" podStartSLOduration=67.543659228 podStartE2EDuration="1m12.368078759s" totalImagesPullingTime="4.824419531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:43:36.367789814 +0000 UTC m=+72.914272609" watchObservedRunningTime="2026-09-19 02:43:36.368078759 +0000 UTC m=+72.914561557" Sep 19 02:43:36.384431 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:36.384393 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nhbtz" podStartSLOduration=67.54475533 podStartE2EDuration="1m12.384379226s" totalImagesPullingTime="4.839623896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:43:36.383745327 +0000 UTC m=+72.930228125" watchObservedRunningTime="2026-09-19 02:43:36.384379226 +0000 UTC m=+72.930862023" Sep 19 02:43:36.580019 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:36.579990 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m9762_b5747033-7ed2-4d77-a72b-5554fbd8ffe0/serve-healthcheck-canary/0.log" Sep 19 02:43:36.988585 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:36.988553 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-t9b99_2b054038-9f86-4006-88f1-97c1b76891f0/migrator/0.log" Sep 19 02:43:37.178779 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:37.178744 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-t9b99_2b054038-9f86-4006-88f1-97c1b76891f0/graceful-termination/0.log" Sep 19 02:43:37.438061 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:37.438032 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:37.438426 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:37.438087 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:37.438426 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:37.438401 2579 scope.go:117] "RemoveContainer" containerID="f16e14309c92f24fea7ef2cb3b014527935bbaaf086c2a075f084b606eeda10b" Sep 19 02:43:37.438565 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:37.438545 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-8bmqw_openshift-console-operator(6ad93860-508d-4204-ad22-24ddca59afa9)\"" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" podUID="6ad93860-508d-4204-ad22-24ddca59afa9" Sep 19 02:43:39.726126 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:39.726085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:39.726545 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:39.726135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:39.726545 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:39.726207 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 02:43:39.726545 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:39.726257 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm podName:1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:47.726243769 +0000 UTC m=+84.272726545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tbwxd" (UID: "1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d") : configmap "kube-rbac-proxy" not found Sep 19 02:43:39.726545 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:39.726261 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 02:43:39.726545 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:39.726328 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls podName:1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:47.726311318 +0000 UTC m=+84.272794095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tbwxd" (UID: "1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d") : secret "insights-runtime-extractor-tls" not found Sep 19 02:43:42.950421 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:42.950381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:42.950835 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:42.950519 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:42.950835 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:42.950585 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls podName:7cb3cf59-75d2-4c10-8d9c-a95558e93a9d nodeName:}" failed. No retries permitted until 2026-09-19 02:43:58.950570503 +0000 UTC m=+95.497053279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-jdqpd" (UID: "7cb3cf59-75d2-4c10-8d9c-a95558e93a9d") : secret "cluster-monitoring-operator-tls" not found Sep 19 02:43:43.050971 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:43.050942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:43.051122 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:43.051039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:43.051174 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:43:43.051163 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle podName:432e30df-07e6-4293-bc8c-b9e6631d6324 nodeName:}" failed. No retries permitted until 2026-09-19 02:43:59.051147063 +0000 UTC m=+95.597629844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle") pod "router-default-976f6c564-979qp" (UID: "432e30df-07e6-4293-bc8c-b9e6631d6324") : configmap references non-existent config key: service-ca.crt Sep 19 02:43:43.053276 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:43.053247 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/432e30df-07e6-4293-bc8c-b9e6631d6324-metrics-certs\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:47.789500 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:47.789368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:47.789500 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:47.789482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:47.789963 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:47.789940 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:47.791755 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:47.791733 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tbwxd\" (UID: \"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d\") " pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:47.922856 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:47.922825 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tbwxd" Sep 19 02:43:48.189813 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:48.189781 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tbwxd"] Sep 19 02:43:48.192686 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:43:48.192661 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1aae18_5911_4cf9_96aa_eb7a7c5a4d2d.slice/crio-6552d593245ad46fe54fd40bb70087aabdb42ba620b6c14b4530a736950e5cb9 WatchSource:0}: Error finding container 6552d593245ad46fe54fd40bb70087aabdb42ba620b6c14b4530a736950e5cb9: Status 404 returned error can't find the container with id 6552d593245ad46fe54fd40bb70087aabdb42ba620b6c14b4530a736950e5cb9 Sep 19 02:43:48.373845 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:48.373809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tbwxd" event={"ID":"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d","Type":"ContainerStarted","Data":"76233636233fc89b17d05b7d4ce8ad7cbd72757fa4649c1f9c068ec3af125e62"} Sep 19 02:43:48.374017 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:48.373877 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tbwxd" event={"ID":"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d","Type":"ContainerStarted","Data":"6552d593245ad46fe54fd40bb70087aabdb42ba620b6c14b4530a736950e5cb9"} Sep 19 02:43:49.379430 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:49.379389 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tbwxd" event={"ID":"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d","Type":"ContainerStarted","Data":"5b5272f5403fa83a8b05218b272583ac267aa9be41d5f921ae18e0dbf61c9caf"} Sep 19 02:43:50.383917 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:50.383879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tbwxd" event={"ID":"1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d","Type":"ContainerStarted","Data":"28f321ea36c94c31945178298aa24a28773da79d7bdffeb65bb3849960c37b53"} Sep 19 02:43:50.403830 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:50.403747 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tbwxd" podStartSLOduration=17.531521133 podStartE2EDuration="19.403724867s" totalImagesPullingTime="1.872203734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 02:43:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:43:50.402345999 +0000 UTC m=+86.948828808" watchObservedRunningTime="2026-09-19 02:43:50.403724867 +0000 UTC m=+86.950207666" Sep 19 02:43:50.934783 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:50.934739 2579 scope.go:117] "RemoveContainer" containerID="f16e14309c92f24fea7ef2cb3b014527935bbaaf086c2a075f084b606eeda10b" Sep 19 02:43:51.388559 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:51.388487 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/1.log" Sep 19 02:43:51.388925 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:51.388608 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" event={"ID":"6ad93860-508d-4204-ad22-24ddca59afa9","Type":"ContainerStarted","Data":"5fbe89e73053679c7522144eb21f426b90fa86a8a3086f0d5f27f8f1b9e9ad7d"} Sep 19 02:43:51.389033 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:51.389013 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:51.406630 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:51.406588 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" podStartSLOduration=21.837166598 podStartE2EDuration="24.406575309s" totalImagesPullingTime="2.569408711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:43:51.405820073 +0000 UTC m=+87.952302868" watchObservedRunningTime="2026-09-19 02:43:51.406575309 +0000 UTC m=+87.953058107" Sep 19 02:43:51.689013 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:51.688979 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-8bmqw" Sep 19 02:43:57.344707 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.344667 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb"] Sep 19 02:43:57.347616 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.347600 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" Sep 19 02:43:57.351057 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.351027 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 19 02:43:57.351225 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.351171 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mkncx\"" Sep 19 02:43:57.351225 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.351201 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 19 02:43:57.351384 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.351181 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 19 02:43:57.351384 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.351273 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 19 02:43:57.360851 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.360830 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb"] Sep 19 02:43:57.460849 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.460815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwjtf\" (UniqueName: \"kubernetes.io/projected/95358644-e6e1-4367-9830-d31fb9c06056-kube-api-access-nwjtf\") pod \"managed-serviceaccount-addon-agent-7bb7f6776-fcvvb\" (UID: \"95358644-e6e1-4367-9830-d31fb9c06056\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" Sep 19 02:43:57.461002 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.460857 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95358644-e6e1-4367-9830-d31fb9c06056-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bb7f6776-fcvvb\" (UID: \"95358644-e6e1-4367-9830-d31fb9c06056\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" Sep 19 02:43:57.562031 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.562003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwjtf\" (UniqueName: \"kubernetes.io/projected/95358644-e6e1-4367-9830-d31fb9c06056-kube-api-access-nwjtf\") pod \"managed-serviceaccount-addon-agent-7bb7f6776-fcvvb\" (UID: \"95358644-e6e1-4367-9830-d31fb9c06056\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" Sep 19 02:43:57.562228 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.562048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95358644-e6e1-4367-9830-d31fb9c06056-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bb7f6776-fcvvb\" (UID: \"95358644-e6e1-4367-9830-d31fb9c06056\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" Sep 19 02:43:57.564510 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.564490 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95358644-e6e1-4367-9830-d31fb9c06056-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bb7f6776-fcvvb\" (UID: \"95358644-e6e1-4367-9830-d31fb9c06056\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" Sep 19 02:43:57.575716 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.575687 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwjtf\" (UniqueName: \"kubernetes.io/projected/95358644-e6e1-4367-9830-d31fb9c06056-kube-api-access-nwjtf\") pod \"managed-serviceaccount-addon-agent-7bb7f6776-fcvvb\" (UID: \"95358644-e6e1-4367-9830-d31fb9c06056\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" Sep 19 02:43:57.663966 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.663943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" Sep 19 02:43:57.937842 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:57.937820 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb"] Sep 19 02:43:57.938181 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:43:57.938158 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95358644_e6e1_4367_9830_d31fb9c06056.slice/crio-aafdfe5ad669012e778086e86f21836ebb5873174dc9f2dd5098badd2d917dbc WatchSource:0}: Error finding container aafdfe5ad669012e778086e86f21836ebb5873174dc9f2dd5098badd2d917dbc: Status 404 returned error can't find the container with id aafdfe5ad669012e778086e86f21836ebb5873174dc9f2dd5098badd2d917dbc Sep 19 02:43:58.412356 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:58.412304 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" event={"ID":"95358644-e6e1-4367-9830-d31fb9c06056","Type":"ContainerStarted","Data":"aafdfe5ad669012e778086e86f21836ebb5873174dc9f2dd5098badd2d917dbc"} Sep 19 02:43:58.975200 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:58.975159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:58.977563 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:58.977534 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb3cf59-75d2-4c10-8d9c-a95558e93a9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-jdqpd\" (UID: \"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:43:59.075808 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:59.075749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:59.076421 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:59.076404 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432e30df-07e6-4293-bc8c-b9e6631d6324-service-ca-bundle\") pod \"router-default-976f6c564-979qp\" (UID: \"432e30df-07e6-4293-bc8c-b9e6631d6324\") " pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:59.121050 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:59.121015 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:43:59.232930 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:43:59.232851 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" Sep 19 02:44:00.244225 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:00.243808 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-976f6c564-979qp"] Sep 19 02:44:00.246829 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:00.246793 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd"] Sep 19 02:44:00.246937 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:44:00.246789 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432e30df_07e6_4293_bc8c_b9e6631d6324.slice/crio-a8754afee08eb0a72c0a75a96575fe13b63778f3d1fb237ecc84e4b77874a735 WatchSource:0}: Error finding container a8754afee08eb0a72c0a75a96575fe13b63778f3d1fb237ecc84e4b77874a735: Status 404 returned error can't find the container with id a8754afee08eb0a72c0a75a96575fe13b63778f3d1fb237ecc84e4b77874a735 Sep 19 02:44:00.249213 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:44:00.249184 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb3cf59_75d2_4c10_8d9c_a95558e93a9d.slice/crio-adeed89d7ba3dd7b221e2ebd0c0d4990962b910a3966e61ae9abef412d2ec33c WatchSource:0}: Error finding container adeed89d7ba3dd7b221e2ebd0c0d4990962b910a3966e61ae9abef412d2ec33c: Status 404 returned error can't find the container with id adeed89d7ba3dd7b221e2ebd0c0d4990962b910a3966e61ae9abef412d2ec33c Sep 19 02:44:00.420059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:00.420016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-976f6c564-979qp" event={"ID":"432e30df-07e6-4293-bc8c-b9e6631d6324","Type":"ContainerStarted","Data":"d1063008786ae6202bce49be32cfce097a440fb1f9ebb75e9969ed6c59f13fb9"} Sep 19 02:44:00.420212 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:00.420078 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-976f6c564-979qp" event={"ID":"432e30df-07e6-4293-bc8c-b9e6631d6324","Type":"ContainerStarted","Data":"a8754afee08eb0a72c0a75a96575fe13b63778f3d1fb237ecc84e4b77874a735"} Sep 19 02:44:00.421197 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:00.421169 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" event={"ID":"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d","Type":"ContainerStarted","Data":"adeed89d7ba3dd7b221e2ebd0c0d4990962b910a3966e61ae9abef412d2ec33c"} Sep 19 02:44:00.422454 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:00.422432 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" event={"ID":"95358644-e6e1-4367-9830-d31fb9c06056","Type":"ContainerStarted","Data":"aa60fca964fa24da227d736c88618f78a4c9ae26ad3e787b430156eae298f545"} Sep 19 02:44:00.437048 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:00.437008 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-976f6c564-979qp" podStartSLOduration=33.436995501 podStartE2EDuration="33.436995501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:00.436151054 +0000 UTC m=+96.982633852" watchObservedRunningTime="2026-09-19 02:44:00.436995501 +0000 UTC m=+96.983478298" Sep 19 02:44:00.452747 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:00.452713 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb7f6776-fcvvb" podStartSLOduration=1.357923249 podStartE2EDuration="3.452699586s" totalImagesPullingTime="2.094776337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:43:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:00.45261617 +0000 UTC m=+96.999098969" watchObservedRunningTime="2026-09-19 02:44:00.452699586 +0000 UTC m=+96.999182391" Sep 19 02:44:01.121363 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:01.121325 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:44:01.124797 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:01.124754 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:44:01.426090 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:01.426057 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:44:01.427289 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:01.427269 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-976f6c564-979qp" Sep 19 02:44:02.206351 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:02.206311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:44:02.208640 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:02.208613 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8c3901-cf7e-45de-ab56-9ac78c8d4588-metrics-tls\") pod \"dns-default-fdstj\" (UID: \"0a8c3901-cf7e-45de-ab56-9ac78c8d4588\") " pod="openshift-dns/dns-default-fdstj" Sep 19 02:44:02.233095 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:02.233069 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mlt87\"" Sep 19 02:44:02.241014 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:02.240999 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdstj" Sep 19 02:44:02.704028 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:02.703996 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fdstj"] Sep 19 02:44:02.706933 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:44:02.706905 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8c3901_cf7e_45de_ab56_9ac78c8d4588.slice/crio-3a883d6923e7ba24770ac4120286242efeff6f5f6b7390f67de3542ba05d6b42 WatchSource:0}: Error finding container 3a883d6923e7ba24770ac4120286242efeff6f5f6b7390f67de3542ba05d6b42: Status 404 returned error can't find the container with id 3a883d6923e7ba24770ac4120286242efeff6f5f6b7390f67de3542ba05d6b42 Sep 19 02:44:02.955973 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:02.955940 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98"] Sep 19 02:44:02.988157 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:02.988072 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98"] Sep 19 02:44:02.988157 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:02.988155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" Sep 19 02:44:02.990725 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:02.990706 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kgsws\"" Sep 19 02:44:02.990725 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:02.990721 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 19 02:44:03.113949 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:03.113897 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/adde9c46-946d-4d31-aaa0-694f246a8fc1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6vt98\" (UID: \"adde9c46-946d-4d31-aaa0-694f246a8fc1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" Sep 19 02:44:03.215380 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:03.215297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/adde9c46-946d-4d31-aaa0-694f246a8fc1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6vt98\" (UID: \"adde9c46-946d-4d31-aaa0-694f246a8fc1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" Sep 19 02:44:03.215513 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:44:03.215448 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 19 02:44:03.215559 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:44:03.215517 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adde9c46-946d-4d31-aaa0-694f246a8fc1-tls-certificates podName:adde9c46-946d-4d31-aaa0-694f246a8fc1 nodeName:}" failed. No retries permitted until 2026-09-19 02:44:03.715500223 +0000 UTC m=+100.261983003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/adde9c46-946d-4d31-aaa0-694f246a8fc1-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-6vt98" (UID: "adde9c46-946d-4d31-aaa0-694f246a8fc1") : secret "prometheus-operator-admission-webhook-tls" not found Sep 19 02:44:03.434462 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:03.434392 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" event={"ID":"7cb3cf59-75d2-4c10-8d9c-a95558e93a9d","Type":"ContainerStarted","Data":"35c6eb6efdbfea7028ff5e14c6e012051e312fb2f65e7e6c1cb9e03c2f77a6c1"} Sep 19 02:44:03.435935 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:03.435910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdstj" event={"ID":"0a8c3901-cf7e-45de-ab56-9ac78c8d4588","Type":"ContainerStarted","Data":"3a883d6923e7ba24770ac4120286242efeff6f5f6b7390f67de3542ba05d6b42"} Sep 19 02:44:03.721121 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:03.721088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/adde9c46-946d-4d31-aaa0-694f246a8fc1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6vt98\" (UID: \"adde9c46-946d-4d31-aaa0-694f246a8fc1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" Sep 19 02:44:03.723782 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:03.723738 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/adde9c46-946d-4d31-aaa0-694f246a8fc1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6vt98\" (UID: \"adde9c46-946d-4d31-aaa0-694f246a8fc1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" Sep 19 02:44:03.897332 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:03.897293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" Sep 19 02:44:04.641336 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:04.641228 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-jdqpd" podStartSLOduration=35.447906391 podStartE2EDuration="37.641202641s" totalImagesPullingTime="2.19329625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:03.45012979 +0000 UTC m=+99.996612612" watchObservedRunningTime="2026-09-19 02:44:04.641202641 +0000 UTC m=+101.187685434" Sep 19 02:44:04.641690 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:04.641657 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98"] Sep 19 02:44:04.737420 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:44:04.737383 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadde9c46_946d_4d31_aaa0_694f246a8fc1.slice/crio-c04c536e678d05f49242062582b0245a84c50140fb6fb892f552625025ad7f7a WatchSource:0}: Error finding container c04c536e678d05f49242062582b0245a84c50140fb6fb892f552625025ad7f7a: Status 404 returned error can't find the container with id c04c536e678d05f49242062582b0245a84c50140fb6fb892f552625025ad7f7a Sep 19 02:44:05.446687 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.446648 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdstj" event={"ID":"0a8c3901-cf7e-45de-ab56-9ac78c8d4588","Type":"ContainerStarted","Data":"e26aad489a964e1edb6afb5e4240d403342ae35eb7a47079e53a7abf7fca9ef9"} Sep 19 02:44:05.446894 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.446717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdstj" event={"ID":"0a8c3901-cf7e-45de-ab56-9ac78c8d4588","Type":"ContainerStarted","Data":"2a21828bb0571b2cb5dfef9792aa32abdf3d44ab0af2f35598863c879475dfc2"} Sep 19 02:44:05.446894 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.446856 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fdstj" Sep 19 02:44:05.448172 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.448140 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" event={"ID":"adde9c46-946d-4d31-aaa0-694f246a8fc1","Type":"ContainerStarted","Data":"c04c536e678d05f49242062582b0245a84c50140fb6fb892f552625025ad7f7a"} Sep 19 02:44:05.466303 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.466258 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fdstj" podStartSLOduration=65.409520715 podStartE2EDuration="1m7.466241549s" totalImagesPullingTime="2.056720834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:05.465100421 +0000 UTC m=+102.011583222" watchObservedRunningTime="2026-09-19 02:44:05.466241549 +0000 UTC m=+102.012724347" Sep 19 02:44:05.855206 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.855134 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c7b5fcd9b-dz279"] Sep 19 02:44:05.869426 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.869404 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7b5fcd9b-dz279"] Sep 19 02:44:05.869557 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.869488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:05.871871 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.871849 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 19 02:44:05.871979 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.871900 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 19 02:44:05.872037 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.871973 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 19 02:44:05.872037 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.871981 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 19 02:44:05.872152 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.872127 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7n8hs\"" Sep 19 02:44:05.872268 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.872238 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 19 02:44:05.872469 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.872448 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 19 02:44:05.872551 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.872476 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 19 02:44:05.938845 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.938812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-oauth-config\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:05.939014 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.938851 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-console-config\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:05.939014 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.938873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-service-ca\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:05.939014 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.938890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfwxx\" (UniqueName: \"kubernetes.io/projected/ab791272-79a3-416a-826e-23d54e2dace0-kube-api-access-lfwxx\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:05.939014 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.938938 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-serving-cert\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:05.939014 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:05.938977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-oauth-serving-cert\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.039748 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.039707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-oauth-config\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.039748 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.039746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-console-config\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.039983 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.039788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-service-ca\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.039983 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.039809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfwxx\" (UniqueName: \"kubernetes.io/projected/ab791272-79a3-416a-826e-23d54e2dace0-kube-api-access-lfwxx\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.039983 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.039850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-serving-cert\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.039983 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.039882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-oauth-serving-cert\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.040673 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.040644 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-service-ca\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.040791 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.040644 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-console-config\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.040791 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.040740 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-oauth-serving-cert\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.042262 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.042236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-oauth-config\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.042357 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.042317 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-serving-cert\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.047321 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.047297 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfwxx\" (UniqueName: \"kubernetes.io/projected/ab791272-79a3-416a-826e-23d54e2dace0-kube-api-access-lfwxx\") pod \"console-5c7b5fcd9b-dz279\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.179429 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.179391 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:06.453780 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.453682 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" event={"ID":"adde9c46-946d-4d31-aaa0-694f246a8fc1","Type":"ContainerStarted","Data":"98bcb415a5592cc0cccc3cd02b53c89bcfa952566b1c53ccbf0997bddce22621"} Sep 19 02:44:06.454095 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.454074 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" Sep 19 02:44:06.458434 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.458413 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" Sep 19 02:44:06.467583 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.467559 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7b5fcd9b-dz279"] Sep 19 02:44:06.470550 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:06.470509 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6vt98" podStartSLOduration=3.033871742 podStartE2EDuration="4.470496849s" totalImagesPullingTime="1.436625107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:06.469485471 +0000 UTC m=+103.015968269" watchObservedRunningTime="2026-09-19 02:44:06.470496849 +0000 UTC m=+103.016979646" Sep 19 02:44:06.471687 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:44:06.471661 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab791272_79a3_416a_826e_23d54e2dace0.slice/crio-b68d72097f4ed88704d68ba5f20d320dcb2f2a3c789adb988ee63b8c2e42bcea WatchSource:0}: Error finding container b68d72097f4ed88704d68ba5f20d320dcb2f2a3c789adb988ee63b8c2e42bcea: Status 404 returned error can't find the container with id b68d72097f4ed88704d68ba5f20d320dcb2f2a3c789adb988ee63b8c2e42bcea Sep 19 02:44:07.020464 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.020427 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b"] Sep 19 02:44:07.035060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.035032 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b"] Sep 19 02:44:07.035210 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.035141 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.037663 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.037638 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 19 02:44:07.037926 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.037661 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 19 02:44:07.037926 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.037661 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kzqkz\"" Sep 19 02:44:07.038543 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.038523 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 19 02:44:07.148266 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.148044 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/472bd32a-6351-4385-ae63-764b3e33fb98-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.148266 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.148107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/472bd32a-6351-4385-ae63-764b3e33fb98-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.148266 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.148144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/472bd32a-6351-4385-ae63-764b3e33fb98-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.148266 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.148170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c77x\" (UniqueName: \"kubernetes.io/projected/472bd32a-6351-4385-ae63-764b3e33fb98-kube-api-access-4c77x\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.248577 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.248546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/472bd32a-6351-4385-ae63-764b3e33fb98-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.248860 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.248593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/472bd32a-6351-4385-ae63-764b3e33fb98-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.248860 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.248619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/472bd32a-6351-4385-ae63-764b3e33fb98-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.248860 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.248636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c77x\" (UniqueName: \"kubernetes.io/projected/472bd32a-6351-4385-ae63-764b3e33fb98-kube-api-access-4c77x\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.249651 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.249625 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/472bd32a-6351-4385-ae63-764b3e33fb98-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.254081 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.254025 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/472bd32a-6351-4385-ae63-764b3e33fb98-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.256858 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.256606 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/472bd32a-6351-4385-ae63-764b3e33fb98-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.256858 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.256819 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c77x\" (UniqueName: \"kubernetes.io/projected/472bd32a-6351-4385-ae63-764b3e33fb98-kube-api-access-4c77x\") pod \"prometheus-operator-7bd5d56d6-hgf4b\" (UID: \"472bd32a-6351-4385-ae63-764b3e33fb98\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.341976 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.341908 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vjcgr" Sep 19 02:44:07.354485 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.354442 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" Sep 19 02:44:07.467476 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.467441 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7b5fcd9b-dz279" event={"ID":"ab791272-79a3-416a-826e-23d54e2dace0","Type":"ContainerStarted","Data":"b68d72097f4ed88704d68ba5f20d320dcb2f2a3c789adb988ee63b8c2e42bcea"} Sep 19 02:44:07.698701 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:07.698657 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b"] Sep 19 02:44:07.702257 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:44:07.702195 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472bd32a_6351_4385_ae63_764b3e33fb98.slice/crio-c9f55451c320878a6a3c85254bdf5cd9111f57a58ee7d633996f67a60e39585e WatchSource:0}: Error finding container c9f55451c320878a6a3c85254bdf5cd9111f57a58ee7d633996f67a60e39585e: Status 404 returned error can't find the container with id c9f55451c320878a6a3c85254bdf5cd9111f57a58ee7d633996f67a60e39585e Sep 19 02:44:08.472414 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:08.472374 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" event={"ID":"472bd32a-6351-4385-ae63-764b3e33fb98","Type":"ContainerStarted","Data":"c9f55451c320878a6a3c85254bdf5cd9111f57a58ee7d633996f67a60e39585e"} Sep 19 02:44:11.483809 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:11.483775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7b5fcd9b-dz279" event={"ID":"ab791272-79a3-416a-826e-23d54e2dace0","Type":"ContainerStarted","Data":"212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81"} Sep 19 02:44:11.485753 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:11.485717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" event={"ID":"472bd32a-6351-4385-ae63-764b3e33fb98","Type":"ContainerStarted","Data":"377cb90b57e8bd642cd4492f5a6db6b260b9ca6df09487c5adf792b54aa0486d"} Sep 19 02:44:11.485880 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:11.485791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" event={"ID":"472bd32a-6351-4385-ae63-764b3e33fb98","Type":"ContainerStarted","Data":"161bdb7b31ef9de3ce7f7c1468757c2775b645a1bcd29b89a681a0719b8bd1e2"} Sep 19 02:44:11.500200 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:11.500161 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c7b5fcd9b-dz279" podStartSLOduration=2.014605757 podStartE2EDuration="6.500148134s" totalImagesPullingTime="4.485542377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:11.498748851 +0000 UTC m=+108.045231648" watchObservedRunningTime="2026-09-19 02:44:11.500148134 +0000 UTC m=+108.046630932" Sep 19 02:44:11.515244 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:11.515206 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-hgf4b" podStartSLOduration=1.23204608 podStartE2EDuration="4.515192244s" totalImagesPullingTime="3.283146164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:11.514202282 +0000 UTC m=+108.060685081" watchObservedRunningTime="2026-09-19 02:44:11.515192244 +0000 UTC m=+108.061675041" Sep 19 02:44:13.402542 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.402506 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mmb8x"] Sep 19 02:44:13.405892 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.405869 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.408678 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.408647 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 19 02:44:13.408825 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.408722 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fvmvw\"" Sep 19 02:44:13.409131 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.409114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 19 02:44:13.409214 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.409143 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 19 02:44:13.502988 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.502956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-textfile\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.502988 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.502991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-metrics-client-ca\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.503180 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.503015 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.503180 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.503082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.503180 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.503119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-root\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.503180 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.503163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdccg\" (UniqueName: \"kubernetes.io/projected/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-kube-api-access-hdccg\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.503328 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.503242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-tls\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.503328 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.503273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-sys\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.503328 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.503293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-wtmp\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.604580 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.604553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-textfile\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.604580 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.604584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-metrics-client-ca\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.604826 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.604600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.604826 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.604799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.604943 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.604849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-root\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.604943 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.604880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdccg\" (UniqueName: \"kubernetes.io/projected/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-kube-api-access-hdccg\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.604943 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.604938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-tls\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.605091 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.604977 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-root\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.605091 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.604989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-sys\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.605091 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.605031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-wtmp\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.605091 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.605037 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-textfile\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.605091 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:44:13.605088 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 19 02:44:13.605267 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:44:13.605150 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-tls podName:c99cb85e-d225-4a3a-b4c0-b06857d20f8d nodeName:}" failed. No retries permitted until 2026-09-19 02:44:14.105133272 +0000 UTC m=+110.651616049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-tls") pod "node-exporter-mmb8x" (UID: "c99cb85e-d225-4a3a-b4c0-b06857d20f8d") : secret "node-exporter-tls" not found Sep 19 02:44:13.605267 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.605175 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-wtmp\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.605267 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.605209 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.605267 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.605220 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-metrics-client-ca\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.605267 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.605238 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-sys\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.607060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.607043 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:13.613349 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:13.613318 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdccg\" (UniqueName: \"kubernetes.io/projected/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-kube-api-access-hdccg\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:14.108814 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:14.108759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-tls\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:14.111001 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:14.110981 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c99cb85e-d225-4a3a-b4c0-b06857d20f8d-node-exporter-tls\") pod \"node-exporter-mmb8x\" (UID: \"c99cb85e-d225-4a3a-b4c0-b06857d20f8d\") " pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:14.315127 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:14.315094 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mmb8x" Sep 19 02:44:14.326482 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:44:14.326452 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99cb85e_d225_4a3a_b4c0_b06857d20f8d.slice/crio-d021397f09ea81a738cfe6790c60a9361a10d61c7a211adde53e0ba28b070059 WatchSource:0}: Error finding container d021397f09ea81a738cfe6790c60a9361a10d61c7a211adde53e0ba28b070059: Status 404 returned error can't find the container with id d021397f09ea81a738cfe6790c60a9361a10d61c7a211adde53e0ba28b070059 Sep 19 02:44:14.497990 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:14.497946 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmb8x" event={"ID":"c99cb85e-d225-4a3a-b4c0-b06857d20f8d","Type":"ContainerStarted","Data":"d021397f09ea81a738cfe6790c60a9361a10d61c7a211adde53e0ba28b070059"} Sep 19 02:44:15.455977 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:15.455943 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fdstj" Sep 19 02:44:15.505149 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:15.505062 2579 generic.go:356] "Generic (PLEG): container finished" podID="c99cb85e-d225-4a3a-b4c0-b06857d20f8d" containerID="3af353a6ba8545ac885c3a11e71a72b1eb16c66ca10c9c2549b064dfe175103d" exitCode=0 Sep 19 02:44:15.505149 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:15.505131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmb8x" event={"ID":"c99cb85e-d225-4a3a-b4c0-b06857d20f8d","Type":"ContainerDied","Data":"3af353a6ba8545ac885c3a11e71a72b1eb16c66ca10c9c2549b064dfe175103d"} Sep 19 02:44:16.179517 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:16.179478 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:16.179688 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:16.179532 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:16.184133 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:16.184112 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:16.511451 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:16.511359 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmb8x" event={"ID":"c99cb85e-d225-4a3a-b4c0-b06857d20f8d","Type":"ContainerStarted","Data":"ca8c236a51317e1c6e8dc08825029a792ae452f1f41e116fcd5206a1dcab66bb"} Sep 19 02:44:16.511451 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:16.511417 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmb8x" event={"ID":"c99cb85e-d225-4a3a-b4c0-b06857d20f8d","Type":"ContainerStarted","Data":"dbbc2caa54e587446701b0ed7409e5c959c16592bbf44a8a3740b247d0a48214"} Sep 19 02:44:16.515458 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:16.515432 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:16.534152 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:16.534096 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mmb8x" podStartSLOduration=2.576372164 podStartE2EDuration="3.534076109s" totalImagesPullingTime="895.425954ms" totalInitContainerRuntime="62.277991ms" isStatefulPod=true podCreationTimestamp="2026-09-19 02:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:16.53263255 +0000 UTC m=+113.079115349" watchObservedRunningTime="2026-09-19 02:44:16.534076109 +0000 UTC m=+113.080558908" Sep 19 02:44:17.812078 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.812048 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-76f6fd6b49-5v25q"] Sep 19 02:44:17.815238 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.815222 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:17.817572 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.817552 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3sg00dd4arm16\"" Sep 19 02:44:17.818479 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.818455 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 19 02:44:17.818589 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.818488 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 19 02:44:17.818589 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.818526 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 19 02:44:17.818589 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.818558 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 19 02:44:17.818735 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.818701 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pk7pq\"" Sep 19 02:44:17.825161 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.825138 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76f6fd6b49-5v25q"] Sep 19 02:44:17.943129 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.943077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-audit-log\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:17.943129 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.943131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-metrics-server-audit-profiles\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:17.943350 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.943164 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-secret-metrics-server-client-certs\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:17.943350 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.943211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:17.943350 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.943242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-secret-metrics-server-tls\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:17.943350 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.943287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-client-ca-bundle\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:17.943350 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:17.943313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49nm5\" (UniqueName: \"kubernetes.io/projected/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-kube-api-access-49nm5\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.043687 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.043646 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49nm5\" (UniqueName: \"kubernetes.io/projected/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-kube-api-access-49nm5\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.043883 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.043716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-audit-log\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.043883 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.043743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-metrics-server-audit-profiles\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.043883 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.043796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-secret-metrics-server-client-certs\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.043883 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.043830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.043883 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.043856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-secret-metrics-server-tls\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.044148 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.043919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-client-ca-bundle\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.044199 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.044174 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-audit-log\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.044663 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.044601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.045004 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.044984 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-metrics-server-audit-profiles\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.046338 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.046315 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-client-ca-bundle\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.046777 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.046748 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-secret-metrics-server-tls\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.046856 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.046842 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-secret-metrics-server-client-certs\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.050963 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.050942 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49nm5\" (UniqueName: \"kubernetes.io/projected/c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5-kube-api-access-49nm5\") pod \"metrics-server-76f6fd6b49-5v25q\" (UID: \"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5\") " pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.125123 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.125045 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:18.395239 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.395169 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76f6fd6b49-5v25q"] Sep 19 02:44:18.398249 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:44:18.398218 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d3b7cf_6aa8_4aa5_a824_4f0b6bb176d5.slice/crio-244c9a25cd10ea64aae65426d6a92864cafcf7189066710a173019e313569c7b WatchSource:0}: Error finding container 244c9a25cd10ea64aae65426d6a92864cafcf7189066710a173019e313569c7b: Status 404 returned error can't find the container with id 244c9a25cd10ea64aae65426d6a92864cafcf7189066710a173019e313569c7b Sep 19 02:44:18.521243 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:18.521217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" event={"ID":"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5","Type":"ContainerStarted","Data":"244c9a25cd10ea64aae65426d6a92864cafcf7189066710a173019e313569c7b"} Sep 19 02:44:19.601032 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.600997 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 02:44:19.605608 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.605553 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.608103 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.608035 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 19 02:44:19.608103 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.608036 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 19 02:44:19.608345 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.608281 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 19 02:44:19.608345 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.608331 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 19 02:44:19.608572 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.608548 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 19 02:44:19.610605 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.608573 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 19 02:44:19.610605 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.608623 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8c1po1tuifr55\"" Sep 19 02:44:19.610605 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.608658 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 19 02:44:19.611335 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.611313 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 19 02:44:19.611514 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.611492 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 19 02:44:19.611651 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.611553 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 19 02:44:19.611720 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.611693 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 19 02:44:19.611885 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.611858 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 19 02:44:19.612331 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.612299 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x8c9k\"" Sep 19 02:44:19.612526 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.612507 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 19 02:44:19.612904 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.612715 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 19 02:44:19.617971 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.617909 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 02:44:19.758407 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758599 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pwpr\" (UniqueName: \"kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-kube-api-access-8pwpr\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758599 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758599 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-config\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758599 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758952 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758639 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758952 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-config-out\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758952 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758691 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758952 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758952 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758952 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758818 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-web-config\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758952 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.758952 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758950 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.759357 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.758989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.759357 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.759036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.759357 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.759101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.759357 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.759128 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.759357 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.759165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.759357 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.759193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.759357 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.759216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.859960 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.859799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.859960 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.859847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.859960 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.859877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.859960 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.859916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.859960 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.859941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.859960 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.859965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.859993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pwpr\" (UniqueName: \"kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-kube-api-access-8pwpr\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-config\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-config-out\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-web-config\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.860497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.861185 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860621 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.861185 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.860940 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.863970 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.861474 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.863970 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.862029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.863970 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.862526 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.863970 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.863109 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.863970 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.863506 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.863970 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.863591 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.863970 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.863917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.864661 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.864587 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.866304 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.866276 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-config\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.866441 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.866419 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.866809 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.866721 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.866809 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.866719 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-config-out\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.867059 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.867040 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.867130 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.867102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.867171 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.867134 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.867871 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.867853 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.868289 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.868268 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-web-config\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.870825 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.870802 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pwpr\" (UniqueName: \"kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-kube-api-access-8pwpr\") pod \"prometheus-k8s-0\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:19.920806 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:19.920778 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:20.235597 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:20.235559 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 02:44:20.239591 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:44:20.239565 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62561524_c387_45bb_8585_579b2ed6e83b.slice/crio-2cd707ad6a5a239712232ceae17843fa21d8dae9a8324257b8c2ed52c8e94899 WatchSource:0}: Error finding container 2cd707ad6a5a239712232ceae17843fa21d8dae9a8324257b8c2ed52c8e94899: Status 404 returned error can't find the container with id 2cd707ad6a5a239712232ceae17843fa21d8dae9a8324257b8c2ed52c8e94899 Sep 19 02:44:20.531292 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:20.531200 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" event={"ID":"c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5","Type":"ContainerStarted","Data":"5e72dce087582cdccd15c3b9b97ac5714531a6cd647fc6d9ed00de6ed82f526a"} Sep 19 02:44:20.532501 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:20.532475 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerStarted","Data":"2cd707ad6a5a239712232ceae17843fa21d8dae9a8324257b8c2ed52c8e94899"} Sep 19 02:44:20.548861 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:20.548802 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" podStartSLOduration=2.094544428 podStartE2EDuration="3.548758792s" totalImagesPullingTime="1.454214364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:20.548040503 +0000 UTC m=+117.094523301" watchObservedRunningTime="2026-09-19 02:44:20.548758792 +0000 UTC m=+117.095241607" Sep 19 02:44:21.540869 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:21.540782 2579 generic.go:356] "Generic (PLEG): container finished" podID="62561524-c387-45bb-8585-579b2ed6e83b" containerID="016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d" exitCode=0 Sep 19 02:44:21.541193 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:21.540882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerDied","Data":"016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d"} Sep 19 02:44:24.557162 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:24.557134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerStarted","Data":"4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d"} Sep 19 02:44:25.565034 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:25.564996 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerStarted","Data":"0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de"} Sep 19 02:44:26.572409 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:26.572332 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerStarted","Data":"672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c"} Sep 19 02:44:26.572737 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:26.572420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerStarted","Data":"a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d"} Sep 19 02:44:26.572737 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:26.572447 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerStarted","Data":"99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f"} Sep 19 02:44:26.572737 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:26.572472 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerStarted","Data":"6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60"} Sep 19 02:44:26.597881 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:26.597830 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.096630051 podStartE2EDuration="7.597812965s" totalImagesPullingTime="5.483895791s" totalInitContainerRuntime="17.287123ms" isStatefulPod=false podCreationTimestamp="2026-09-19 02:44:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:26.595897839 +0000 UTC m=+123.142380669" watchObservedRunningTime="2026-09-19 02:44:26.597812965 +0000 UTC m=+123.144295763" Sep 19 02:44:29.921946 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:29.921901 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:44:32.345981 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:32.345944 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7b5fcd9b-dz279"] Sep 19 02:44:33.674969 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:33.674926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:44:33.677210 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:33.677180 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/924b04f6-d98c-445a-ad4b-feef03aa9f67-metrics-certs\") pod \"network-metrics-daemon-7jpb8\" (UID: \"924b04f6-d98c-445a-ad4b-feef03aa9f67\") " pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:44:33.746020 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:33.745992 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dsccn\"" Sep 19 02:44:33.753821 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:33.753802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jpb8" Sep 19 02:44:34.023948 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:34.023914 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7jpb8"] Sep 19 02:44:34.026056 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:44:34.026029 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924b04f6_d98c_445a_ad4b_feef03aa9f67.slice/crio-5e0362e84793135dde8244df11d3c8be8403f27953a8b7497bebc645e6619104 WatchSource:0}: Error finding container 5e0362e84793135dde8244df11d3c8be8403f27953a8b7497bebc645e6619104: Status 404 returned error can't find the container with id 5e0362e84793135dde8244df11d3c8be8403f27953a8b7497bebc645e6619104 Sep 19 02:44:34.605368 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:34.605328 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7jpb8" event={"ID":"924b04f6-d98c-445a-ad4b-feef03aa9f67","Type":"ContainerStarted","Data":"5e0362e84793135dde8244df11d3c8be8403f27953a8b7497bebc645e6619104"} Sep 19 02:44:35.611353 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:35.611314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7jpb8" event={"ID":"924b04f6-d98c-445a-ad4b-feef03aa9f67","Type":"ContainerStarted","Data":"f877dcf570c8bfca86d7bde7916524f0b8807c64dd1c81ff3e1fd2f3b78d4e6b"} Sep 19 02:44:35.611783 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:35.611369 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7jpb8" event={"ID":"924b04f6-d98c-445a-ad4b-feef03aa9f67","Type":"ContainerStarted","Data":"cd1776bad30e92525e1f2c68c948ad4866fc8edbf658f26dbf23914b61dd21cd"} Sep 19 02:44:35.628142 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:35.628098 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7jpb8" podStartSLOduration=130.655421134 podStartE2EDuration="2m11.628083503s" totalImagesPullingTime="972.662369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:44:35.627090496 +0000 UTC m=+132.173573295" watchObservedRunningTime="2026-09-19 02:44:35.628083503 +0000 UTC m=+132.174566320" Sep 19 02:44:38.126038 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:38.125993 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:38.126417 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:38.126067 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:57.365525 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.365459 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c7b5fcd9b-dz279" podUID="ab791272-79a3-416a-826e-23d54e2dace0" containerName="console" containerID="cri-o://212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81" gracePeriod=15 Sep 19 02:44:57.631222 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.631154 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:57.698932 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.698901 2579 generic.go:356] "Generic (PLEG): container finished" podID="ab791272-79a3-416a-826e-23d54e2dace0" containerID="212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81" exitCode=0 Sep 19 02:44:57.699085 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.698945 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7b5fcd9b-dz279" Sep 19 02:44:57.699085 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.698952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7b5fcd9b-dz279" event={"ID":"ab791272-79a3-416a-826e-23d54e2dace0","Type":"ContainerDied","Data":"212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81"} Sep 19 02:44:57.699085 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.699015 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7b5fcd9b-dz279" event={"ID":"ab791272-79a3-416a-826e-23d54e2dace0","Type":"ContainerDied","Data":"b68d72097f4ed88704d68ba5f20d320dcb2f2a3c789adb988ee63b8c2e42bcea"} Sep 19 02:44:57.699085 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.699034 2579 scope.go:117] "RemoveContainer" containerID="212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81" Sep 19 02:44:57.706758 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.706740 2579 scope.go:117] "RemoveContainer" containerID="212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81" Sep 19 02:44:57.707052 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:44:57.707030 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81\": container with ID starting with 212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81 not found: ID does not exist" containerID="212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81" Sep 19 02:44:57.707099 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.707061 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81"} err="failed to get container status \"212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81\": rpc error: code = NotFound desc = could not find container \"212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81\": container with ID starting with 212c4a72a6fd7aa45e65a96a4ed5b1179b811822673ede9760b219f14e4d5e81 not found: ID does not exist" Sep 19 02:44:57.772801 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.772753 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfwxx\" (UniqueName: \"kubernetes.io/projected/ab791272-79a3-416a-826e-23d54e2dace0-kube-api-access-lfwxx\") pod \"ab791272-79a3-416a-826e-23d54e2dace0\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " Sep 19 02:44:57.772916 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.772809 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-serving-cert\") pod \"ab791272-79a3-416a-826e-23d54e2dace0\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " Sep 19 02:44:57.772916 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.772839 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-service-ca\") pod \"ab791272-79a3-416a-826e-23d54e2dace0\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " Sep 19 02:44:57.772916 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.772878 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-console-config\") pod \"ab791272-79a3-416a-826e-23d54e2dace0\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " Sep 19 02:44:57.773101 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.772969 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-oauth-config\") pod \"ab791272-79a3-416a-826e-23d54e2dace0\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " Sep 19 02:44:57.773101 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.773045 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-oauth-serving-cert\") pod \"ab791272-79a3-416a-826e-23d54e2dace0\" (UID: \"ab791272-79a3-416a-826e-23d54e2dace0\") " Sep 19 02:44:57.773368 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.773341 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-service-ca" (OuterVolumeSpecName: "service-ca") pod "ab791272-79a3-416a-826e-23d54e2dace0" (UID: "ab791272-79a3-416a-826e-23d54e2dace0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 02:44:57.773498 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.773366 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-console-config" (OuterVolumeSpecName: "console-config") pod "ab791272-79a3-416a-826e-23d54e2dace0" (UID: "ab791272-79a3-416a-826e-23d54e2dace0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 02:44:57.773498 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.773429 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ab791272-79a3-416a-826e-23d54e2dace0" (UID: "ab791272-79a3-416a-826e-23d54e2dace0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 02:44:57.775151 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.775133 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ab791272-79a3-416a-826e-23d54e2dace0" (UID: "ab791272-79a3-416a-826e-23d54e2dace0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:44:57.775215 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.775156 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ab791272-79a3-416a-826e-23d54e2dace0" (UID: "ab791272-79a3-416a-826e-23d54e2dace0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:44:57.775256 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.775239 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab791272-79a3-416a-826e-23d54e2dace0-kube-api-access-lfwxx" (OuterVolumeSpecName: "kube-api-access-lfwxx") pod "ab791272-79a3-416a-826e-23d54e2dace0" (UID: "ab791272-79a3-416a-826e-23d54e2dace0"). InnerVolumeSpecName "kube-api-access-lfwxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 02:44:57.873922 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.873891 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-console-config\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:44:57.873922 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.873915 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-oauth-config\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:44:57.873922 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.873924 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-oauth-serving-cert\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:44:57.873922 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.873932 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfwxx\" (UniqueName: \"kubernetes.io/projected/ab791272-79a3-416a-826e-23d54e2dace0-kube-api-access-lfwxx\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:44:57.874147 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.873940 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab791272-79a3-416a-826e-23d54e2dace0-console-serving-cert\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:44:57.874147 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:57.873949 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab791272-79a3-416a-826e-23d54e2dace0-service-ca\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:44:58.015298 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:58.015263 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7b5fcd9b-dz279"] Sep 19 02:44:58.020355 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:58.020332 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c7b5fcd9b-dz279"] Sep 19 02:44:58.131307 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:58.131271 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:58.135218 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:58.135195 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-76f6fd6b49-5v25q" Sep 19 02:44:59.938908 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:44:59.938875 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab791272-79a3-416a-826e-23d54e2dace0" path="/var/lib/kubelet/pods/ab791272-79a3-416a-826e-23d54e2dace0/volumes" Sep 19 02:45:01.716552 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:01.716519 2579 generic.go:356] "Generic (PLEG): container finished" podID="1f8d1df1-7e9a-4144-b668-4cc3e1567102" containerID="042b6ddec97ad4e7679a45304213693571ac650616c659df7875ec4268249b14" exitCode=0 Sep 19 02:45:01.716936 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:01.716570 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" event={"ID":"1f8d1df1-7e9a-4144-b668-4cc3e1567102","Type":"ContainerDied","Data":"042b6ddec97ad4e7679a45304213693571ac650616c659df7875ec4268249b14"} Sep 19 02:45:01.716936 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:01.716924 2579 scope.go:117] "RemoveContainer" containerID="042b6ddec97ad4e7679a45304213693571ac650616c659df7875ec4268249b14" Sep 19 02:45:02.722528 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:02.722490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-vww7w" event={"ID":"1f8d1df1-7e9a-4144-b668-4cc3e1567102","Type":"ContainerStarted","Data":"7e3e007d8252e63e1a56f9882a2a155eb02fb4b7afceb59bab3b70028cf49362"} Sep 19 02:45:19.921977 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:19.921879 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:19.938797 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:19.938756 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:20.813380 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:20.813349 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:37.958977 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:37.958938 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 02:45:37.959584 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:37.959233 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="prometheus" containerID="cri-o://4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d" gracePeriod=600 Sep 19 02:45:37.959584 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:37.959281 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c" gracePeriod=600 Sep 19 02:45:37.959584 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:37.959282 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="thanos-sidecar" containerID="cri-o://6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60" gracePeriod=600 Sep 19 02:45:37.959584 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:37.959323 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy-web" containerID="cri-o://99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f" gracePeriod=600 Sep 19 02:45:37.959584 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:37.959242 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy" containerID="cri-o://a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d" gracePeriod=600 Sep 19 02:45:37.959584 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:37.959519 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="config-reloader" containerID="cri-o://0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de" gracePeriod=600 Sep 19 02:45:38.871078 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:38.871042 2579 generic.go:356] "Generic (PLEG): container finished" podID="62561524-c387-45bb-8585-579b2ed6e83b" containerID="672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c" exitCode=0 Sep 19 02:45:38.871078 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:38.871068 2579 generic.go:356] "Generic (PLEG): container finished" podID="62561524-c387-45bb-8585-579b2ed6e83b" containerID="a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d" exitCode=0 Sep 19 02:45:38.871078 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:38.871074 2579 generic.go:356] "Generic (PLEG): container finished" podID="62561524-c387-45bb-8585-579b2ed6e83b" containerID="6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60" exitCode=0 Sep 19 02:45:38.871078 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:38.871080 2579 generic.go:356] "Generic (PLEG): container finished" podID="62561524-c387-45bb-8585-579b2ed6e83b" containerID="0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de" exitCode=0 Sep 19 02:45:38.871078 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:38.871087 2579 generic.go:356] "Generic (PLEG): container finished" podID="62561524-c387-45bb-8585-579b2ed6e83b" containerID="4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d" exitCode=0 Sep 19 02:45:38.871419 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:38.871114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerDied","Data":"672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c"} Sep 19 02:45:38.871419 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:38.871190 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerDied","Data":"a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d"} Sep 19 02:45:38.871419 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:38.871229 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerDied","Data":"6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60"} Sep 19 02:45:38.871419 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:38.871265 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerDied","Data":"0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de"} Sep 19 02:45:38.871419 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:38.871305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerDied","Data":"4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d"} Sep 19 02:45:39.211319 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.211294 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:39.324298 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324265 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pwpr\" (UniqueName: \"kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-kube-api-access-8pwpr\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.324298 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324299 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-thanos-prometheus-http-client-file\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.324525 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324329 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-2\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.324525 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324357 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-metrics-client-certs\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.324525 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324383 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-grpc-tls\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.324525 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324409 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-0\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.324525 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324442 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-serving-certs-ca-bundle\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.324525 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324477 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-trusted-ca-bundle\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.324823 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324671 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 02:45:39.324823 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324730 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-config\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.324823 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324780 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.324823 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324808 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-kubelet-serving-ca-bundle\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.325013 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324857 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.325013 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324886 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-tls\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.325013 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324925 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-metrics-client-ca\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.325013 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324952 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-tls-assets\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.325013 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324978 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-config-out\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.325013 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.325003 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-1\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.325274 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.325043 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-db\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.325274 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.325089 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-kube-rbac-proxy\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.325274 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.325119 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-web-config\") pod \"62561524-c387-45bb-8585-579b2ed6e83b\" (UID: \"62561524-c387-45bb-8585-579b2ed6e83b\") " Sep 19 02:45:39.325410 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.325366 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.327986 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324882 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 02:45:39.327986 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.324944 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 02:45:39.327986 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.325499 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 02:45:39.327986 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.325692 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 02:45:39.327986 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.325977 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 02:45:39.327986 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.326980 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 02:45:39.327986 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.327381 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:45:39.327986 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.327459 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:45:39.327986 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.327695 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 02:45:39.327986 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.327907 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-kube-api-access-8pwpr" (OuterVolumeSpecName: "kube-api-access-8pwpr") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "kube-api-access-8pwpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 02:45:39.328530 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.328477 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-config" (OuterVolumeSpecName: "config") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:45:39.329586 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.329551 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:45:39.329699 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.329589 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:45:39.329699 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.329668 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:45:39.329960 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.329936 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-config-out" (OuterVolumeSpecName: "config-out") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 02:45:39.330032 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.330012 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:45:39.330488 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.330455 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 02:45:39.330532 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.330464 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:45:39.338350 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.338329 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-web-config" (OuterVolumeSpecName: "web-config") pod "62561524-c387-45bb-8585-579b2ed6e83b" (UID: "62561524-c387-45bb-8585-579b2ed6e83b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 02:45:39.426237 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426210 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-kube-rbac-proxy\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426259 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-web-config\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426273 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pwpr\" (UniqueName: \"kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-kube-api-access-8pwpr\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426285 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426297 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-metrics-client-certs\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426311 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-grpc-tls\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426323 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426336 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426350 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426362 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-config\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426374 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426385 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426387 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426759 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426401 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426759 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426414 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62561524-c387-45bb-8585-579b2ed6e83b-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426759 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426430 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-configmap-metrics-client-ca\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426759 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426443 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62561524-c387-45bb-8585-579b2ed6e83b-tls-assets\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426759 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426456 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-config-out\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426759 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426469 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.426759 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.426482 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62561524-c387-45bb-8585-579b2ed6e83b-prometheus-k8s-db\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 02:45:39.878108 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.878029 2579 generic.go:356] "Generic (PLEG): container finished" podID="62561524-c387-45bb-8585-579b2ed6e83b" containerID="99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f" exitCode=0 Sep 19 02:45:39.878108 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.878105 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:39.878277 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.878103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerDied","Data":"99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f"} Sep 19 02:45:39.878277 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.878173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62561524-c387-45bb-8585-579b2ed6e83b","Type":"ContainerDied","Data":"2cd707ad6a5a239712232ceae17843fa21d8dae9a8324257b8c2ed52c8e94899"} Sep 19 02:45:39.878277 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.878206 2579 scope.go:117] "RemoveContainer" containerID="672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c" Sep 19 02:45:39.885707 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.885604 2579 scope.go:117] "RemoveContainer" containerID="a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d" Sep 19 02:45:39.892251 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.892233 2579 scope.go:117] "RemoveContainer" containerID="99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f" Sep 19 02:45:39.898463 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.898447 2579 scope.go:117] "RemoveContainer" containerID="6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60" Sep 19 02:45:39.900397 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.900377 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 02:45:39.905041 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.905022 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 02:45:39.905473 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.905460 2579 scope.go:117] "RemoveContainer" containerID="0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de" Sep 19 02:45:39.911678 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.911660 2579 scope.go:117] "RemoveContainer" containerID="4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d" Sep 19 02:45:39.918099 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.918085 2579 scope.go:117] "RemoveContainer" containerID="016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d" Sep 19 02:45:39.924150 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.924134 2579 scope.go:117] "RemoveContainer" containerID="672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c" Sep 19 02:45:39.924424 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:45:39.924398 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c\": container with ID starting with 672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c not found: ID does not exist" containerID="672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c" Sep 19 02:45:39.924472 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.924425 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c"} err="failed to get container status \"672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c\": rpc error: code = NotFound desc = could not find container \"672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c\": container with ID starting with 672dee4cf95a1da6e22af4a5461d4e13559d46b4aab4017397c13d256ea15b4c not found: ID does not exist" Sep 19 02:45:39.924472 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.924441 2579 scope.go:117] "RemoveContainer" containerID="a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d" Sep 19 02:45:39.924685 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:45:39.924669 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d\": container with ID starting with a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d not found: ID does not exist" containerID="a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d" Sep 19 02:45:39.924742 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.924689 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d"} err="failed to get container status \"a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d\": rpc error: code = NotFound desc = could not find container \"a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d\": container with ID starting with a584ce39367d14affc374d5c47f71d117fcb78488877a7e391546f5c6fcc7b8d not found: ID does not exist" Sep 19 02:45:39.924742 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.924702 2579 scope.go:117] "RemoveContainer" containerID="99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f" Sep 19 02:45:39.924944 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:45:39.924928 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f\": container with ID starting with 99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f not found: ID does not exist" containerID="99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f" Sep 19 02:45:39.924985 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.924949 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f"} err="failed to get container status \"99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f\": rpc error: code = NotFound desc = could not find container \"99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f\": container with ID starting with 99d67b98e99bfbff9a9b77a01b5ad0b85f3eef5eb7adda37813a1104195c969f not found: ID does not exist" Sep 19 02:45:39.924985 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.924963 2579 scope.go:117] "RemoveContainer" containerID="6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60" Sep 19 02:45:39.925166 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:45:39.925152 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60\": container with ID starting with 6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60 not found: ID does not exist" containerID="6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60" Sep 19 02:45:39.925203 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.925170 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60"} err="failed to get container status \"6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60\": rpc error: code = NotFound desc = could not find container \"6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60\": container with ID starting with 6615b0c0b9cb232daf6d3bfead4ff6b2808d41a0169fb8e0151adc14ae1ddf60 not found: ID does not exist" Sep 19 02:45:39.925203 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.925181 2579 scope.go:117] "RemoveContainer" containerID="0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de" Sep 19 02:45:39.925420 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:45:39.925402 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de\": container with ID starting with 0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de not found: ID does not exist" containerID="0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de" Sep 19 02:45:39.925470 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.925425 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de"} err="failed to get container status \"0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de\": rpc error: code = NotFound desc = could not find container \"0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de\": container with ID starting with 0dcd3cbe4c2835fb12af754d3d64e96a115cc23554858f175c8b7b0f7f3fc0de not found: ID does not exist" Sep 19 02:45:39.925470 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.925439 2579 scope.go:117] "RemoveContainer" containerID="4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d" Sep 19 02:45:39.925657 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:45:39.925640 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d\": container with ID starting with 4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d not found: ID does not exist" containerID="4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d" Sep 19 02:45:39.926121 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.925659 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d"} err="failed to get container status \"4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d\": rpc error: code = NotFound desc = could not find container \"4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d\": container with ID starting with 4cdacb35f9273d67e5846629598e0bebc32b19fa6a414fc1f061d5f18488165d not found: ID does not exist" Sep 19 02:45:39.926121 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.926010 2579 scope.go:117] "RemoveContainer" containerID="016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d" Sep 19 02:45:39.930878 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:45:39.930845 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d\": container with ID starting with 016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d not found: ID does not exist" containerID="016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d" Sep 19 02:45:39.931016 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.930957 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d"} err="failed to get container status \"016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d\": rpc error: code = NotFound desc = could not find container \"016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d\": container with ID starting with 016a80c95035bb86753a693d18da01ca8512629406c38703bafab89a1eb9fe2d not found: ID does not exist" Sep 19 02:45:39.932605 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.932587 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 02:45:39.932992 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.932975 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy-web" Sep 19 02:45:39.933037 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933000 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy-web" Sep 19 02:45:39.933037 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933021 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy-thanos" Sep 19 02:45:39.933037 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933033 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy-thanos" Sep 19 02:45:39.933130 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933048 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy" Sep 19 02:45:39.933130 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933059 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy" Sep 19 02:45:39.933130 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933076 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="thanos-sidecar" Sep 19 02:45:39.933130 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933089 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="thanos-sidecar" Sep 19 02:45:39.933130 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933107 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="init-config-reloader" Sep 19 02:45:39.933130 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933122 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="init-config-reloader" Sep 19 02:45:39.933130 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933129 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="config-reloader" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933133 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="config-reloader" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933143 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab791272-79a3-416a-826e-23d54e2dace0" containerName="console" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933148 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab791272-79a3-416a-826e-23d54e2dace0" containerName="console" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933155 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="prometheus" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933160 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="prometheus" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933199 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="prometheus" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933205 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="config-reloader" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933211 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="thanos-sidecar" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933217 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy-web" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933221 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy-thanos" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933226 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab791272-79a3-416a-826e-23d54e2dace0" containerName="console" Sep 19 02:45:39.933310 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.933231 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62561524-c387-45bb-8585-579b2ed6e83b" containerName="kube-rbac-proxy" Sep 19 02:45:39.937981 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.937965 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:39.940331 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.940313 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 19 02:45:39.940620 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.940599 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 19 02:45:39.940698 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.940599 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 19 02:45:39.940922 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.940901 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 19 02:45:39.941116 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.941098 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 19 02:45:39.941195 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.941138 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8c1po1tuifr55\"" Sep 19 02:45:39.941332 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.941316 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 19 02:45:39.941399 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.941337 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 19 02:45:39.941610 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.941592 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 19 02:45:39.941713 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.941652 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 19 02:45:39.941713 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.941695 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 19 02:45:39.942034 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.942019 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 19 02:45:39.942123 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.942046 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 19 02:45:39.942123 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.942108 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x8c9k\"" Sep 19 02:45:39.944030 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.944010 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 19 02:45:39.944150 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.944055 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62561524-c387-45bb-8585-579b2ed6e83b" path="/var/lib/kubelet/pods/62561524-c387-45bb-8585-579b2ed6e83b/volumes" Sep 19 02:45:39.946509 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.946486 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 19 02:45:39.947630 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:39.947613 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 02:45:40.032336 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-config\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032452 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032338 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032452 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032452 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032452 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032452 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032668 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032668 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032668 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032668 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032668 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032855 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032675 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032855 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032855 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032855 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032855 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.032855 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.033033 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.033033 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.033033 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.032902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv976\" (UniqueName: \"kubernetes.io/projected/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-kube-api-access-sv976\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134224 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134224 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134224 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134224 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134517 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv976\" (UniqueName: \"kubernetes.io/projected/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-kube-api-access-sv976\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134517 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-config\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134517 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134517 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134517 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134517 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134517 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134517 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134931 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134931 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134931 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134931 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134931 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134931 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134931 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134931 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.134931 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.134801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.135481 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.135054 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.135481 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.135300 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.135997 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.135973 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.136799 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.136777 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.137331 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.137302 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.137461 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.137437 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.137548 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.137524 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.137608 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.137587 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.137715 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.137697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.138044 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.137927 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-config\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.138343 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.138301 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.138519 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.138493 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.138938 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.138913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.139926 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.139884 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.140021 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.139932 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.140021 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.139959 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.140167 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.140148 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.140646 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.140625 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.142150 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.142133 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv976\" (UniqueName: \"kubernetes.io/projected/7089d1b6-d31c-4e0b-ad7a-edb279879ae0-kube-api-access-sv976\") pod \"prometheus-k8s-0\" (UID: \"7089d1b6-d31c-4e0b-ad7a-edb279879ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.248196 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.248151 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:45:40.526654 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.526622 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 02:45:40.530033 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:45:40.530004 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7089d1b6_d31c_4e0b_ad7a_edb279879ae0.slice/crio-eb60b8b571092196b6f995116afd0654a4afb6093f2e2b8089a08e2b867e4bb3 WatchSource:0}: Error finding container eb60b8b571092196b6f995116afd0654a4afb6093f2e2b8089a08e2b867e4bb3: Status 404 returned error can't find the container with id eb60b8b571092196b6f995116afd0654a4afb6093f2e2b8089a08e2b867e4bb3 Sep 19 02:45:40.886232 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.886132 2579 generic.go:356] "Generic (PLEG): container finished" podID="7089d1b6-d31c-4e0b-ad7a-edb279879ae0" containerID="ed93c5b3f198ffd66dce253f68418a9707e85953199bf8fa1859039090eb9576" exitCode=0 Sep 19 02:45:40.886232 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.886189 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7089d1b6-d31c-4e0b-ad7a-edb279879ae0","Type":"ContainerDied","Data":"ed93c5b3f198ffd66dce253f68418a9707e85953199bf8fa1859039090eb9576"} Sep 19 02:45:40.886467 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:40.886238 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7089d1b6-d31c-4e0b-ad7a-edb279879ae0","Type":"ContainerStarted","Data":"eb60b8b571092196b6f995116afd0654a4afb6093f2e2b8089a08e2b867e4bb3"} Sep 19 02:45:41.893188 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:41.893152 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7089d1b6-d31c-4e0b-ad7a-edb279879ae0","Type":"ContainerStarted","Data":"30d2b560522163920f36e985725a132679aed396476d1c12cac7aac97ba87f05"} Sep 19 02:45:41.893524 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:41.893248 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7089d1b6-d31c-4e0b-ad7a-edb279879ae0","Type":"ContainerStarted","Data":"5bfa802b161db9b99fb69fa88f097b86e6b7c871cb4bca5cb895f992ea86ca57"} Sep 19 02:45:41.893524 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:41.893279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7089d1b6-d31c-4e0b-ad7a-edb279879ae0","Type":"ContainerStarted","Data":"9a8d3aa4e314e243fc88e0e22bd58cdb264319433d857d53abdc74a95b116495"} Sep 19 02:45:41.893524 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:41.893307 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7089d1b6-d31c-4e0b-ad7a-edb279879ae0","Type":"ContainerStarted","Data":"13809d71a8b7ccb3e928399fc593af9c83978925178a906f26335f1e98d849ad"} Sep 19 02:45:41.893524 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:41.893346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7089d1b6-d31c-4e0b-ad7a-edb279879ae0","Type":"ContainerStarted","Data":"0b39da3019be8972514254264c34e7334a8abea14092cd1470b5918627988938"} Sep 19 02:45:41.893524 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:41.893372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7089d1b6-d31c-4e0b-ad7a-edb279879ae0","Type":"ContainerStarted","Data":"645f36198004adbf6310aede504975889bed38f73512d8ba21ef70829e08fd5d"} Sep 19 02:45:41.920624 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:41.920565 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.900466815 podStartE2EDuration="2.920545586s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.078771ms" isStatefulPod=false podCreationTimestamp="2026-09-19 02:45:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:45:41.919086126 +0000 UTC m=+198.465568935" watchObservedRunningTime="2026-09-19 02:45:41.920545586 +0000 UTC m=+198.467028383" Sep 19 02:45:45.248408 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:45:45.248369 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:46:40.249240 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:46:40.249198 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:46:40.264497 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:46:40.264469 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:46:41.120107 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:46:41.120080 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 02:47:23.773545 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:47:23.773515 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/1.log" Sep 19 02:47:23.776925 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:47:23.776904 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/1.log" Sep 19 02:47:23.783654 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:47:23.783625 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 19 02:50:48.517674 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:48.517639 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl"] Sep 19 02:50:48.520700 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:48.520686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" Sep 19 02:50:48.523174 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:48.523149 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-mkcf4\"/\"openshift-service-ca.crt\"" Sep 19 02:50:48.523174 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:48.523167 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-mkcf4\"/\"default-dockercfg-rfklh\"" Sep 19 02:50:48.524108 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:48.524093 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-mkcf4\"/\"kube-root-ca.crt\"" Sep 19 02:50:48.528368 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:48.528345 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl"] Sep 19 02:50:48.562933 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:48.562901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbmds\" (UniqueName: \"kubernetes.io/projected/8dcf2ad1-371e-4462-83d9-943108c80384-kube-api-access-hbmds\") pod \"e2e-test-torch-node-0-0-pbbwl\" (UID: \"8dcf2ad1-371e-4462-83d9-943108c80384\") " pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" Sep 19 02:50:48.663647 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:48.663603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbmds\" (UniqueName: \"kubernetes.io/projected/8dcf2ad1-371e-4462-83d9-943108c80384-kube-api-access-hbmds\") pod \"e2e-test-torch-node-0-0-pbbwl\" (UID: \"8dcf2ad1-371e-4462-83d9-943108c80384\") " pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" Sep 19 02:50:48.671580 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:48.671553 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbmds\" (UniqueName: \"kubernetes.io/projected/8dcf2ad1-371e-4462-83d9-943108c80384-kube-api-access-hbmds\") pod \"e2e-test-torch-node-0-0-pbbwl\" (UID: \"8dcf2ad1-371e-4462-83d9-943108c80384\") " pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" Sep 19 02:50:48.830060 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:48.829990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" Sep 19 02:50:49.095357 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:49.095334 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl"] Sep 19 02:50:49.097097 ip-10-0-137-27 kubenswrapper[2579]: W0919 02:50:49.097064 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dcf2ad1_371e_4462_83d9_943108c80384.slice/crio-1cb7409006cc21daf2ebf352a801c6e67ffc0ccac2a7d279a7137f05b3e3a069 WatchSource:0}: Error finding container 1cb7409006cc21daf2ebf352a801c6e67ffc0ccac2a7d279a7137f05b3e3a069: Status 404 returned error can't find the container with id 1cb7409006cc21daf2ebf352a801c6e67ffc0ccac2a7d279a7137f05b3e3a069 Sep 19 02:50:49.099022 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:49.099005 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 02:50:50.024349 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:50:50.024291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" event={"ID":"8dcf2ad1-371e-4462-83d9-943108c80384","Type":"ContainerStarted","Data":"1cb7409006cc21daf2ebf352a801c6e67ffc0ccac2a7d279a7137f05b3e3a069"} Sep 19 02:54:23.784354 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:54:23.784269 2579 log.go:32] "ListImages with filter from image service failed" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" filter="" Sep 19 02:54:23.784354 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:54:23.784329 2579 kuberuntime_image.go:108] "Failed to list images" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Sep 19 02:54:23.784354 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:54:23.784343 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Sep 19 02:54:23.787382 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:54:23.787358 2579 log.go:32] "ListImages with filter from image service failed" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" filter="" Sep 19 02:54:23.787447 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:54:23.787386 2579 kuberuntime_image.go:108] "Failed to list images" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Sep 19 02:54:23.787447 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:54:23.787397 2579 image_gc_manager.go:222] "Failed to monitor images" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Sep 19 02:54:25.287475 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:54:25.287430 2579 log.go:32] "ListImages with filter from image service failed" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" filter="" Sep 19 02:54:25.287475 ip-10-0-137-27 kubenswrapper[2579]: E0919 02:54:25.287477 2579 kuberuntime_image.go:108] "Failed to list images" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Sep 19 02:54:25.287885 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:54:25.287491 2579 image_gc_manager.go:230] "Failed to update image list" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Sep 19 02:54:57.170151 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:54:57.170115 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" event={"ID":"8dcf2ad1-371e-4462-83d9-943108c80384","Type":"ContainerStarted","Data":"31c64663cc7d19a724ef1033a553bea042dcdac25ae53e493545a3fca1d2e199"} Sep 19 02:54:57.189652 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:54:57.189597 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" podStartSLOduration=1.342034428 podStartE2EDuration="4m9.189578283s" totalImagesPullingTime="4m7.847543855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 02:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 02:54:57.188379893 +0000 UTC m=+753.734862702" watchObservedRunningTime="2026-09-19 02:54:57.189578283 +0000 UTC m=+753.736061080" Sep 19 02:59:23.799602 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:59:23.799569 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/1.log" Sep 19 02:59:23.802118 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:59:23.802008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/1.log" Sep 19 02:59:23.809352 ip-10-0-137-27 kubenswrapper[2579]: I0919 02:59:23.809333 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 19 03:00:48.851376 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:48.851302 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw"] Sep 19 03:00:48.858082 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:48.858053 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw" Sep 19 03:00:48.860293 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:48.860266 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-xcb7d\"/\"kube-root-ca.crt\"" Sep 19 03:00:48.860422 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:48.860307 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-xcb7d\"/\"openshift-service-ca.crt\"" Sep 19 03:00:48.860422 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:48.860360 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-xcb7d\"/\"default-dockercfg-qkgdr\"" Sep 19 03:00:48.867958 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:48.867939 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw"] Sep 19 03:00:48.898371 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:48.898349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtd2x\" (UniqueName: \"kubernetes.io/projected/dd61d52b-3d85-44ad-9fb8-d59c02a05e18-kube-api-access-dtd2x\") pod \"e2e-test-jax-node-0-0-nhbcw\" (UID: \"dd61d52b-3d85-44ad-9fb8-d59c02a05e18\") " pod="e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw" Sep 19 03:00:48.998959 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:48.998921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtd2x\" (UniqueName: \"kubernetes.io/projected/dd61d52b-3d85-44ad-9fb8-d59c02a05e18-kube-api-access-dtd2x\") pod \"e2e-test-jax-node-0-0-nhbcw\" (UID: \"dd61d52b-3d85-44ad-9fb8-d59c02a05e18\") " pod="e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw" Sep 19 03:00:49.006801 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:49.006759 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtd2x\" (UniqueName: \"kubernetes.io/projected/dd61d52b-3d85-44ad-9fb8-d59c02a05e18-kube-api-access-dtd2x\") pod \"e2e-test-jax-node-0-0-nhbcw\" (UID: \"dd61d52b-3d85-44ad-9fb8-d59c02a05e18\") " pod="e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw" Sep 19 03:00:49.166744 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:49.166716 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw" Sep 19 03:00:49.439564 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:49.439540 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw"] Sep 19 03:00:49.441750 ip-10-0-137-27 kubenswrapper[2579]: W0919 03:00:49.441704 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd61d52b_3d85_44ad_9fb8_d59c02a05e18.slice/crio-f5b52fca2d2a61bf82b40f0eb26a56547addc0e254b5a477d3948da1842a085c WatchSource:0}: Error finding container f5b52fca2d2a61bf82b40f0eb26a56547addc0e254b5a477d3948da1842a085c: Status 404 returned error can't find the container with id f5b52fca2d2a61bf82b40f0eb26a56547addc0e254b5a477d3948da1842a085c Sep 19 03:00:49.443753 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:49.443736 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 03:00:49.474824 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:49.474794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw" event={"ID":"dd61d52b-3d85-44ad-9fb8-d59c02a05e18","Type":"ContainerStarted","Data":"f5b52fca2d2a61bf82b40f0eb26a56547addc0e254b5a477d3948da1842a085c"} Sep 19 03:00:53.682302 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:53.682262 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl"] Sep 19 03:00:53.682816 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:53.682483 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" podUID="8dcf2ad1-371e-4462-83d9-943108c80384" containerName="node" containerID="cri-o://31c64663cc7d19a724ef1033a553bea042dcdac25ae53e493545a3fca1d2e199" gracePeriod=30 Sep 19 03:00:56.521625 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:56.521516 2579 generic.go:356] "Generic (PLEG): container finished" podID="8dcf2ad1-371e-4462-83d9-943108c80384" containerID="31c64663cc7d19a724ef1033a553bea042dcdac25ae53e493545a3fca1d2e199" exitCode=0 Sep 19 03:00:56.521625 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:56.521600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" event={"ID":"8dcf2ad1-371e-4462-83d9-943108c80384","Type":"ContainerDied","Data":"31c64663cc7d19a724ef1033a553bea042dcdac25ae53e493545a3fca1d2e199"} Sep 19 03:00:57.654063 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:57.654027 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" Sep 19 03:00:57.782325 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:57.781633 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbmds\" (UniqueName: \"kubernetes.io/projected/8dcf2ad1-371e-4462-83d9-943108c80384-kube-api-access-hbmds\") pod \"8dcf2ad1-371e-4462-83d9-943108c80384\" (UID: \"8dcf2ad1-371e-4462-83d9-943108c80384\") " Sep 19 03:00:57.787033 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:57.786997 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dcf2ad1-371e-4462-83d9-943108c80384-kube-api-access-hbmds" (OuterVolumeSpecName: "kube-api-access-hbmds") pod "8dcf2ad1-371e-4462-83d9-943108c80384" (UID: "8dcf2ad1-371e-4462-83d9-943108c80384"). InnerVolumeSpecName "kube-api-access-hbmds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 03:00:57.883231 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:57.883150 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbmds\" (UniqueName: \"kubernetes.io/projected/8dcf2ad1-371e-4462-83d9-943108c80384-kube-api-access-hbmds\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:00:58.535424 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:58.535378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" event={"ID":"8dcf2ad1-371e-4462-83d9-943108c80384","Type":"ContainerDied","Data":"1cb7409006cc21daf2ebf352a801c6e67ffc0ccac2a7d279a7137f05b3e3a069"} Sep 19 03:00:58.535613 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:58.535442 2579 scope.go:117] "RemoveContainer" containerID="31c64663cc7d19a724ef1033a553bea042dcdac25ae53e493545a3fca1d2e199" Sep 19 03:00:58.535613 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:58.535596 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl" Sep 19 03:00:58.558115 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:58.558077 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl"] Sep 19 03:00:58.558589 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:58.558567 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-mkcf4/e2e-test-torch-node-0-0-pbbwl"] Sep 19 03:00:59.941524 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:00:59.941146 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dcf2ad1-371e-4462-83d9-943108c80384" path="/var/lib/kubelet/pods/8dcf2ad1-371e-4462-83d9-943108c80384/volumes" Sep 19 03:02:41.021260 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:41.021182 2579 generic.go:356] "Generic (PLEG): container finished" podID="dd61d52b-3d85-44ad-9fb8-d59c02a05e18" containerID="226e9ead850a3df50781737df37834fbb6ce9fd2735d4df24105f5d50d4569f6" exitCode=0 Sep 19 03:02:41.021649 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:41.021262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw" event={"ID":"dd61d52b-3d85-44ad-9fb8-d59c02a05e18","Type":"ContainerDied","Data":"226e9ead850a3df50781737df37834fbb6ce9fd2735d4df24105f5d50d4569f6"} Sep 19 03:02:42.197312 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:42.197284 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw" Sep 19 03:02:42.295567 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:42.295496 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtd2x\" (UniqueName: \"kubernetes.io/projected/dd61d52b-3d85-44ad-9fb8-d59c02a05e18-kube-api-access-dtd2x\") pod \"dd61d52b-3d85-44ad-9fb8-d59c02a05e18\" (UID: \"dd61d52b-3d85-44ad-9fb8-d59c02a05e18\") " Sep 19 03:02:42.297659 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:42.297629 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd61d52b-3d85-44ad-9fb8-d59c02a05e18-kube-api-access-dtd2x" (OuterVolumeSpecName: "kube-api-access-dtd2x") pod "dd61d52b-3d85-44ad-9fb8-d59c02a05e18" (UID: "dd61d52b-3d85-44ad-9fb8-d59c02a05e18"). InnerVolumeSpecName "kube-api-access-dtd2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 03:02:42.396174 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:42.396138 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtd2x\" (UniqueName: \"kubernetes.io/projected/dd61d52b-3d85-44ad-9fb8-d59c02a05e18-kube-api-access-dtd2x\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:02:43.029625 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:43.029591 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw" Sep 19 03:02:43.029822 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:43.029630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw" event={"ID":"dd61d52b-3d85-44ad-9fb8-d59c02a05e18","Type":"ContainerDied","Data":"f5b52fca2d2a61bf82b40f0eb26a56547addc0e254b5a477d3948da1842a085c"} Sep 19 03:02:43.029822 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:43.029662 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5b52fca2d2a61bf82b40f0eb26a56547addc0e254b5a477d3948da1842a085c" Sep 19 03:02:48.444393 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:48.444355 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw"] Sep 19 03:02:48.446324 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:48.446300 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-xcb7d/e2e-test-jax-node-0-0-nhbcw"] Sep 19 03:02:49.938959 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:02:49.938920 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd61d52b-3d85-44ad-9fb8-d59c02a05e18" path="/var/lib/kubelet/pods/dd61d52b-3d85-44ad-9fb8-d59c02a05e18/volumes" Sep 19 03:03:26.220693 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.220617 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-v9j7z/e2e-test-flux-node-0-0-2mclx"] Sep 19 03:03:26.221144 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.220895 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd61d52b-3d85-44ad-9fb8-d59c02a05e18" containerName="node" Sep 19 03:03:26.221144 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.220907 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd61d52b-3d85-44ad-9fb8-d59c02a05e18" containerName="node" Sep 19 03:03:26.221144 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.220923 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcf2ad1-371e-4462-83d9-943108c80384" containerName="node" Sep 19 03:03:26.221144 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.220928 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcf2ad1-371e-4462-83d9-943108c80384" containerName="node" Sep 19 03:03:26.221144 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.220979 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dcf2ad1-371e-4462-83d9-943108c80384" containerName="node" Sep 19 03:03:26.221144 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.220989 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd61d52b-3d85-44ad-9fb8-d59c02a05e18" containerName="node" Sep 19 03:03:26.223889 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.223874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.227472 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.227433 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-v9j7z\"/\"e2e-test-flux-flux-curve\"" Sep 19 03:03:26.227602 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.227526 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-v9j7z\"/\"e2e-test-flux-flux-entrypoint\"" Sep 19 03:03:26.227602 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.227589 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-v9j7z\"/\"kube-root-ca.crt\"" Sep 19 03:03:26.230782 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.228071 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-v9j7z\"/\"openshift-service-ca.crt\"" Sep 19 03:03:26.230782 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.228958 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-v9j7z\"/\"default-dockercfg-xfrq6\"" Sep 19 03:03:26.233932 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.233908 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-v9j7z/e2e-test-flux-node-0-0-2mclx"] Sep 19 03:03:26.324337 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.324311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/17aa6299-490f-4467-a997-e1efa70f6c05-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.324473 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.324342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-flux-install\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.324473 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.324361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rl28\" (UniqueName: \"kubernetes.io/projected/17aa6299-490f-4467-a997-e1efa70f6c05-kube-api-access-8rl28\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.324473 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.324410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-shared-memory\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.324578 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.324500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-spack-install\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.324578 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.324518 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/17aa6299-490f-4467-a997-e1efa70f6c05-flux-curve\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.425062 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.425032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-flux-install\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.425212 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.425068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rl28\" (UniqueName: \"kubernetes.io/projected/17aa6299-490f-4467-a997-e1efa70f6c05-kube-api-access-8rl28\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.425212 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.425094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-shared-memory\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.425212 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.425154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-spack-install\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.425212 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.425180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/17aa6299-490f-4467-a997-e1efa70f6c05-flux-curve\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.425417 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.425239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/17aa6299-490f-4467-a997-e1efa70f6c05-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.425475 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.425432 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-flux-install\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.425535 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.425519 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-spack-install\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.425979 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.425959 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/17aa6299-490f-4467-a997-e1efa70f6c05-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.427230 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.427210 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-shared-memory\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.427417 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.427401 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/17aa6299-490f-4467-a997-e1efa70f6c05-flux-curve\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.432354 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.432331 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rl28\" (UniqueName: \"kubernetes.io/projected/17aa6299-490f-4467-a997-e1efa70f6c05-kube-api-access-8rl28\") pod \"e2e-test-flux-node-0-0-2mclx\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.539395 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.539322 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:26.807260 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:26.807186 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-v9j7z/e2e-test-flux-node-0-0-2mclx"] Sep 19 03:03:26.810736 ip-10-0-137-27 kubenswrapper[2579]: W0919 03:03:26.810708 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17aa6299_490f_4467_a997_e1efa70f6c05.slice/crio-96952c8ce5c539f07d8781d9bdac09d4c0f1136cee8909190f13984dc80b2556 WatchSource:0}: Error finding container 96952c8ce5c539f07d8781d9bdac09d4c0f1136cee8909190f13984dc80b2556: Status 404 returned error can't find the container with id 96952c8ce5c539f07d8781d9bdac09d4c0f1136cee8909190f13984dc80b2556 Sep 19 03:03:27.196282 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:27.196240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" event={"ID":"17aa6299-490f-4467-a997-e1efa70f6c05","Type":"ContainerStarted","Data":"96952c8ce5c539f07d8781d9bdac09d4c0f1136cee8909190f13984dc80b2556"} Sep 19 03:03:38.255524 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:38.255483 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" event={"ID":"17aa6299-490f-4467-a997-e1efa70f6c05","Type":"ContainerStarted","Data":"701bc947d504035b0cfaf5dd9d709215a42307dc1008b9a38d04a3106372a153"} Sep 19 03:03:41.269599 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:41.269558 2579 generic.go:356] "Generic (PLEG): container finished" podID="17aa6299-490f-4467-a997-e1efa70f6c05" containerID="701bc947d504035b0cfaf5dd9d709215a42307dc1008b9a38d04a3106372a153" exitCode=0 Sep 19 03:03:41.270007 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:41.269631 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" event={"ID":"17aa6299-490f-4467-a997-e1efa70f6c05","Type":"ContainerDied","Data":"701bc947d504035b0cfaf5dd9d709215a42307dc1008b9a38d04a3106372a153"} Sep 19 03:03:43.280885 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:43.280810 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" event={"ID":"17aa6299-490f-4467-a997-e1efa70f6c05","Type":"ContainerStarted","Data":"d635cdbb11a3d23f23101cc0f698ab1a36e0bffeb8ce9df4090fd32c94878e22"} Sep 19 03:03:43.297966 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:43.297905 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" podStartSLOduration=2.022138924 podStartE2EDuration="17.297884108s" totalImagesPullingTime="12.077353051s" totalInitContainerRuntime="3.198392133s" isStatefulPod=false podCreationTimestamp="2026-09-19 03:03:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 03:03:43.297004064 +0000 UTC m=+1279.843486873" watchObservedRunningTime="2026-09-19 03:03:43.297884108 +0000 UTC m=+1279.844366907" Sep 19 03:03:52.326847 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:52.326812 2579 generic.go:356] "Generic (PLEG): container finished" podID="17aa6299-490f-4467-a997-e1efa70f6c05" containerID="d635cdbb11a3d23f23101cc0f698ab1a36e0bffeb8ce9df4090fd32c94878e22" exitCode=0 Sep 19 03:03:52.327250 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:52.326856 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" event={"ID":"17aa6299-490f-4467-a997-e1efa70f6c05","Type":"ContainerDied","Data":"d635cdbb11a3d23f23101cc0f698ab1a36e0bffeb8ce9df4090fd32c94878e22"} Sep 19 03:03:53.532375 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.532346 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:53.661660 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.661630 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-shared-memory\") pod \"17aa6299-490f-4467-a997-e1efa70f6c05\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " Sep 19 03:03:53.661660 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.661666 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/17aa6299-490f-4467-a997-e1efa70f6c05-flux-curve\") pod \"17aa6299-490f-4467-a997-e1efa70f6c05\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " Sep 19 03:03:53.661909 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.661719 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rl28\" (UniqueName: \"kubernetes.io/projected/17aa6299-490f-4467-a997-e1efa70f6c05-kube-api-access-8rl28\") pod \"17aa6299-490f-4467-a997-e1efa70f6c05\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " Sep 19 03:03:53.661909 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.661745 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-spack-install\") pod \"17aa6299-490f-4467-a997-e1efa70f6c05\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " Sep 19 03:03:53.661909 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.661818 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/17aa6299-490f-4467-a997-e1efa70f6c05-e2e-test-flux-flux-entrypoint\") pod \"17aa6299-490f-4467-a997-e1efa70f6c05\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " Sep 19 03:03:53.661909 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.661869 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-flux-install\") pod \"17aa6299-490f-4467-a997-e1efa70f6c05\" (UID: \"17aa6299-490f-4467-a997-e1efa70f6c05\") " Sep 19 03:03:53.662301 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.662268 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17aa6299-490f-4467-a997-e1efa70f6c05-e2e-test-flux-flux-entrypoint" (OuterVolumeSpecName: "e2e-test-flux-flux-entrypoint") pod "17aa6299-490f-4467-a997-e1efa70f6c05" (UID: "17aa6299-490f-4467-a997-e1efa70f6c05"). InnerVolumeSpecName "e2e-test-flux-flux-entrypoint". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 03:03:53.663915 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.663886 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-shared-memory" (OuterVolumeSpecName: "shared-memory") pod "17aa6299-490f-4467-a997-e1efa70f6c05" (UID: "17aa6299-490f-4467-a997-e1efa70f6c05"). InnerVolumeSpecName "shared-memory". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 03:03:53.664247 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.664228 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17aa6299-490f-4467-a997-e1efa70f6c05-kube-api-access-8rl28" (OuterVolumeSpecName: "kube-api-access-8rl28") pod "17aa6299-490f-4467-a997-e1efa70f6c05" (UID: "17aa6299-490f-4467-a997-e1efa70f6c05"). InnerVolumeSpecName "kube-api-access-8rl28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 03:03:53.664312 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.664265 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17aa6299-490f-4467-a997-e1efa70f6c05-flux-curve" (OuterVolumeSpecName: "flux-curve") pod "17aa6299-490f-4467-a997-e1efa70f6c05" (UID: "17aa6299-490f-4467-a997-e1efa70f6c05"). InnerVolumeSpecName "flux-curve". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 03:03:53.763497 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.763463 2579 reconciler_common.go:299] "Volume detached for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-shared-memory\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:03:53.763669 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.763508 2579 reconciler_common.go:299] "Volume detached for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/17aa6299-490f-4467-a997-e1efa70f6c05-flux-curve\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:03:53.763669 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.763517 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rl28\" (UniqueName: \"kubernetes.io/projected/17aa6299-490f-4467-a997-e1efa70f6c05-kube-api-access-8rl28\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:03:53.763669 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:53.763526 2579 reconciler_common.go:299] "Volume detached for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/17aa6299-490f-4467-a997-e1efa70f6c05-e2e-test-flux-flux-entrypoint\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:03:54.337267 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:54.337226 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" event={"ID":"17aa6299-490f-4467-a997-e1efa70f6c05","Type":"ContainerDied","Data":"96952c8ce5c539f07d8781d9bdac09d4c0f1136cee8909190f13984dc80b2556"} Sep 19 03:03:54.337267 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:54.337261 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-v9j7z/e2e-test-flux-node-0-0-2mclx" Sep 19 03:03:54.337462 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:54.337270 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96952c8ce5c539f07d8781d9bdac09d4c0f1136cee8909190f13984dc80b2556" Sep 19 03:03:55.543077 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:55.543021 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-flux-install" (OuterVolumeSpecName: "flux-install") pod "17aa6299-490f-4467-a997-e1efa70f6c05" (UID: "17aa6299-490f-4467-a997-e1efa70f6c05"). InnerVolumeSpecName "flux-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 03:03:55.580802 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:55.580776 2579 reconciler_common.go:299] "Volume detached for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-flux-install\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:03:58.384338 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:58.384295 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-spack-install" (OuterVolumeSpecName: "spack-install") pod "17aa6299-490f-4467-a997-e1efa70f6c05" (UID: "17aa6299-490f-4467-a997-e1efa70f6c05"). InnerVolumeSpecName "spack-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 03:03:58.403190 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:58.403162 2579 reconciler_common.go:299] "Volume detached for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/17aa6299-490f-4467-a997-e1efa70f6c05-spack-install\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:03:59.315069 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:59.315032 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-v9j7z/e2e-test-flux-node-0-0-2mclx"] Sep 19 03:03:59.318942 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:59.318914 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-v9j7z/e2e-test-flux-node-0-0-2mclx"] Sep 19 03:03:59.938399 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:03:59.938364 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17aa6299-490f-4467-a997-e1efa70f6c05" path="/var/lib/kubelet/pods/17aa6299-490f-4467-a997-e1efa70f6c05/volumes" Sep 19 03:04:20.232403 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.232365 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x"] Sep 19 03:04:20.232758 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.232634 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17aa6299-490f-4467-a997-e1efa70f6c05" containerName="flux-installer" Sep 19 03:04:20.232758 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.232645 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="17aa6299-490f-4467-a997-e1efa70f6c05" containerName="flux-installer" Sep 19 03:04:20.232758 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.232667 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17aa6299-490f-4467-a997-e1efa70f6c05" containerName="node" Sep 19 03:04:20.232758 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.232674 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="17aa6299-490f-4467-a997-e1efa70f6c05" containerName="node" Sep 19 03:04:20.232758 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.232722 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="17aa6299-490f-4467-a997-e1efa70f6c05" containerName="node" Sep 19 03:04:20.271257 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.271223 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x"] Sep 19 03:04:20.271403 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.271310 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" Sep 19 03:04:20.273931 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.273910 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-66mtr\"/\"kube-root-ca.crt\"" Sep 19 03:04:20.274833 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.274791 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-66mtr\"/\"openshift-service-ca.crt\"" Sep 19 03:04:20.274833 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.274800 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-66mtr\"/\"default-dockercfg-gnpvp\"" Sep 19 03:04:20.280721 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.280696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvq9g\" (UniqueName: \"kubernetes.io/projected/aac06101-69c1-43f6-a781-b02af4123cfa-kube-api-access-mvq9g\") pod \"e2e-test-runtime-update-node-0-0-8t64x\" (UID: \"aac06101-69c1-43f6-a781-b02af4123cfa\") " pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" Sep 19 03:04:20.381713 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.381659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvq9g\" (UniqueName: \"kubernetes.io/projected/aac06101-69c1-43f6-a781-b02af4123cfa-kube-api-access-mvq9g\") pod \"e2e-test-runtime-update-node-0-0-8t64x\" (UID: \"aac06101-69c1-43f6-a781-b02af4123cfa\") " pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" Sep 19 03:04:20.389865 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.389838 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvq9g\" (UniqueName: \"kubernetes.io/projected/aac06101-69c1-43f6-a781-b02af4123cfa-kube-api-access-mvq9g\") pod \"e2e-test-runtime-update-node-0-0-8t64x\" (UID: \"aac06101-69c1-43f6-a781-b02af4123cfa\") " pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" Sep 19 03:04:20.469710 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.469672 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x"] Sep 19 03:04:20.469939 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.469926 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" Sep 19 03:04:20.741276 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.741251 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x"] Sep 19 03:04:20.744050 ip-10-0-137-27 kubenswrapper[2579]: W0919 03:04:20.744019 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaac06101_69c1_43f6_a781_b02af4123cfa.slice/crio-b97ada6cc40ae36c184adc8f542fa803601def003ed8ca778d71a38821f71906 WatchSource:0}: Error finding container b97ada6cc40ae36c184adc8f542fa803601def003ed8ca778d71a38821f71906: Status 404 returned error can't find the container with id b97ada6cc40ae36c184adc8f542fa803601def003ed8ca778d71a38821f71906 Sep 19 03:04:20.773652 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.773578 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq"] Sep 19 03:04:20.778029 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.778007 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" Sep 19 03:04:20.785931 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.785906 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq"] Sep 19 03:04:20.886429 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.886393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9z8d\" (UniqueName: \"kubernetes.io/projected/0d41dc14-c43d-465c-89af-cca2f1d761f9-kube-api-access-f9z8d\") pod \"e2e-test-runtime-update-node-0-0-6khnq\" (UID: \"0d41dc14-c43d-465c-89af-cca2f1d761f9\") " pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" Sep 19 03:04:20.987630 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.987595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9z8d\" (UniqueName: \"kubernetes.io/projected/0d41dc14-c43d-465c-89af-cca2f1d761f9-kube-api-access-f9z8d\") pod \"e2e-test-runtime-update-node-0-0-6khnq\" (UID: \"0d41dc14-c43d-465c-89af-cca2f1d761f9\") " pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" Sep 19 03:04:20.997478 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:20.997445 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9z8d\" (UniqueName: \"kubernetes.io/projected/0d41dc14-c43d-465c-89af-cca2f1d761f9-kube-api-access-f9z8d\") pod \"e2e-test-runtime-update-node-0-0-6khnq\" (UID: \"0d41dc14-c43d-465c-89af-cca2f1d761f9\") " pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" Sep 19 03:04:21.018949 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.018916 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq"] Sep 19 03:04:21.019160 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.019147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" Sep 19 03:04:21.301583 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.301557 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq"] Sep 19 03:04:21.303681 ip-10-0-137-27 kubenswrapper[2579]: W0919 03:04:21.303655 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d41dc14_c43d_465c_89af_cca2f1d761f9.slice/crio-50df1be7c94163cdc3fe02b217419368389c33d30113b0af0aaf947cc3c4bb1a WatchSource:0}: Error finding container 50df1be7c94163cdc3fe02b217419368389c33d30113b0af0aaf947cc3c4bb1a: Status 404 returned error can't find the container with id 50df1be7c94163cdc3fe02b217419368389c33d30113b0af0aaf947cc3c4bb1a Sep 19 03:04:21.356981 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.356958 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g"] Sep 19 03:04:21.360134 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.360117 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" Sep 19 03:04:21.362406 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.362389 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-llfmm\"/\"openshift-service-ca.crt\"" Sep 19 03:04:21.362406 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.362402 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-llfmm\"/\"kube-root-ca.crt\"" Sep 19 03:04:21.362567 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.362442 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-llfmm\"/\"default-dockercfg-7sz97\"" Sep 19 03:04:21.367877 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.367852 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g"] Sep 19 03:04:21.390254 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.390222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg447\" (UniqueName: \"kubernetes.io/projected/8bf89373-be4e-4ada-a46c-800c265d95f6-kube-api-access-kg447\") pod \"e2e-test-runtime-update-node-0-0-zgp5g\" (UID: \"8bf89373-be4e-4ada-a46c-800c265d95f6\") " pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" Sep 19 03:04:21.446411 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.446370 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" podUID="0d41dc14-c43d-465c-89af-cca2f1d761f9" containerName="node" containerID="cri-o://3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f" gracePeriod=30 Sep 19 03:04:21.446610 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.446373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" event={"ID":"0d41dc14-c43d-465c-89af-cca2f1d761f9","Type":"ContainerStarted","Data":"3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f"} Sep 19 03:04:21.446610 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.446489 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" event={"ID":"0d41dc14-c43d-465c-89af-cca2f1d761f9","Type":"ContainerStarted","Data":"50df1be7c94163cdc3fe02b217419368389c33d30113b0af0aaf947cc3c4bb1a"} Sep 19 03:04:21.448127 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.448103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" event={"ID":"aac06101-69c1-43f6-a781-b02af4123cfa","Type":"ContainerStarted","Data":"9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4"} Sep 19 03:04:21.448267 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.448132 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" event={"ID":"aac06101-69c1-43f6-a781-b02af4123cfa","Type":"ContainerStarted","Data":"b97ada6cc40ae36c184adc8f542fa803601def003ed8ca778d71a38821f71906"} Sep 19 03:04:21.448267 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.448184 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" podUID="aac06101-69c1-43f6-a781-b02af4123cfa" containerName="node" containerID="cri-o://9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4" gracePeriod=30 Sep 19 03:04:21.462510 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.462466 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" podStartSLOduration=1.462451403 podStartE2EDuration="1.462451403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 03:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 03:04:21.461745877 +0000 UTC m=+1318.008228678" watchObservedRunningTime="2026-09-19 03:04:21.462451403 +0000 UTC m=+1318.008934197" Sep 19 03:04:21.479759 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.479712 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" podStartSLOduration=1.140814592 podStartE2EDuration="1.47969368s" totalImagesPullingTime="338.879088ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 03:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 03:04:21.477993415 +0000 UTC m=+1318.024476216" watchObservedRunningTime="2026-09-19 03:04:21.47969368 +0000 UTC m=+1318.026176478" Sep 19 03:04:21.491027 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.490998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg447\" (UniqueName: \"kubernetes.io/projected/8bf89373-be4e-4ada-a46c-800c265d95f6-kube-api-access-kg447\") pod \"e2e-test-runtime-update-node-0-0-zgp5g\" (UID: \"8bf89373-be4e-4ada-a46c-800c265d95f6\") " pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" Sep 19 03:04:21.498733 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.498709 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg447\" (UniqueName: \"kubernetes.io/projected/8bf89373-be4e-4ada-a46c-800c265d95f6-kube-api-access-kg447\") pod \"e2e-test-runtime-update-node-0-0-zgp5g\" (UID: \"8bf89373-be4e-4ada-a46c-800c265d95f6\") " pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" Sep 19 03:04:21.600518 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.600474 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g"] Sep 19 03:04:21.601054 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.601031 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" Sep 19 03:04:21.713156 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.713135 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" Sep 19 03:04:21.717127 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.717101 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" Sep 19 03:04:21.794938 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.794903 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvq9g\" (UniqueName: \"kubernetes.io/projected/aac06101-69c1-43f6-a781-b02af4123cfa-kube-api-access-mvq9g\") pod \"aac06101-69c1-43f6-a781-b02af4123cfa\" (UID: \"aac06101-69c1-43f6-a781-b02af4123cfa\") " Sep 19 03:04:21.794938 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.794956 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9z8d\" (UniqueName: \"kubernetes.io/projected/0d41dc14-c43d-465c-89af-cca2f1d761f9-kube-api-access-f9z8d\") pod \"0d41dc14-c43d-465c-89af-cca2f1d761f9\" (UID: \"0d41dc14-c43d-465c-89af-cca2f1d761f9\") " Sep 19 03:04:21.797119 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.797091 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d41dc14-c43d-465c-89af-cca2f1d761f9-kube-api-access-f9z8d" (OuterVolumeSpecName: "kube-api-access-f9z8d") pod "0d41dc14-c43d-465c-89af-cca2f1d761f9" (UID: "0d41dc14-c43d-465c-89af-cca2f1d761f9"). InnerVolumeSpecName "kube-api-access-f9z8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 03:04:21.797231 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.797123 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac06101-69c1-43f6-a781-b02af4123cfa-kube-api-access-mvq9g" (OuterVolumeSpecName: "kube-api-access-mvq9g") pod "aac06101-69c1-43f6-a781-b02af4123cfa" (UID: "aac06101-69c1-43f6-a781-b02af4123cfa"). InnerVolumeSpecName "kube-api-access-mvq9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 03:04:21.877403 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.877291 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g"] Sep 19 03:04:21.881366 ip-10-0-137-27 kubenswrapper[2579]: W0919 03:04:21.881337 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bf89373_be4e_4ada_a46c_800c265d95f6.slice/crio-5dbdbda93afb725dae6bb6970925a3ed5c5f21fa813435efd31223ff97fe269e WatchSource:0}: Error finding container 5dbdbda93afb725dae6bb6970925a3ed5c5f21fa813435efd31223ff97fe269e: Status 404 returned error can't find the container with id 5dbdbda93afb725dae6bb6970925a3ed5c5f21fa813435efd31223ff97fe269e Sep 19 03:04:21.895385 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.895300 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd"] Sep 19 03:04:21.895656 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.895633 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvq9g\" (UniqueName: \"kubernetes.io/projected/aac06101-69c1-43f6-a781-b02af4123cfa-kube-api-access-mvq9g\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:04:21.895742 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.895665 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9z8d\" (UniqueName: \"kubernetes.io/projected/0d41dc14-c43d-465c-89af-cca2f1d761f9-kube-api-access-f9z8d\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:04:21.895742 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.895644 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac06101-69c1-43f6-a781-b02af4123cfa" containerName="node" Sep 19 03:04:21.895742 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.895689 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac06101-69c1-43f6-a781-b02af4123cfa" containerName="node" Sep 19 03:04:21.895742 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.895716 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d41dc14-c43d-465c-89af-cca2f1d761f9" containerName="node" Sep 19 03:04:21.895742 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.895725 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d41dc14-c43d-465c-89af-cca2f1d761f9" containerName="node" Sep 19 03:04:21.895999 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.895860 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac06101-69c1-43f6-a781-b02af4123cfa" containerName="node" Sep 19 03:04:21.895999 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.895875 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d41dc14-c43d-465c-89af-cca2f1d761f9" containerName="node" Sep 19 03:04:21.899917 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.899897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" Sep 19 03:04:21.906874 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.906855 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd"] Sep 19 03:04:21.996551 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:21.996511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhd55\" (UniqueName: \"kubernetes.io/projected/35f20254-3169-441e-ab8b-3a20bbcf849e-kube-api-access-dhd55\") pod \"e2e-test-runtime-update-node-0-0-8b4wd\" (UID: \"35f20254-3169-441e-ab8b-3a20bbcf849e\") " pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" Sep 19 03:04:22.097869 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.097832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhd55\" (UniqueName: \"kubernetes.io/projected/35f20254-3169-441e-ab8b-3a20bbcf849e-kube-api-access-dhd55\") pod \"e2e-test-runtime-update-node-0-0-8b4wd\" (UID: \"35f20254-3169-441e-ab8b-3a20bbcf849e\") " pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" Sep 19 03:04:22.105445 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.105424 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhd55\" (UniqueName: \"kubernetes.io/projected/35f20254-3169-441e-ab8b-3a20bbcf849e-kube-api-access-dhd55\") pod \"e2e-test-runtime-update-node-0-0-8b4wd\" (UID: \"35f20254-3169-441e-ab8b-3a20bbcf849e\") " pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" Sep 19 03:04:22.135899 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.135828 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd"] Sep 19 03:04:22.136074 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.136062 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" Sep 19 03:04:22.402822 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.402786 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd"] Sep 19 03:04:22.405410 ip-10-0-137-27 kubenswrapper[2579]: W0919 03:04:22.405383 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35f20254_3169_441e_ab8b_3a20bbcf849e.slice/crio-4ae999ba1d3eb712830caa7d930b6bd57dce0d73611c5e87dc26445eed455933 WatchSource:0}: Error finding container 4ae999ba1d3eb712830caa7d930b6bd57dce0d73611c5e87dc26445eed455933: Status 404 returned error can't find the container with id 4ae999ba1d3eb712830caa7d930b6bd57dce0d73611c5e87dc26445eed455933 Sep 19 03:04:22.453533 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.453506 2579 generic.go:356] "Generic (PLEG): container finished" podID="aac06101-69c1-43f6-a781-b02af4123cfa" containerID="9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4" exitCode=0 Sep 19 03:04:22.453644 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.453543 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" Sep 19 03:04:22.453644 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.453583 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" event={"ID":"aac06101-69c1-43f6-a781-b02af4123cfa","Type":"ContainerDied","Data":"9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4"} Sep 19 03:04:22.453644 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.453623 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x" event={"ID":"aac06101-69c1-43f6-a781-b02af4123cfa","Type":"ContainerDied","Data":"b97ada6cc40ae36c184adc8f542fa803601def003ed8ca778d71a38821f71906"} Sep 19 03:04:22.453644 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.453640 2579 scope.go:117] "RemoveContainer" containerID="9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4" Sep 19 03:04:22.454981 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.454961 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" event={"ID":"35f20254-3169-441e-ab8b-3a20bbcf849e","Type":"ContainerStarted","Data":"4ae999ba1d3eb712830caa7d930b6bd57dce0d73611c5e87dc26445eed455933"} Sep 19 03:04:22.456713 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.456693 2579 generic.go:356] "Generic (PLEG): container finished" podID="0d41dc14-c43d-465c-89af-cca2f1d761f9" containerID="3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f" exitCode=0 Sep 19 03:04:22.456832 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.456722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" event={"ID":"0d41dc14-c43d-465c-89af-cca2f1d761f9","Type":"ContainerDied","Data":"3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f"} Sep 19 03:04:22.456832 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.456743 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" Sep 19 03:04:22.456832 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.456758 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq" event={"ID":"0d41dc14-c43d-465c-89af-cca2f1d761f9","Type":"ContainerDied","Data":"50df1be7c94163cdc3fe02b217419368389c33d30113b0af0aaf947cc3c4bb1a"} Sep 19 03:04:22.458827 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.458802 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" event={"ID":"8bf89373-be4e-4ada-a46c-800c265d95f6","Type":"ContainerStarted","Data":"de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d"} Sep 19 03:04:22.459026 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.458839 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" event={"ID":"8bf89373-be4e-4ada-a46c-800c265d95f6","Type":"ContainerStarted","Data":"5dbdbda93afb725dae6bb6970925a3ed5c5f21fa813435efd31223ff97fe269e"} Sep 19 03:04:22.459026 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.458862 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" podUID="8bf89373-be4e-4ada-a46c-800c265d95f6" containerName="node" containerID="cri-o://de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d" gracePeriod=30 Sep 19 03:04:22.463623 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.463603 2579 scope.go:117] "RemoveContainer" containerID="9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4" Sep 19 03:04:22.463870 ip-10-0-137-27 kubenswrapper[2579]: E0919 03:04:22.463854 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4\": container with ID starting with 9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4 not found: ID does not exist" containerID="9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4" Sep 19 03:04:22.463937 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.463876 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4"} err="failed to get container status \"9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4\": rpc error: code = NotFound desc = could not find container \"9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4\": container with ID starting with 9836b173f914eb59101d50d80aed81a263c4599cc4ac4a68098feaada72620d4 not found: ID does not exist" Sep 19 03:04:22.463937 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.463893 2579 scope.go:117] "RemoveContainer" containerID="3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f" Sep 19 03:04:22.468011 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.467991 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x"] Sep 19 03:04:22.473105 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.473087 2579 scope.go:117] "RemoveContainer" containerID="3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f" Sep 19 03:04:22.473346 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.473327 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-8t64x"] Sep 19 03:04:22.473415 ip-10-0-137-27 kubenswrapper[2579]: E0919 03:04:22.473326 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f\": container with ID starting with 3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f not found: ID does not exist" containerID="3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f" Sep 19 03:04:22.473415 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.473382 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f"} err="failed to get container status \"3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f\": rpc error: code = NotFound desc = could not find container \"3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f\": container with ID starting with 3e107f15ca63d911d69e96e95318e2c5a480345fb60a8f6f2acbd3adfa33429f not found: ID does not exist" Sep 19 03:04:22.483121 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.483103 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq"] Sep 19 03:04:22.485502 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.485482 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-66mtr/e2e-test-runtime-update-node-0-0-6khnq"] Sep 19 03:04:22.498341 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.498301 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" podStartSLOduration=1.4982877540000001 podStartE2EDuration="1.498287754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 03:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 03:04:22.4973649 +0000 UTC m=+1319.043847697" watchObservedRunningTime="2026-09-19 03:04:22.498287754 +0000 UTC m=+1319.044770563" Sep 19 03:04:22.702623 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.702599 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" Sep 19 03:04:22.803809 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.803744 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg447\" (UniqueName: \"kubernetes.io/projected/8bf89373-be4e-4ada-a46c-800c265d95f6-kube-api-access-kg447\") pod \"8bf89373-be4e-4ada-a46c-800c265d95f6\" (UID: \"8bf89373-be4e-4ada-a46c-800c265d95f6\") " Sep 19 03:04:22.805894 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.805863 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bf89373-be4e-4ada-a46c-800c265d95f6-kube-api-access-kg447" (OuterVolumeSpecName: "kube-api-access-kg447") pod "8bf89373-be4e-4ada-a46c-800c265d95f6" (UID: "8bf89373-be4e-4ada-a46c-800c265d95f6"). InnerVolumeSpecName "kube-api-access-kg447". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 03:04:22.905253 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:22.905217 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg447\" (UniqueName: \"kubernetes.io/projected/8bf89373-be4e-4ada-a46c-800c265d95f6-kube-api-access-kg447\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:04:23.464030 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.463999 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" event={"ID":"35f20254-3169-441e-ab8b-3a20bbcf849e","Type":"ContainerStarted","Data":"0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032"} Sep 19 03:04:23.464497 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.464053 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" podUID="35f20254-3169-441e-ab8b-3a20bbcf849e" containerName="node" containerID="cri-o://0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032" gracePeriod=30 Sep 19 03:04:23.466391 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.466369 2579 generic.go:356] "Generic (PLEG): container finished" podID="8bf89373-be4e-4ada-a46c-800c265d95f6" containerID="de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d" exitCode=0 Sep 19 03:04:23.466507 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.466416 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" Sep 19 03:04:23.466507 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.466416 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" event={"ID":"8bf89373-be4e-4ada-a46c-800c265d95f6","Type":"ContainerDied","Data":"de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d"} Sep 19 03:04:23.466613 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.466533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g" event={"ID":"8bf89373-be4e-4ada-a46c-800c265d95f6","Type":"ContainerDied","Data":"5dbdbda93afb725dae6bb6970925a3ed5c5f21fa813435efd31223ff97fe269e"} Sep 19 03:04:23.466613 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.466570 2579 scope.go:117] "RemoveContainer" containerID="de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d" Sep 19 03:04:23.478538 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.478495 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" podStartSLOduration=2.478482187 podStartE2EDuration="2.478482187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 03:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 03:04:23.477431725 +0000 UTC m=+1320.023914526" watchObservedRunningTime="2026-09-19 03:04:23.478482187 +0000 UTC m=+1320.024964985" Sep 19 03:04:23.523234 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.523212 2579 scope.go:117] "RemoveContainer" containerID="de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d" Sep 19 03:04:23.523678 ip-10-0-137-27 kubenswrapper[2579]: E0919 03:04:23.523656 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d\": container with ID starting with de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d not found: ID does not exist" containerID="de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d" Sep 19 03:04:23.523732 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.523688 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d"} err="failed to get container status \"de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d\": rpc error: code = NotFound desc = could not find container \"de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d\": container with ID starting with de57fa72f68ce9603ad4cd51ec21f7d807371f3474182ee8d2b9641da798cf8d not found: ID does not exist" Sep 19 03:04:23.529483 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.529459 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g"] Sep 19 03:04:23.532821 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.532799 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-zgp5g"] Sep 19 03:04:23.691449 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.691417 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ngkhw/must-gather-lvpr9"] Sep 19 03:04:23.691743 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.691731 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf89373-be4e-4ada-a46c-800c265d95f6" containerName="node" Sep 19 03:04:23.691800 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.691745 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf89373-be4e-4ada-a46c-800c265d95f6" containerName="node" Sep 19 03:04:23.691839 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.691815 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bf89373-be4e-4ada-a46c-800c265d95f6" containerName="node" Sep 19 03:04:23.694880 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.694859 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:04:23.697090 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.697071 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ngkhw\"/\"kube-root-ca.crt\"" Sep 19 03:04:23.697213 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.697166 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ngkhw\"/\"default-dockercfg-2wwmj\"" Sep 19 03:04:23.697213 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.697189 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ngkhw\"/\"openshift-service-ca.crt\"" Sep 19 03:04:23.703301 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.703279 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ngkhw/must-gather-lvpr9"] Sep 19 03:04:23.712189 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.712169 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" Sep 19 03:04:23.811334 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.811206 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhd55\" (UniqueName: \"kubernetes.io/projected/35f20254-3169-441e-ab8b-3a20bbcf849e-kube-api-access-dhd55\") pod \"35f20254-3169-441e-ab8b-3a20bbcf849e\" (UID: \"35f20254-3169-441e-ab8b-3a20bbcf849e\") " Sep 19 03:04:23.831044 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.811356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c3041a7-75c9-4d31-8685-2d7c04288e12-must-gather-output\") pod \"must-gather-lvpr9\" (UID: \"9c3041a7-75c9-4d31-8685-2d7c04288e12\") " pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:04:23.831044 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.811435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh2gs\" (UniqueName: \"kubernetes.io/projected/9c3041a7-75c9-4d31-8685-2d7c04288e12-kube-api-access-lh2gs\") pod \"must-gather-lvpr9\" (UID: \"9c3041a7-75c9-4d31-8685-2d7c04288e12\") " pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:04:23.831044 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.813394 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35f20254-3169-441e-ab8b-3a20bbcf849e-kube-api-access-dhd55" (OuterVolumeSpecName: "kube-api-access-dhd55") pod "35f20254-3169-441e-ab8b-3a20bbcf849e" (UID: "35f20254-3169-441e-ab8b-3a20bbcf849e"). InnerVolumeSpecName "kube-api-access-dhd55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 03:04:23.834532 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.834509 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/1.log" Sep 19 03:04:23.835314 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.835294 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/1.log" Sep 19 03:04:23.912047 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.912026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh2gs\" (UniqueName: \"kubernetes.io/projected/9c3041a7-75c9-4d31-8685-2d7c04288e12-kube-api-access-lh2gs\") pod \"must-gather-lvpr9\" (UID: \"9c3041a7-75c9-4d31-8685-2d7c04288e12\") " pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:04:23.912108 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.912066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c3041a7-75c9-4d31-8685-2d7c04288e12-must-gather-output\") pod \"must-gather-lvpr9\" (UID: \"9c3041a7-75c9-4d31-8685-2d7c04288e12\") " pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:04:23.912142 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.912127 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhd55\" (UniqueName: \"kubernetes.io/projected/35f20254-3169-441e-ab8b-3a20bbcf849e-kube-api-access-dhd55\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:04:23.912394 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.912378 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c3041a7-75c9-4d31-8685-2d7c04288e12-must-gather-output\") pod \"must-gather-lvpr9\" (UID: \"9c3041a7-75c9-4d31-8685-2d7c04288e12\") " pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:04:23.919464 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.919444 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ngkhw\"/\"kube-root-ca.crt\"" Sep 19 03:04:23.930119 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.930097 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ngkhw\"/\"openshift-service-ca.crt\"" Sep 19 03:04:23.939549 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.939526 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d41dc14-c43d-465c-89af-cca2f1d761f9" path="/var/lib/kubelet/pods/0d41dc14-c43d-465c-89af-cca2f1d761f9/volumes" Sep 19 03:04:23.939868 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.939855 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bf89373-be4e-4ada-a46c-800c265d95f6" path="/var/lib/kubelet/pods/8bf89373-be4e-4ada-a46c-800c265d95f6/volumes" Sep 19 03:04:23.940139 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.940128 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aac06101-69c1-43f6-a781-b02af4123cfa" path="/var/lib/kubelet/pods/aac06101-69c1-43f6-a781-b02af4123cfa/volumes" Sep 19 03:04:23.940273 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:23.940254 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh2gs\" (UniqueName: \"kubernetes.io/projected/9c3041a7-75c9-4d31-8685-2d7c04288e12-kube-api-access-lh2gs\") pod \"must-gather-lvpr9\" (UID: \"9c3041a7-75c9-4d31-8685-2d7c04288e12\") " pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:04:24.019310 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.019276 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ngkhw\"/\"default-dockercfg-2wwmj\"" Sep 19 03:04:24.027041 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.027004 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:04:24.295044 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.295021 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ngkhw/must-gather-lvpr9"] Sep 19 03:04:24.297364 ip-10-0-137-27 kubenswrapper[2579]: W0919 03:04:24.297342 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c3041a7_75c9_4d31_8685_2d7c04288e12.slice/crio-7df0232cfac731137fa9c2b8b1ce6f5ee95f0b840720ca0a931a5435582dc48d WatchSource:0}: Error finding container 7df0232cfac731137fa9c2b8b1ce6f5ee95f0b840720ca0a931a5435582dc48d: Status 404 returned error can't find the container with id 7df0232cfac731137fa9c2b8b1ce6f5ee95f0b840720ca0a931a5435582dc48d Sep 19 03:04:24.472978 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.472946 2579 generic.go:356] "Generic (PLEG): container finished" podID="35f20254-3169-441e-ab8b-3a20bbcf849e" containerID="0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032" exitCode=0 Sep 19 03:04:24.473431 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.472988 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" Sep 19 03:04:24.473431 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.473040 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" event={"ID":"35f20254-3169-441e-ab8b-3a20bbcf849e","Type":"ContainerDied","Data":"0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032"} Sep 19 03:04:24.473431 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.473082 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd" event={"ID":"35f20254-3169-441e-ab8b-3a20bbcf849e","Type":"ContainerDied","Data":"4ae999ba1d3eb712830caa7d930b6bd57dce0d73611c5e87dc26445eed455933"} Sep 19 03:04:24.473431 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.473100 2579 scope.go:117] "RemoveContainer" containerID="0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032" Sep 19 03:04:24.474287 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.474260 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" event={"ID":"9c3041a7-75c9-4d31-8685-2d7c04288e12","Type":"ContainerStarted","Data":"7df0232cfac731137fa9c2b8b1ce6f5ee95f0b840720ca0a931a5435582dc48d"} Sep 19 03:04:24.481213 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.481197 2579 scope.go:117] "RemoveContainer" containerID="0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032" Sep 19 03:04:24.481457 ip-10-0-137-27 kubenswrapper[2579]: E0919 03:04:24.481436 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032\": container with ID starting with 0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032 not found: ID does not exist" containerID="0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032" Sep 19 03:04:24.481498 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.481467 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032"} err="failed to get container status \"0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032\": rpc error: code = NotFound desc = could not find container \"0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032\": container with ID starting with 0168c37f888e13bd0ceaedde1ff61de8c0a1bad1494b9efbd2d4c52c5ac69032 not found: ID does not exist" Sep 19 03:04:24.486591 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.486566 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd"] Sep 19 03:04:24.491682 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:24.491661 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-llfmm/e2e-test-runtime-update-node-0-0-8b4wd"] Sep 19 03:04:25.942212 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:25.942165 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35f20254-3169-441e-ab8b-3a20bbcf849e" path="/var/lib/kubelet/pods/35f20254-3169-441e-ab8b-3a20bbcf849e/volumes" Sep 19 03:04:31.513279 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:31.513184 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" event={"ID":"9c3041a7-75c9-4d31-8685-2d7c04288e12","Type":"ContainerStarted","Data":"1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf"} Sep 19 03:04:31.513279 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:31.513235 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" event={"ID":"9c3041a7-75c9-4d31-8685-2d7c04288e12","Type":"ContainerStarted","Data":"f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865"} Sep 19 03:04:31.527124 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:04:31.527040 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" podStartSLOduration=2.400329019 podStartE2EDuration="8.527018631s" totalImagesPullingTime="6.126689612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 03:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 03:04:31.526722079 +0000 UTC m=+1328.073204876" watchObservedRunningTime="2026-09-19 03:04:31.527018631 +0000 UTC m=+1328.073501431" Sep 19 03:05:14.716293 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:14.716261 2579 generic.go:356] "Generic (PLEG): container finished" podID="9c3041a7-75c9-4d31-8685-2d7c04288e12" containerID="f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865" exitCode=0 Sep 19 03:05:14.716687 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:14.716324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" event={"ID":"9c3041a7-75c9-4d31-8685-2d7c04288e12","Type":"ContainerDied","Data":"f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865"} Sep 19 03:05:14.716687 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:14.716628 2579 scope.go:117] "RemoveContainer" containerID="f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865" Sep 19 03:05:15.385588 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:15.385558 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ngkhw_must-gather-lvpr9_9c3041a7-75c9-4d31-8685-2d7c04288e12/gather/0.log" Sep 19 03:05:18.804395 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:18.804366 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nhbtz_7a53515b-9a34-4f6a-9e4c-3a27db012dfe/global-pull-secret-syncer/0.log" Sep 19 03:05:18.892797 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:18.892772 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p7ctn_c4b52b9b-8cd9-41cb-883e-802bc91be819/konnectivity-agent/0.log" Sep 19 03:05:18.961795 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:18.961753 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-27.ec2.internal_a273ac8b2cca19fe2190dc3d23e4202f/haproxy/0.log" Sep 19 03:05:20.697569 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:20.697531 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-ngkhw/must-gather-lvpr9"] Sep 19 03:05:20.697986 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:20.697726 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" containerName="copy" containerID="cri-o://1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf" gracePeriod=2 Sep 19 03:05:20.703192 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:20.703171 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-ngkhw/must-gather-lvpr9"] Sep 19 03:05:20.703622 ip-10-0-137-27 kubenswrapper[2579]: E0919 03:05:20.703593 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c3041a7-75c9-4d31-8685-2d7c04288e12\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-ngkhw\"/\"must-gather-lvpr9\": pods \"must-gather-lvpr9\" not found" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:05:20.928687 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:20.928665 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ngkhw_must-gather-lvpr9_9c3041a7-75c9-4d31-8685-2d7c04288e12/copy/0.log" Sep 19 03:05:20.931251 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:20.931235 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:05:20.933365 ip-10-0-137-27 kubenswrapper[2579]: E0919 03:05:20.933340 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lvpr9\" is forbidden: User \"system:node:ip-10-0-137-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ngkhw\": no relationship found between node 'ip-10-0-137-27.ec2.internal' and this object" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:05:20.999466 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:20.999386 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh2gs\" (UniqueName: \"kubernetes.io/projected/9c3041a7-75c9-4d31-8685-2d7c04288e12-kube-api-access-lh2gs\") pod \"9c3041a7-75c9-4d31-8685-2d7c04288e12\" (UID: \"9c3041a7-75c9-4d31-8685-2d7c04288e12\") " Sep 19 03:05:20.999592 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:20.999464 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c3041a7-75c9-4d31-8685-2d7c04288e12-must-gather-output\") pod \"9c3041a7-75c9-4d31-8685-2d7c04288e12\" (UID: \"9c3041a7-75c9-4d31-8685-2d7c04288e12\") " Sep 19 03:05:21.000847 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.000824 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c3041a7-75c9-4d31-8685-2d7c04288e12-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9c3041a7-75c9-4d31-8685-2d7c04288e12" (UID: "9c3041a7-75c9-4d31-8685-2d7c04288e12"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 03:05:21.001531 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.001506 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3041a7-75c9-4d31-8685-2d7c04288e12-kube-api-access-lh2gs" (OuterVolumeSpecName: "kube-api-access-lh2gs") pod "9c3041a7-75c9-4d31-8685-2d7c04288e12" (UID: "9c3041a7-75c9-4d31-8685-2d7c04288e12"). InnerVolumeSpecName "kube-api-access-lh2gs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 03:05:21.100712 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.100684 2579 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c3041a7-75c9-4d31-8685-2d7c04288e12-must-gather-output\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:05:21.100712 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.100709 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh2gs\" (UniqueName: \"kubernetes.io/projected/9c3041a7-75c9-4d31-8685-2d7c04288e12-kube-api-access-lh2gs\") on node \"ip-10-0-137-27.ec2.internal\" DevicePath \"\"" Sep 19 03:05:21.744870 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.744837 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ngkhw_must-gather-lvpr9_9c3041a7-75c9-4d31-8685-2d7c04288e12/copy/0.log" Sep 19 03:05:21.745247 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.745155 2579 generic.go:356] "Generic (PLEG): container finished" podID="9c3041a7-75c9-4d31-8685-2d7c04288e12" containerID="1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf" exitCode=143 Sep 19 03:05:21.745247 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.745209 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:05:21.745323 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.745259 2579 scope.go:117] "RemoveContainer" containerID="1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf" Sep 19 03:05:21.747663 ip-10-0-137-27 kubenswrapper[2579]: E0919 03:05:21.747640 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lvpr9\" is forbidden: User \"system:node:ip-10-0-137-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ngkhw\": no relationship found between node 'ip-10-0-137-27.ec2.internal' and this object" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:05:21.759623 ip-10-0-137-27 kubenswrapper[2579]: E0919 03:05:21.758106 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lvpr9\" is forbidden: User \"system:node:ip-10-0-137-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ngkhw\": no relationship found between node 'ip-10-0-137-27.ec2.internal' and this object" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" pod="openshift-must-gather-ngkhw/must-gather-lvpr9" Sep 19 03:05:21.760774 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.760740 2579 scope.go:117] "RemoveContainer" containerID="f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865" Sep 19 03:05:21.772245 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.772227 2579 scope.go:117] "RemoveContainer" containerID="1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf" Sep 19 03:05:21.772497 ip-10-0-137-27 kubenswrapper[2579]: E0919 03:05:21.772478 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf\": container with ID starting with 1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf not found: ID does not exist" containerID="1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf" Sep 19 03:05:21.772563 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.772502 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf"} err="failed to get container status \"1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf\": rpc error: code = NotFound desc = could not find container \"1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf\": container with ID starting with 1dd398ffc6bcfadf72a566482b1c788fd9aa22c51ade199df13749869ee962bf not found: ID does not exist" Sep 19 03:05:21.772563 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.772518 2579 scope.go:117] "RemoveContainer" containerID="f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865" Sep 19 03:05:21.772740 ip-10-0-137-27 kubenswrapper[2579]: E0919 03:05:21.772721 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865\": container with ID starting with f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865 not found: ID does not exist" containerID="f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865" Sep 19 03:05:21.772799 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.772746 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865"} err="failed to get container status \"f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865\": rpc error: code = NotFound desc = could not find container \"f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865\": container with ID starting with f8bf28b9bf197bee127f7043346445f583626e33e9a437d734b40d1d6d82c865 not found: ID does not exist" Sep 19 03:05:21.938008 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:21.937972 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" path="/var/lib/kubelet/pods/9c3041a7-75c9-4d31-8685-2d7c04288e12/volumes" Sep 19 03:05:22.773752 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:22.773718 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-jdqpd_7cb3cf59-75d2-4c10-8d9c-a95558e93a9d/cluster-monitoring-operator/0.log" Sep 19 03:05:22.879579 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:22.879507 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76f6fd6b49-5v25q_c6d3b7cf-6aa8-4aa5-a824-4f0b6bb176d5/metrics-server/0.log" Sep 19 03:05:23.089637 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.089608 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmb8x_c99cb85e-d225-4a3a-b4c0-b06857d20f8d/node-exporter/0.log" Sep 19 03:05:23.109090 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.109071 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmb8x_c99cb85e-d225-4a3a-b4c0-b06857d20f8d/kube-rbac-proxy/0.log" Sep 19 03:05:23.135343 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.135282 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmb8x_c99cb85e-d225-4a3a-b4c0-b06857d20f8d/init-textfile/0.log" Sep 19 03:05:23.235883 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.235855 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7089d1b6-d31c-4e0b-ad7a-edb279879ae0/prometheus/0.log" Sep 19 03:05:23.256724 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.256705 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7089d1b6-d31c-4e0b-ad7a-edb279879ae0/config-reloader/0.log" Sep 19 03:05:23.280278 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.280256 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7089d1b6-d31c-4e0b-ad7a-edb279879ae0/thanos-sidecar/0.log" Sep 19 03:05:23.303822 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.303806 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7089d1b6-d31c-4e0b-ad7a-edb279879ae0/kube-rbac-proxy-web/0.log" Sep 19 03:05:23.325384 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.325355 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7089d1b6-d31c-4e0b-ad7a-edb279879ae0/kube-rbac-proxy/0.log" Sep 19 03:05:23.345893 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.345872 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7089d1b6-d31c-4e0b-ad7a-edb279879ae0/kube-rbac-proxy-thanos/0.log" Sep 19 03:05:23.368191 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.368170 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7089d1b6-d31c-4e0b-ad7a-edb279879ae0/init-config-reloader/0.log" Sep 19 03:05:23.400571 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.400545 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-hgf4b_472bd32a-6351-4385-ae63-764b3e33fb98/prometheus-operator/0.log" Sep 19 03:05:23.420693 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.420671 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-hgf4b_472bd32a-6351-4385-ae63-764b3e33fb98/kube-rbac-proxy/0.log" Sep 19 03:05:23.446513 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:23.446489 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-6vt98_adde9c46-946d-4d31-aaa0-694f246a8fc1/prometheus-operator-admission-webhook/0.log" Sep 19 03:05:25.456309 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:25.456278 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/1.log" Sep 19 03:05:25.461477 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:25.461458 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8bmqw_6ad93860-508d-4204-ad22-24ddca59afa9/console-operator/2.log" Sep 19 03:05:26.170541 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.170509 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2"] Sep 19 03:05:26.170884 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.170869 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" containerName="copy" Sep 19 03:05:26.170973 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.170886 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" containerName="copy" Sep 19 03:05:26.170973 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.170904 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35f20254-3169-441e-ab8b-3a20bbcf849e" containerName="node" Sep 19 03:05:26.170973 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.170911 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="35f20254-3169-441e-ab8b-3a20bbcf849e" containerName="node" Sep 19 03:05:26.170973 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.170924 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" containerName="gather" Sep 19 03:05:26.170973 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.170933 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" containerName="gather" Sep 19 03:05:26.171212 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.171001 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" containerName="gather" Sep 19 03:05:26.171212 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.171012 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3041a7-75c9-4d31-8685-2d7c04288e12" containerName="copy" Sep 19 03:05:26.171212 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.171022 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="35f20254-3169-441e-ab8b-3a20bbcf849e" containerName="node" Sep 19 03:05:26.175957 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.175939 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.177946 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.177925 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6n98x\"/\"kube-root-ca.crt\"" Sep 19 03:05:26.178998 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.178941 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6n98x\"/\"default-dockercfg-9rkb9\"" Sep 19 03:05:26.178998 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.178991 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6n98x\"/\"openshift-service-ca.crt\"" Sep 19 03:05:26.180659 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.180642 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2"] Sep 19 03:05:26.242355 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.242322 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-podres\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.242479 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.242369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckqw4\" (UniqueName: \"kubernetes.io/projected/62483276-c6cb-495f-b366-e4528c6d5b7b-kube-api-access-ckqw4\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.242479 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.242437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-sys\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.242578 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.242484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-lib-modules\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.242578 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.242503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-proc\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.343191 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.343166 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-lib-modules\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.343292 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.343196 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-proc\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.343292 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.343255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-podres\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.343405 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.343293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckqw4\" (UniqueName: \"kubernetes.io/projected/62483276-c6cb-495f-b366-e4528c6d5b7b-kube-api-access-ckqw4\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.343405 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.343325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-sys\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.343405 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.343349 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-proc\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.343405 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.343348 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-lib-modules\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.343405 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.343402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-sys\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.343581 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.343407 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62483276-c6cb-495f-b366-e4528c6d5b7b-podres\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.350652 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.350629 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckqw4\" (UniqueName: \"kubernetes.io/projected/62483276-c6cb-495f-b366-e4528c6d5b7b-kube-api-access-ckqw4\") pod \"perf-node-gather-daemonset-8vqf2\" (UID: \"62483276-c6cb-495f-b366-e4528c6d5b7b\") " pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.364253 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.364230 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-q7gsx_70555ce4-b805-4e31-8e3d-03ee5495a2a7/volume-data-source-validator/0.log" Sep 19 03:05:26.487135 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.487064 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:26.752781 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.752733 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2"] Sep 19 03:05:26.755214 ip-10-0-137-27 kubenswrapper[2579]: W0919 03:05:26.755190 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod62483276_c6cb_495f_b366_e4528c6d5b7b.slice/crio-66b2e02523c3ece419a27f5838f95919e424e90d4c554d214a9df86bd68f5fc1 WatchSource:0}: Error finding container 66b2e02523c3ece419a27f5838f95919e424e90d4c554d214a9df86bd68f5fc1: Status 404 returned error can't find the container with id 66b2e02523c3ece419a27f5838f95919e424e90d4c554d214a9df86bd68f5fc1 Sep 19 03:05:26.767433 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:26.767411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" event={"ID":"62483276-c6cb-495f-b366-e4528c6d5b7b","Type":"ContainerStarted","Data":"66b2e02523c3ece419a27f5838f95919e424e90d4c554d214a9df86bd68f5fc1"} Sep 19 03:05:27.194183 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:27.194153 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdstj_0a8c3901-cf7e-45de-ab56-9ac78c8d4588/dns/0.log" Sep 19 03:05:27.212629 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:27.212602 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdstj_0a8c3901-cf7e-45de-ab56-9ac78c8d4588/kube-rbac-proxy/0.log" Sep 19 03:05:27.296516 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:27.296492 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j58r8_94c0cdbe-b80a-40be-816b-c1efdaebada8/dns-node-resolver/0.log" Sep 19 03:05:27.719642 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:27.719616 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7d4rq_6fdc1553-466c-416d-8218-0ef10191b152/node-ca/0.log" Sep 19 03:05:27.772487 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:27.772458 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" event={"ID":"62483276-c6cb-495f-b366-e4528c6d5b7b","Type":"ContainerStarted","Data":"f8a9dbcf1f72c3a9140a4defe424f60925c4d4cf476ef641c75ce3e7c45ccf6f"} Sep 19 03:05:27.772653 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:27.772571 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:27.787742 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:27.787699 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" podStartSLOduration=1.787686551 podStartE2EDuration="1.787686551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 03:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 03:05:27.786986155 +0000 UTC m=+1384.333491164" watchObservedRunningTime="2026-09-19 03:05:27.787686551 +0000 UTC m=+1384.334169349" Sep 19 03:05:28.404985 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:28.404960 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-976f6c564-979qp_432e30df-07e6-4293-bc8c-b9e6631d6324/router/0.log" Sep 19 03:05:28.737886 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:28.737806 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m9762_b5747033-7ed2-4d77-a72b-5554fbd8ffe0/serve-healthcheck-canary/0.log" Sep 19 03:05:29.077998 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:29.077897 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-vww7w_1f8d1df1-7e9a-4144-b668-4cc3e1567102/insights-operator/1.log" Sep 19 03:05:29.078758 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:29.078740 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-vww7w_1f8d1df1-7e9a-4144-b668-4cc3e1567102/insights-operator/0.log" Sep 19 03:05:29.217224 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:29.217195 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tbwxd_1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d/kube-rbac-proxy/0.log" Sep 19 03:05:29.235463 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:29.235437 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tbwxd_1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d/exporter/0.log" Sep 19 03:05:29.254291 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:29.254267 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tbwxd_1f1aae18-5911-4cf9-96aa-eb7a7c5a4d2d/extractor/0.log" Sep 19 03:05:33.786087 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:33.786052 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6n98x/perf-node-gather-daemonset-8vqf2" Sep 19 03:05:33.818622 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:33.818598 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-t9b99_2b054038-9f86-4006-88f1-97c1b76891f0/migrator/0.log" Sep 19 03:05:33.839563 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:33.839533 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-t9b99_2b054038-9f86-4006-88f1-97c1b76891f0/graceful-termination/0.log" Sep 19 03:05:35.094119 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:35.094053 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5xkvs_eadd361d-35a7-4c18-aa0a-7e38f9fb78c4/kube-multus-additional-cni-plugins/0.log" Sep 19 03:05:35.115848 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:35.115828 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5xkvs_eadd361d-35a7-4c18-aa0a-7e38f9fb78c4/egress-router-binary-copy/0.log" Sep 19 03:05:35.135470 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:35.135449 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5xkvs_eadd361d-35a7-4c18-aa0a-7e38f9fb78c4/cni-plugins/0.log" Sep 19 03:05:35.184673 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:35.184646 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5xkvs_eadd361d-35a7-4c18-aa0a-7e38f9fb78c4/bond-cni-plugin/0.log" Sep 19 03:05:35.204315 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:35.204294 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5xkvs_eadd361d-35a7-4c18-aa0a-7e38f9fb78c4/routeoverride-cni/0.log" Sep 19 03:05:35.224493 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:35.224470 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5xkvs_eadd361d-35a7-4c18-aa0a-7e38f9fb78c4/whereabouts-cni-bincopy/0.log" Sep 19 03:05:35.250192 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:35.250174 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5xkvs_eadd361d-35a7-4c18-aa0a-7e38f9fb78c4/whereabouts-cni/0.log" Sep 19 03:05:35.632619 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:35.632589 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qnkgw_dde6afb9-b468-47df-b086-08d4ffff5fde/kube-multus/0.log" Sep 19 03:05:35.754758 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:35.754667 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7jpb8_924b04f6-d98c-445a-ad4b-feef03aa9f67/network-metrics-daemon/0.log" Sep 19 03:05:35.774416 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:35.774391 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7jpb8_924b04f6-d98c-445a-ad4b-feef03aa9f67/kube-rbac-proxy/0.log" Sep 19 03:05:36.601441 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:36.601415 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gsmzv_d8991102-63cd-4f82-8c04-acd42fb82c2a/ovn-controller/0.log" Sep 19 03:05:36.619701 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:36.619677 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gsmzv_d8991102-63cd-4f82-8c04-acd42fb82c2a/ovn-acl-logging/0.log" Sep 19 03:05:36.643270 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:36.643250 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gsmzv_d8991102-63cd-4f82-8c04-acd42fb82c2a/kube-rbac-proxy-node/0.log" Sep 19 03:05:36.672133 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:36.672114 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gsmzv_d8991102-63cd-4f82-8c04-acd42fb82c2a/kube-rbac-proxy-ovn-metrics/0.log" Sep 19 03:05:36.689457 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:36.689438 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gsmzv_d8991102-63cd-4f82-8c04-acd42fb82c2a/northd/0.log" Sep 19 03:05:36.712300 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:36.712255 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gsmzv_d8991102-63cd-4f82-8c04-acd42fb82c2a/nbdb/0.log" Sep 19 03:05:36.735791 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:36.735758 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gsmzv_d8991102-63cd-4f82-8c04-acd42fb82c2a/sbdb/0.log" Sep 19 03:05:36.770522 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:36.770501 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gsmzv_d8991102-63cd-4f82-8c04-acd42fb82c2a/ovnkube-controller/0.log" Sep 19 03:05:37.929154 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:37.929114 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vjcgr_d22cd897-e0d4-4d29-8ad2-c75cd27f1a11/network-check-target-container/0.log" Sep 19 03:05:38.803525 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:38.803499 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-c7x9d_cd5f2ab1-66bd-442e-878a-38b76d70f702/iptables-alerter/0.log" Sep 19 03:05:39.387215 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:39.387185 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-252nd_f8aa6346-b659-436f-b75e-440d5e15c5d9/tuned/0.log" Sep 19 03:05:42.534490 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:42.534456 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-5n482_a6f886a6-d581-4ae4-b26d-d832521867db/csi-driver/0.log" Sep 19 03:05:42.553913 ip-10-0-137-27 kubenswrapper[2579]: I0919 03:05:42.553891 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-5n482_a6f886a6-d581-4ae4-b26d-d832521867db/csi-node-driver-registrar/0.log"